Oct 16 18:19:45 user nova-compute[74247]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74247) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74247) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74247) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 16 18:19:45 user nova-compute[74247]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:19:45 user nova-compute[74247]: INFO nova.virt.driver [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] Loading compute driver 'libvirt.LibvirtDriver'
Oct 16 18:19:45 user nova-compute[74247]: INFO nova.compute.provider_config [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] Acquiring lock "singleton_lock" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] Acquired lock "singleton_lock" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] Releasing lock "singleton_lock" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] Full set of CONF: {{(pid=74247) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] ******************************************************************************** {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] Configuration options gathered from: {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] ================================================================================ {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] allow_resize_to_same_host      = True {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] arq_binding_timeout            = 300 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] backdoor_port                  = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] backdoor_socket                = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] block_device_allocate_retries  = 300 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] block_device_allocate_retries_interval = 5 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cert                           = self.pem {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] compute_monitors               = [] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] config_dir                     = [] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] config_drive_format            = iso9660 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] config_source                  = [] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] console_host                   = user {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] control_exchange               = nova {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cpu_allocation_ratio           = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] daemon                         = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] debug                          = True {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] default_access_ip_network_name = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] default_availability_zone      = nova {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] default_ephemeral_format       = ext4 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] default_green_pool_size        = 1000 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] default_schedule_zone          = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] disk_allocation_ratio          = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] enable_new_services            = True {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] enabled_apis                   = ['osapi_compute'] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] enabled_ssl_apis               = [] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] flat_injected                  = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] force_config_drive             = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] force_raw_images               = True {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] graceful_shutdown_timeout      = 5 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] heal_instance_info_cache_interval = 60 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] host                           = user {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] instance_build_timeout         = 0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] instance_delete_interval       = 300 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] instance_name_template         = instance-%08x {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] instance_usage_audit           = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] instance_usage_audit_period    = month {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] internal_service_availability_zone = internal {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] key                            = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] live_migration_retry_count     = 30 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] log_config_append              = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] log_dir                        = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] log_file                       = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] log_options                    = True {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] log_rotate_interval            = 1 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] log_rotate_interval_type       = days {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] log_rotation_type              = none {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] long_rpc_timeout               = 1800 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] max_concurrent_builds          = 10 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] max_concurrent_live_migrations = 1 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] max_concurrent_snapshots       = 5 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] max_local_block_devices        = 3 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] max_logfile_count              = 30 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] max_logfile_size_mb            = 200 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] maximum_instance_delete_attempts = 5 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] metadata_listen                = 0.0.0.0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] metadata_listen_port           = 8775 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] metadata_workers               = 3 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] migrate_max_retries            = -1 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] mkisofs_cmd                    = genisoimage {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] my_ip                          = 10.0.0.210 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] network_allocate_retries       = 0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] osapi_compute_listen_port      = 8774 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] osapi_compute_unique_server_name_scope =  {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] osapi_compute_workers          = 3 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] password_length                = 12 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] periodic_enable                = True {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] periodic_fuzzy_delay           = 60 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] pointer_model                  = ps2mouse {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] preallocate_images             = none {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] publish_errors                 = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] pybasedir                      = /opt/stack/nova {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] ram_allocation_ratio           = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] rate_limit_burst               = 0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] rate_limit_except_level        = CRITICAL {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] rate_limit_interval            = 0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] reboot_timeout                 = 0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] reclaim_instance_interval      = 0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] record                         = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] reimage_timeout_per_gb         = 60 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] report_interval                = 120 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] rescue_timeout                 = 0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] reserved_host_cpus             = 0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] reserved_host_disk_mb          = 0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] reserved_host_memory_mb        = 512 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] reserved_huge_pages            = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] resize_confirm_window          = 0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] resize_fs_using_block_device   = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] resume_guests_state_on_host_boot = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] rpc_response_timeout           = 60 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] run_external_periodic_tasks    = True {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] running_deleted_instance_action = reap {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] running_deleted_instance_poll_interval = 1800 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] running_deleted_instance_timeout = 0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] scheduler_instance_sync_interval = 120 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] service_down_time              = 720 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] servicegroup_driver            = db {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] shelved_offload_time           = 0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] shelved_poll_interval          = 3600 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] shutdown_timeout               = 0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] source_is_ipv6                 = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] ssl_only                       = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] state_path                     = /opt/stack/data/nova {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] sync_power_state_interval      = 600 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] sync_power_state_pool_size     = 1000 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] syslog_log_facility            = LOG_USER {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] tempdir                        = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] timeout_nbd                    = 10 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] transport_url                  = **** {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] update_resources_interval      = 0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] use_cow_images                 = True {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] use_eventlog                   = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] use_journal                    = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] use_json                       = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] use_rootwrap_daemon            = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] use_stderr                     = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] use_syslog                     = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vcpu_pin_set                   = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vif_plugging_is_fatal          = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vif_plugging_timeout           = 0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] virt_mkfs                      = [] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] volume_usage_poll_interval     = 0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] watch_log_file                 = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] web                            = /usr/share/spice-html5 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_concurrency.disable_process_locking = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] api.auth_strategy              = keystone {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] api.compute_link_prefix        = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] api.dhcp_domain                = novalocal {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] api.enable_instance_password   = True {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:45 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] api.glance_link_prefix         = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] api.instance_list_per_project_cells = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] api.list_records_by_skipping_down_cells = True {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] api.local_metadata_per_cell    = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] api.max_limit                  = 1000 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] api.metadata_cache_expiration  = 15 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] api.neutron_default_tenant_id  = default {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] api.use_forwarded_for          = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] api.use_neutron_default_nets   = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] api.vendordata_dynamic_targets = [] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] api.vendordata_jsonfile_path   = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cache.backend                  = dogpile.cache.memcached {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cache.backend_argument         = **** {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cache.config_prefix            = cache.oslo {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cache.dead_timeout             = 60.0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cache.debug_cache_backend      = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cache.enable_retry_client      = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cache.enable_socket_keepalive  = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cache.enabled                  = True {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cache.expiration_time          = 600 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cache.hashclient_retry_attempts = 2 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cache.memcache_dead_retry      = 300 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cache.memcache_password        =  {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cache.memcache_sasl_enabled    = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cache.memcache_username        =  {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cache.proxies                  = [] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cache.retry_attempts           = 2 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cache.retry_delay              = 0.0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cache.socket_keepalive_count   = 1 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cache.socket_keepalive_idle    = 1 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cache.socket_keepalive_interval = 1 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cache.tls_allowed_ciphers      = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cache.tls_cafile               = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cache.tls_certfile             = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cache.tls_enabled              = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cache.tls_keyfile              = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cinder.auth_section            = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cinder.auth_type               = password {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cinder.cafile                  = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cinder.certfile                = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cinder.collect_timing          = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cinder.cross_az_attach         = True {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cinder.debug                   = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cinder.endpoint_template       = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cinder.http_retries            = 3 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cinder.insecure                = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cinder.keyfile                 = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cinder.os_region_name          = RegionOne {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cinder.split_loggers           = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cinder.timeout                 = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] compute.cpu_dedicated_set      = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] compute.cpu_shared_set         = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] compute.image_type_exclude_list = [] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] compute.max_concurrent_disk_ops = 0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] compute.max_disk_devices_to_attach = -1 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] compute.resource_provider_association_refresh = 300 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] compute.shutdown_retry_interval = 10 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] conductor.workers              = 3 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] console.allowed_origins        = [] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] console.ssl_ciphers            = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] console.ssl_minimum_version    = default {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] consoleauth.token_ttl          = 600 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cyborg.cafile                  = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cyborg.certfile                = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cyborg.collect_timing          = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cyborg.connect_retries         = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cyborg.connect_retry_delay     = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cyborg.endpoint_override       = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cyborg.insecure                = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cyborg.keyfile                 = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cyborg.max_version             = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cyborg.min_version             = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cyborg.region_name             = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cyborg.service_name            = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cyborg.service_type            = accelerator {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cyborg.split_loggers           = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cyborg.status_code_retries     = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cyborg.status_code_retry_delay = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cyborg.timeout                 = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] cyborg.version                 = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] database.backend               = sqlalchemy {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] database.connection            = **** {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] database.connection_debug      = 0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] database.connection_parameters =  {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] database.connection_recycle_time = 3600 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] database.connection_trace      = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] database.db_inc_retry_interval = True {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] database.db_max_retries        = 20 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] database.db_max_retry_interval = 10 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] database.db_retry_interval     = 1 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] database.max_overflow          = 50 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] database.max_pool_size         = 5 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] database.max_retries           = 10 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] database.mysql_wsrep_sync_wait = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] database.pool_timeout          = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] database.retry_interval        = 10 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] database.slave_connection      = **** {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] database.sqlite_synchronous    = True {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] api_database.backend           = sqlalchemy {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] api_database.connection        = **** {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] api_database.connection_debug  = 0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] api_database.connection_parameters =  {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] api_database.connection_recycle_time = 3600 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] api_database.connection_trace  = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] api_database.db_inc_retry_interval = True {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] api_database.db_max_retries    = 20 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] api_database.db_max_retry_interval = 10 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] api_database.db_retry_interval = 1 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] api_database.max_overflow      = 50 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] api_database.max_pool_size     = 5 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] api_database.max_retries       = 10 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] api_database.pool_timeout      = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] api_database.retry_interval    = 10 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] api_database.slave_connection  = **** {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] api_database.sqlite_synchronous = True {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] devices.enabled_mdev_types     = [] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] ephemeral_storage_encryption.enabled = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] glance.api_servers             = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] glance.cafile                  = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] glance.certfile                = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] glance.collect_timing          = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] glance.connect_retries         = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] glance.connect_retry_delay     = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] glance.debug                   = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] glance.default_trusted_certificate_ids = [] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] glance.enable_certificate_validation = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] glance.enable_rbd_download     = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] glance.endpoint_override       = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] glance.insecure                = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] glance.keyfile                 = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] glance.max_version             = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] glance.min_version             = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] glance.num_retries             = 3 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] glance.rbd_ceph_conf           =  {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] glance.rbd_connect_timeout     = 5 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] glance.rbd_pool                =  {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] glance.rbd_user                =  {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] glance.region_name             = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] glance.service_name            = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] glance.service_type            = image {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] glance.split_loggers           = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] glance.status_code_retries     = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] glance.status_code_retry_delay = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] glance.timeout                 = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] glance.verify_glance_signatures = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] glance.version                 = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] guestfs.debug                  = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] hyperv.config_drive_cdrom      = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] hyperv.config_drive_inject_password = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] hyperv.enable_instance_metrics_collection = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] hyperv.enable_remotefx         = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] hyperv.instances_path_share    =  {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] hyperv.iscsi_initiator_list    = [] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] hyperv.limit_cpu_features      = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] hyperv.power_state_check_timeframe = 60 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] hyperv.use_multipath_io        = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] hyperv.volume_attach_retry_count = 10 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] hyperv.vswitch_name            = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] mks.enabled                    = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] image_cache.manager_interval   = 2400 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] image_cache.precache_concurrency = 1 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] image_cache.remove_unused_base_images = True {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] image_cache.subdirectory_name  = _base {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] ironic.api_max_retries         = 60 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] ironic.api_retry_interval      = 2 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] ironic.auth_section            = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] ironic.auth_type               = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] ironic.cafile                  = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] ironic.certfile                = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] ironic.collect_timing          = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] ironic.conductor_group         = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] ironic.connect_retries         = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] ironic.connect_retry_delay     = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] ironic.endpoint_override       = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] ironic.insecure                = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] ironic.keyfile                 = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] ironic.max_version             = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] ironic.min_version             = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] ironic.peer_list               = [] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] ironic.region_name             = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] ironic.serial_console_state_timeout = 10 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] ironic.service_name            = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] ironic.service_type            = baremetal {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] ironic.split_loggers           = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] ironic.status_code_retries     = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] ironic.status_code_retry_delay = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] ironic.timeout                 = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] ironic.version                 = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] key_manager.fixed_key          = **** {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] barbican.barbican_api_version  = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] barbican.barbican_endpoint     = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] barbican.barbican_endpoint_type = public {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] barbican.barbican_region_name  = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] barbican.cafile                = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] barbican.certfile              = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] barbican.collect_timing        = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] barbican.insecure              = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] barbican.keyfile               = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] barbican.number_of_retries     = 60 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] barbican.retry_delay           = 1 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] barbican.send_service_user_token = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] barbican.split_loggers         = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] barbican.timeout               = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] barbican.verify_ssl            = True {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] barbican.verify_ssl_path       = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] barbican_service_user.auth_section = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] barbican_service_user.auth_type = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] barbican_service_user.cafile   = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] barbican_service_user.certfile = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] barbican_service_user.collect_timing = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] barbican_service_user.insecure = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] barbican_service_user.keyfile  = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] barbican_service_user.split_loggers = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] barbican_service_user.timeout  = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vault.approle_role_id          = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vault.approle_secret_id        = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vault.cafile                   = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vault.certfile                 = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vault.collect_timing           = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vault.insecure                 = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vault.keyfile                  = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vault.kv_mountpoint            = secret {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vault.kv_path                  = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vault.kv_version               = 2 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vault.namespace                = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vault.root_token_id            = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vault.split_loggers            = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vault.ssl_ca_crt_file          = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vault.timeout                  = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vault.use_ssl                  = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] keystone.auth_section          = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] keystone.auth_type             = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] keystone.cafile                = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] keystone.certfile              = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] keystone.collect_timing        = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] keystone.connect_retries       = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] keystone.connect_retry_delay   = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] keystone.endpoint_override     = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] keystone.insecure              = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] keystone.keyfile               = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] keystone.max_version           = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] keystone.min_version           = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] keystone.region_name           = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] keystone.service_name          = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] keystone.service_type          = identity {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] keystone.split_loggers         = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] keystone.status_code_retries   = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] keystone.status_code_retry_delay = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] keystone.timeout               = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] keystone.version               = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.connection_uri         =  {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.cpu_mode               = custom {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: WARNING oslo_config.cfg [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.cpu_power_governor_high = performance {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.cpu_power_governor_low = powersave {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.cpu_power_management   = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.device_detach_attempts = 8 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.device_detach_timeout  = 20 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.disk_cachemodes        = [] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.disk_prefix            = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.enabled_perf_events    = [] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.file_backed_memory     = 0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.gid_maps               = [] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.hw_disk_discard        = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.hw_machine_type        = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.images_rbd_glance_store_name =  {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.images_rbd_pool        = rbd {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.images_type            = default {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.images_volume_group    = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.inject_key             = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.inject_partition       = -2 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.inject_password        = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.iscsi_iface            = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.iser_use_multipath     = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.live_migration_bandwidth = 0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.live_migration_downtime = 500 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.live_migration_inbound_addr = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.live_migration_permit_post_copy = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.live_migration_scheme  = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.live_migration_timeout_action = abort {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.live_migration_tunnelled = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: WARNING oslo_config.cfg [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Oct 16 18:19:46 user nova-compute[74247]: live_migration_uri is deprecated for removal in favor of two other options that
Oct 16 18:19:46 user nova-compute[74247]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Oct 16 18:19:46 user nova-compute[74247]: and ``live_migration_inbound_addr`` respectively.
Oct 16 18:19:46 user nova-compute[74247]: ).  Its value may be silently ignored in the future.
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.live_migration_with_native_tls = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.max_queues             = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.nfs_mount_options      = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.num_memory_encrypted_guests = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.num_pcie_ports         = 0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.pmem_namespaces        = [] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.quobyte_client_cfg     = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.rbd_secret_uuid        = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.rbd_user               = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.remote_filesystem_transport = ssh {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.rescue_image_id        = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.rescue_kernel_id       = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.rescue_ramdisk_id      = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.rx_queue_size          = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.smbfs_mount_options    =  {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.snapshot_compression   = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.snapshot_image_format  = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.sparse_logical_volumes = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.swtpm_enabled          = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.swtpm_group            = tss {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.swtpm_user             = tss {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.sysinfo_serial         = unique {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.tb_cache_size          = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.tx_queue_size          = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.uid_maps               = [] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.use_virtio_for_bridges = True {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.virt_type              = kvm {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.volume_clear           = zero {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.volume_clear_size      = 0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.volume_use_multipath   = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.vzstorage_cache_path   = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.vzstorage_mount_user   = stack {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] neutron.auth_section           = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] neutron.auth_type              = password {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] neutron.cafile                 = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] neutron.certfile               = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] neutron.collect_timing         = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] neutron.connect_retries        = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] neutron.connect_retry_delay    = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] neutron.default_floating_pool  = public {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] neutron.endpoint_override      = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] neutron.extension_sync_interval = 600 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] neutron.http_retries           = 3 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] neutron.insecure               = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] neutron.keyfile                = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] neutron.max_version            = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] neutron.min_version            = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] neutron.ovs_bridge             = br-int {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] neutron.physnets               = [] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] neutron.region_name            = RegionOne {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] neutron.service_metadata_proxy = True {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] neutron.service_name           = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] neutron.service_type           = network {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] neutron.split_loggers          = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] neutron.status_code_retries    = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] neutron.status_code_retry_delay = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] neutron.timeout                = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] neutron.version                = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] notifications.bdms_in_notifications = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] notifications.default_level    = INFO {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] notifications.notification_format = unversioned {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] notifications.notify_on_state_change = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] pci.alias                      = [] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] pci.device_spec                = [] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] pci.report_in_placement        = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] placement.auth_section         = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] placement.auth_type            = password {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] placement.cafile               = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] placement.certfile             = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] placement.collect_timing       = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] placement.connect_retries      = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] placement.connect_retry_delay  = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] placement.default_domain_id    = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] placement.default_domain_name  = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] placement.domain_id            = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] placement.domain_name          = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] placement.endpoint_override    = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] placement.insecure             = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] placement.keyfile              = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] placement.max_version          = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] placement.min_version          = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] placement.password             = **** {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] placement.project_domain_id    = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] placement.project_domain_name  = Default {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] placement.project_id           = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] placement.project_name         = service {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] placement.region_name          = RegionOne {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] placement.service_name         = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] placement.service_type         = placement {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] placement.split_loggers        = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] placement.status_code_retries  = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] placement.status_code_retry_delay = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] placement.system_scope         = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] placement.timeout              = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] placement.trust_id             = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] placement.user_domain_id       = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] placement.user_domain_name     = Default {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] placement.user_id              = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] placement.username             = placement {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] placement.version              = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] quota.cores                    = 20 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] quota.count_usage_from_placement = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] quota.injected_file_content_bytes = 10240 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] quota.injected_file_path_length = 255 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] quota.injected_files           = 5 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] quota.instances                = 10 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] quota.key_pairs                = 100 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] quota.metadata_items           = 128 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] quota.ram                      = 51200 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] quota.recheck_quota            = True {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] quota.server_group_members     = 10 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] quota.server_groups            = 10 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] rdp.enabled                    = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] scheduler.image_metadata_prefilter = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] scheduler.max_attempts         = 3 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] scheduler.max_placement_results = 1000 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] scheduler.query_placement_for_image_type_support = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] scheduler.workers              = 3 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] filter_scheduler.host_subset_size = 1 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] filter_scheduler.isolated_hosts = [] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] filter_scheduler.isolated_images = [] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] filter_scheduler.pci_in_placement = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] filter_scheduler.track_instance_changes = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] metrics.required               = True {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] metrics.weight_multiplier      = 1.0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] metrics.weight_setting         = [] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] serial_console.enabled         = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] serial_console.port_range      = 10000:20000 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] serial_console.serialproxy_port = 6083 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] service_user.auth_section      = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] service_user.auth_type         = password {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] service_user.cafile            = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] service_user.certfile          = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] service_user.collect_timing    = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] service_user.insecure          = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] service_user.keyfile           = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] service_user.send_service_user_token = True {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] service_user.split_loggers     = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] service_user.timeout           = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] spice.agent_enabled            = True {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] spice.enabled                  = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] spice.html5proxy_port          = 6082 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] spice.image_compression        = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] spice.jpeg_compression         = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] spice.playback_compression     = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] spice.server_listen            = 127.0.0.1 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] spice.streaming_mode           = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] spice.zlib_compression         = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] upgrade_levels.baseapi         = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] upgrade_levels.cert            = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] upgrade_levels.compute         = auto {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] upgrade_levels.conductor       = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] upgrade_levels.scheduler       = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vendordata_dynamic_auth.auth_section = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vendordata_dynamic_auth.auth_type = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vendordata_dynamic_auth.cafile = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vendordata_dynamic_auth.certfile = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vendordata_dynamic_auth.insecure = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vendordata_dynamic_auth.keyfile = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vendordata_dynamic_auth.timeout = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vmware.api_retry_count         = 10 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vmware.ca_file                 = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vmware.cache_prefix            = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vmware.cluster_name            = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vmware.connection_pool_size    = 10 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vmware.console_delay_seconds   = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vmware.datastore_regex         = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vmware.host_ip                 = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vmware.host_password           = **** {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vmware.host_port               = 443 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vmware.host_username           = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vmware.insecure                = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vmware.integration_bridge      = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vmware.maximum_objects         = 100 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vmware.pbm_default_policy      = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vmware.pbm_enabled             = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vmware.pbm_wsdl_location       = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vmware.serial_port_proxy_uri   = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vmware.serial_port_service_uri = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vmware.task_poll_interval      = 0.5 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vmware.use_linked_clone        = True {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vmware.vnc_keymap              = en-us {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vmware.vnc_port                = 5900 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vmware.vnc_port_total          = 10000 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vnc.auth_schemes               = ['none'] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vnc.enabled                    = True {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vnc.novncproxy_port            = 6080 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vnc.server_listen              = 0.0.0.0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vnc.vencrypt_ca_certs          = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vnc.vencrypt_client_cert       = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vnc.vencrypt_client_key        = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] workarounds.disable_rootwrap   = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] workarounds.enable_numa_live_migration = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] workarounds.libvirt_disable_apic = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] wsgi.client_socket_timeout     = 900 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] wsgi.default_pool_size         = 1000 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] wsgi.keep_alive                = True {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] wsgi.max_header_line           = 16384 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] wsgi.ssl_ca_file               = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] wsgi.ssl_cert_file             = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] wsgi.ssl_key_file              = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] wsgi.tcp_keepidle              = 600 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] zvm.ca_file                    = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] zvm.cloud_connector_url        = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] zvm.reachable_timeout          = 300 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_policy.enforce_new_defaults = True {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_policy.enforce_scope      = True {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_policy.policy_default_rule = default {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] profiler.connection_string     = messaging:// {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] profiler.enabled               = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] profiler.es_doc_type           = notification {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] profiler.es_scroll_size        = 10000 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] profiler.es_scroll_time        = 2m {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] profiler.filter_error_trace    = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] profiler.hmac_keys             = **** {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] profiler.sentinel_service_name = mymaster {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] profiler.socket_timeout        = 0.1 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] profiler.trace_requests        = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] profiler.trace_sqlalchemy      = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] profiler_jaeger.process_tags   = {} {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] profiler_jaeger.service_name_prefix = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] profiler_otlp.service_name_prefix = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] remote_debug.host              = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] remote_debug.port              = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_messaging_notifications.retry = -1 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_limit.auth_section        = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_limit.auth_type           = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_limit.cafile              = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_limit.certfile            = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_limit.collect_timing      = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_limit.connect_retries     = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_limit.connect_retry_delay = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_limit.endpoint_id         = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_limit.endpoint_override   = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_limit.insecure            = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_limit.keyfile             = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_limit.max_version         = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_limit.min_version         = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_limit.region_name         = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_limit.service_name        = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_limit.service_type        = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_limit.split_loggers       = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_limit.status_code_retries = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_limit.status_code_retry_delay = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_limit.timeout             = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_limit.valid_interfaces    = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_limit.version             = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_reports.file_event_handler = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] oslo_reports.log_dir           = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vif_plug_ovs_privileged.group  = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] vif_plug_ovs_privileged.user   = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] os_vif_linux_bridge.flat_interface = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] os_vif_ovs.isolate_vif         = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] os_vif_ovs.per_port_bridge     = False {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] os_brick.lock_path             = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] privsep_osbrick.capabilities   = [21] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] privsep_osbrick.group          = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] privsep_osbrick.helper_command = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] privsep_osbrick.user           = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] nova_sys_admin.group           = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] nova_sys_admin.helper_command  = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] nova_sys_admin.user            = None {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG oslo_service.service [None req-d6938733-a4c7-4a7c-9fe1-6d9292070ee1 None None] ******************************************************************************** {{(pid=74247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Oct 16 18:19:46 user nova-compute[74247]: INFO nova.service [-] Starting compute node (version 0.0.0)
Oct 16 18:19:46 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Connecting to libvirt: qemu:///system {{(pid=74247) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fe079b351e0> {{(pid=74247) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Oct 16 18:19:46 user nova-compute[74247]: libvirt:  error : internal error: could not initialize domain event timer
Oct 16 18:19:46 user nova-compute[74247]: WARNING nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Oct 16 18:19:46 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fe079b351e0> {{(pid=74247) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Starting native event thread {{(pid=74247) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Starting green dispatch thread {{(pid=74247) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Oct 16 18:19:46 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Starting connection event dispatch thread {{(pid=74247) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Oct 16 18:19:46 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Connection event '1' reason 'None'
Oct 16 18:19:46 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 16 18:19:46 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.mount [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Initialising _HostMountState generation 0 {{(pid=74247) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Oct 16 18:19:53 user nova-compute[74247]: INFO nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Libvirt host capabilities <capabilities>
Oct 16 18:19:53 user nova-compute[74247]:   <host>
Oct 16 18:19:53 user nova-compute[74247]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Oct 16 18:19:53 user nova-compute[74247]:     <cpu>
Oct 16 18:19:53 user nova-compute[74247]:       <arch>x86_64</arch>
Oct 16 18:19:53 user nova-compute[74247]:       <model>IvyBridge-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <vendor>Intel</vendor>
Oct 16 18:19:53 user nova-compute[74247]:       <microcode version='1070'/>
Oct 16 18:19:53 user nova-compute[74247]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Oct 16 18:19:53 user nova-compute[74247]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature name='ss'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature name='vmx'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature name='pcid'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature name='osxsave'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature name='hypervisor'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature name='arat'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature name='tsc_adjust'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature name='md-clear'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature name='stibp'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature name='arch-capabilities'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature name='ssbd'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature name='invtsc'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature name='rsba'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature name='skip-l1dfl-vmentry'/>
Oct 16 18:19:53 user nova-compute[74247]:       <pages unit='KiB' size='4'/>
Oct 16 18:19:53 user nova-compute[74247]:       <pages unit='KiB' size='2048'/>
Oct 16 18:19:53 user nova-compute[74247]:     </cpu>
Oct 16 18:19:53 user nova-compute[74247]:     <power_management>
Oct 16 18:19:53 user nova-compute[74247]:       <suspend_mem/>
Oct 16 18:19:53 user nova-compute[74247]:       <suspend_disk/>
Oct 16 18:19:53 user nova-compute[74247]:       <suspend_hybrid/>
Oct 16 18:19:53 user nova-compute[74247]:     </power_management>
Oct 16 18:19:53 user nova-compute[74247]:     <iommu support='no'/>
Oct 16 18:19:53 user nova-compute[74247]:     <migration_features>
Oct 16 18:19:53 user nova-compute[74247]:       <live/>
Oct 16 18:19:53 user nova-compute[74247]:       <uri_transports>
Oct 16 18:19:53 user nova-compute[74247]:         <uri_transport>tcp</uri_transport>
Oct 16 18:19:53 user nova-compute[74247]:         <uri_transport>rdma</uri_transport>
Oct 16 18:19:53 user nova-compute[74247]:       </uri_transports>
Oct 16 18:19:53 user nova-compute[74247]:     </migration_features>
Oct 16 18:19:53 user nova-compute[74247]:     <topology>
Oct 16 18:19:53 user nova-compute[74247]:       <cells num='2'>
Oct 16 18:19:53 user nova-compute[74247]:         <cell id='0'>
Oct 16 18:19:53 user nova-compute[74247]:           <memory unit='KiB'>8140616</memory>
Oct 16 18:19:53 user nova-compute[74247]:           <pages unit='KiB' size='4'>2035154</pages>
Oct 16 18:19:53 user nova-compute[74247]:           <pages unit='KiB' size='2048'>0</pages>
Oct 16 18:19:53 user nova-compute[74247]:           <distances>
Oct 16 18:19:53 user nova-compute[74247]:             <sibling id='0' value='10'/>
Oct 16 18:19:53 user nova-compute[74247]:             <sibling id='1' value='20'/>
Oct 16 18:19:53 user nova-compute[74247]:           </distances>
Oct 16 18:19:53 user nova-compute[74247]:           <cpus num='6'>
Oct 16 18:19:53 user nova-compute[74247]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Oct 16 18:19:53 user nova-compute[74247]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Oct 16 18:19:53 user nova-compute[74247]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Oct 16 18:19:53 user nova-compute[74247]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Oct 16 18:19:53 user nova-compute[74247]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Oct 16 18:19:53 user nova-compute[74247]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Oct 16 18:19:53 user nova-compute[74247]:           </cpus>
Oct 16 18:19:53 user nova-compute[74247]:         </cell>
Oct 16 18:19:53 user nova-compute[74247]:         <cell id='1'>
Oct 16 18:19:53 user nova-compute[74247]:           <memory unit='KiB'>8255068</memory>
Oct 16 18:19:53 user nova-compute[74247]:           <pages unit='KiB' size='4'>2063767</pages>
Oct 16 18:19:53 user nova-compute[74247]:           <pages unit='KiB' size='2048'>0</pages>
Oct 16 18:19:53 user nova-compute[74247]:           <distances>
Oct 16 18:19:53 user nova-compute[74247]:             <sibling id='0' value='20'/>
Oct 16 18:19:53 user nova-compute[74247]:             <sibling id='1' value='10'/>
Oct 16 18:19:53 user nova-compute[74247]:           </distances>
Oct 16 18:19:53 user nova-compute[74247]:           <cpus num='6'>
Oct 16 18:19:53 user nova-compute[74247]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Oct 16 18:19:53 user nova-compute[74247]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Oct 16 18:19:53 user nova-compute[74247]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Oct 16 18:19:53 user nova-compute[74247]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Oct 16 18:19:53 user nova-compute[74247]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Oct 16 18:19:53 user nova-compute[74247]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Oct 16 18:19:53 user nova-compute[74247]:           </cpus>
Oct 16 18:19:53 user nova-compute[74247]:         </cell>
Oct 16 18:19:53 user nova-compute[74247]:       </cells>
Oct 16 18:19:53 user nova-compute[74247]:     </topology>
Oct 16 18:19:53 user nova-compute[74247]:     <cache>
Oct 16 18:19:53 user nova-compute[74247]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Oct 16 18:19:53 user nova-compute[74247]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Oct 16 18:19:53 user nova-compute[74247]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Oct 16 18:19:53 user nova-compute[74247]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Oct 16 18:19:53 user nova-compute[74247]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Oct 16 18:19:53 user nova-compute[74247]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Oct 16 18:19:53 user nova-compute[74247]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Oct 16 18:19:53 user nova-compute[74247]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Oct 16 18:19:53 user nova-compute[74247]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Oct 16 18:19:53 user nova-compute[74247]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Oct 16 18:19:53 user nova-compute[74247]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Oct 16 18:19:53 user nova-compute[74247]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Oct 16 18:19:53 user nova-compute[74247]:     </cache>
Oct 16 18:19:53 user nova-compute[74247]:     <secmodel>
Oct 16 18:19:53 user nova-compute[74247]:       <model>apparmor</model>
Oct 16 18:19:53 user nova-compute[74247]:       <doi>0</doi>
Oct 16 18:19:53 user nova-compute[74247]:     </secmodel>
Oct 16 18:19:53 user nova-compute[74247]:     <secmodel>
Oct 16 18:19:53 user nova-compute[74247]:       <model>dac</model>
Oct 16 18:19:53 user nova-compute[74247]:       <doi>0</doi>
Oct 16 18:19:53 user nova-compute[74247]:       <baselabel type='kvm'>+64055:+108</baselabel>
Oct 16 18:19:53 user nova-compute[74247]:       <baselabel type='qemu'>+64055:+108</baselabel>
Oct 16 18:19:53 user nova-compute[74247]:     </secmodel>
Oct 16 18:19:53 user nova-compute[74247]:   </host>
Oct 16 18:19:53 user nova-compute[74247]:   <guest>
Oct 16 18:19:53 user nova-compute[74247]:     <os_type>hvm</os_type>
Oct 16 18:19:53 user nova-compute[74247]:     <arch name='alpha'>
Oct 16 18:19:53 user nova-compute[74247]:       <wordsize>64</wordsize>
Oct 16 18:19:53 user nova-compute[74247]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='4'>clipper</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <domain type='qemu'/>
Oct 16 18:19:53 user nova-compute[74247]:     </arch>
Oct 16 18:19:53 user nova-compute[74247]:     <features>
Oct 16 18:19:53 user nova-compute[74247]:       <cpuselection/>
Oct 16 18:19:53 user nova-compute[74247]:       <deviceboot/>
Oct 16 18:19:53 user nova-compute[74247]:       <disksnapshot default='on' toggle='no'/>
Oct 16 18:19:53 user nova-compute[74247]:     </features>
Oct 16 18:19:53 user nova-compute[74247]:   </guest>
Oct 16 18:19:53 user nova-compute[74247]:   <guest>
Oct 16 18:19:53 user nova-compute[74247]:     <os_type>hvm</os_type>
Oct 16 18:19:53 user nova-compute[74247]:     <arch name='armv6l'>
Oct 16 18:19:53 user nova-compute[74247]:       <wordsize>32</wordsize>
Oct 16 18:19:53 user nova-compute[74247]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>integratorcp</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>borzoi</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>spitz</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2'>nuri</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2'>musca-b1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>versatileab</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>kzm</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2'>musca-a</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2'>smdkc210</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>sx1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>z2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>tosa</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='4'>sabrelite</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>realview-eb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>n810</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>n800</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>versatilepb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>terrier</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>mainstone</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='4'>midway</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>musicpal</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>microbit</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>cubieboard</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>verdex</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>netduino2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='4'>raspi2b</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>cheetah</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='4'>highbank</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>akita</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>connex</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>collie</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>raspi0</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <domain type='qemu'/>
Oct 16 18:19:53 user nova-compute[74247]:     </arch>
Oct 16 18:19:53 user nova-compute[74247]:     <features>
Oct 16 18:19:53 user nova-compute[74247]:       <cpuselection/>
Oct 16 18:19:53 user nova-compute[74247]:       <deviceboot/>
Oct 16 18:19:53 user nova-compute[74247]:       <disksnapshot default='on' toggle='no'/>
Oct 16 18:19:53 user nova-compute[74247]:     </features>
Oct 16 18:19:53 user nova-compute[74247]:   </guest>
Oct 16 18:19:53 user nova-compute[74247]:   <guest>
Oct 16 18:19:53 user nova-compute[74247]:     <os_type>hvm</os_type>
Oct 16 18:19:53 user nova-compute[74247]:     <arch name='armv7l'>
Oct 16 18:19:53 user nova-compute[74247]:       <wordsize>32</wordsize>
Oct 16 18:19:53 user nova-compute[74247]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>integratorcp</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>borzoi</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>spitz</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2'>nuri</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2'>musca-b1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>versatileab</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>kzm</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2'>musca-a</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2'>smdkc210</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>sx1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>z2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>tosa</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='4'>sabrelite</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>realview-eb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>n810</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>n800</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>versatilepb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>terrier</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>mainstone</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='4'>midway</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>musicpal</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>microbit</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>cubieboard</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>verdex</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>netduino2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='4'>raspi2b</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>cheetah</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='4'>highbank</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>akita</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>connex</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>collie</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>raspi0</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <domain type='qemu'/>
Oct 16 18:19:53 user nova-compute[74247]:     </arch>
Oct 16 18:19:53 user nova-compute[74247]:     <features>
Oct 16 18:19:53 user nova-compute[74247]:       <cpuselection/>
Oct 16 18:19:53 user nova-compute[74247]:       <deviceboot/>
Oct 16 18:19:53 user nova-compute[74247]:       <disksnapshot default='on' toggle='no'/>
Oct 16 18:19:53 user nova-compute[74247]:     </features>
Oct 16 18:19:53 user nova-compute[74247]:   </guest>
Oct 16 18:19:53 user nova-compute[74247]:   <guest>
Oct 16 18:19:53 user nova-compute[74247]:     <os_type>hvm</os_type>
Oct 16 18:19:53 user nova-compute[74247]:     <arch name='aarch64'>
Oct 16 18:19:53 user nova-compute[74247]:       <wordsize>64</wordsize>
Oct 16 18:19:53 user nova-compute[74247]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>integratorcp</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>borzoi</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>spitz</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2'>nuri</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2'>musca-b1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>versatileab</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>kzm</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2'>musca-a</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2'>smdkc210</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>sx1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>z2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>tosa</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='4'>sabrelite</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>realview-eb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='512'>sbsa-ref</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>n810</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>n800</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>versatilepb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>terrier</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>mainstone</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='4'>midway</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>musicpal</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>microbit</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='4'>raspi3ap</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>cubieboard</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>verdex</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>netduino2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='4'>raspi3b</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='4'>raspi2b</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>cheetah</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='4'>highbank</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>akita</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>connex</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>collie</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>raspi0</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <domain type='qemu'/>
Oct 16 18:19:53 user nova-compute[74247]:     </arch>
Oct 16 18:19:53 user nova-compute[74247]:     <features>
Oct 16 18:19:53 user nova-compute[74247]:       <acpi default='on' toggle='yes'/>
Oct 16 18:19:53 user nova-compute[74247]:       <cpuselection/>
Oct 16 18:19:53 user nova-compute[74247]:       <deviceboot/>
Oct 16 18:19:53 user nova-compute[74247]:       <disksnapshot default='on' toggle='no'/>
Oct 16 18:19:53 user nova-compute[74247]:     </features>
Oct 16 18:19:53 user nova-compute[74247]:   </guest>
Oct 16 18:19:53 user nova-compute[74247]:   <guest>
Oct 16 18:19:53 user nova-compute[74247]:     <os_type>hvm</os_type>
Oct 16 18:19:53 user nova-compute[74247]:     <arch name='cris'>
Oct 16 18:19:53 user nova-compute[74247]:       <wordsize>32</wordsize>
Oct 16 18:19:53 user nova-compute[74247]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>axis-dev88</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <domain type='qemu'/>
Oct 16 18:19:53 user nova-compute[74247]:     </arch>
Oct 16 18:19:53 user nova-compute[74247]:     <features>
Oct 16 18:19:53 user nova-compute[74247]:       <cpuselection/>
Oct 16 18:19:53 user nova-compute[74247]:       <deviceboot/>
Oct 16 18:19:53 user nova-compute[74247]:       <disksnapshot default='on' toggle='no'/>
Oct 16 18:19:53 user nova-compute[74247]:     </features>
Oct 16 18:19:53 user nova-compute[74247]:   </guest>
Oct 16 18:19:53 user nova-compute[74247]:   <guest>
Oct 16 18:19:53 user nova-compute[74247]:     <os_type>hvm</os_type>
Oct 16 18:19:53 user nova-compute[74247]:     <arch name='i686'>
Oct 16 18:19:53 user nova-compute[74247]:       <wordsize>32</wordsize>
Oct 16 18:19:53 user nova-compute[74247]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>x-remote</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>isapc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>microvm</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <domain type='qemu'/>
Oct 16 18:19:53 user nova-compute[74247]:       <domain type='kvm'/>
Oct 16 18:19:53 user nova-compute[74247]:     </arch>
Oct 16 18:19:53 user nova-compute[74247]:     <features>
Oct 16 18:19:53 user nova-compute[74247]:       <pae/>
Oct 16 18:19:53 user nova-compute[74247]:       <nonpae/>
Oct 16 18:19:53 user nova-compute[74247]:       <acpi default='on' toggle='yes'/>
Oct 16 18:19:53 user nova-compute[74247]:       <apic default='on' toggle='no'/>
Oct 16 18:19:53 user nova-compute[74247]:       <cpuselection/>
Oct 16 18:19:53 user nova-compute[74247]:       <deviceboot/>
Oct 16 18:19:53 user nova-compute[74247]:       <disksnapshot default='on' toggle='no'/>
Oct 16 18:19:53 user nova-compute[74247]:     </features>
Oct 16 18:19:53 user nova-compute[74247]:   </guest>
Oct 16 18:19:53 user nova-compute[74247]:   <guest>
Oct 16 18:19:53 user nova-compute[74247]:     <os_type>hvm</os_type>
Oct 16 18:19:53 user nova-compute[74247]:     <arch name='m68k'>
Oct 16 18:19:53 user nova-compute[74247]:       <wordsize>32</wordsize>
Oct 16 18:19:53 user nova-compute[74247]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>mcf5208evb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>an5206</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>virt-6.0</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>q800</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>virt-6.2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>next-cube</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>virt-6.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <domain type='qemu'/>
Oct 16 18:19:53 user nova-compute[74247]:     </arch>
Oct 16 18:19:53 user nova-compute[74247]:     <features>
Oct 16 18:19:53 user nova-compute[74247]:       <cpuselection/>
Oct 16 18:19:53 user nova-compute[74247]:       <deviceboot/>
Oct 16 18:19:53 user nova-compute[74247]:       <disksnapshot default='on' toggle='no'/>
Oct 16 18:19:53 user nova-compute[74247]:     </features>
Oct 16 18:19:53 user nova-compute[74247]:   </guest>
Oct 16 18:19:53 user nova-compute[74247]:   <guest>
Oct 16 18:19:53 user nova-compute[74247]:     <os_type>hvm</os_type>
Oct 16 18:19:53 user nova-compute[74247]:     <arch name='microblaze'>
Oct 16 18:19:53 user nova-compute[74247]:       <wordsize>32</wordsize>
Oct 16 18:19:53 user nova-compute[74247]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <domain type='qemu'/>
Oct 16 18:19:53 user nova-compute[74247]:     </arch>
Oct 16 18:19:53 user nova-compute[74247]:     <features>
Oct 16 18:19:53 user nova-compute[74247]:       <cpuselection/>
Oct 16 18:19:53 user nova-compute[74247]:       <deviceboot/>
Oct 16 18:19:53 user nova-compute[74247]:       <disksnapshot default='on' toggle='no'/>
Oct 16 18:19:53 user nova-compute[74247]:     </features>
Oct 16 18:19:53 user nova-compute[74247]:   </guest>
Oct 16 18:19:53 user nova-compute[74247]:   <guest>
Oct 16 18:19:53 user nova-compute[74247]:     <os_type>hvm</os_type>
Oct 16 18:19:53 user nova-compute[74247]:     <arch name='microblazeel'>
Oct 16 18:19:53 user nova-compute[74247]:       <wordsize>32</wordsize>
Oct 16 18:19:53 user nova-compute[74247]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <domain type='qemu'/>
Oct 16 18:19:53 user nova-compute[74247]:     </arch>
Oct 16 18:19:53 user nova-compute[74247]:     <features>
Oct 16 18:19:53 user nova-compute[74247]:       <cpuselection/>
Oct 16 18:19:53 user nova-compute[74247]:       <deviceboot/>
Oct 16 18:19:53 user nova-compute[74247]:       <disksnapshot default='on' toggle='no'/>
Oct 16 18:19:53 user nova-compute[74247]:     </features>
Oct 16 18:19:53 user nova-compute[74247]:   </guest>
Oct 16 18:19:53 user nova-compute[74247]:   <guest>
Oct 16 18:19:53 user nova-compute[74247]:     <os_type>hvm</os_type>
Oct 16 18:19:53 user nova-compute[74247]:     <arch name='mips'>
Oct 16 18:19:53 user nova-compute[74247]:       <wordsize>32</wordsize>
Oct 16 18:19:53 user nova-compute[74247]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='16'>malta</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>mipssim</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <domain type='qemu'/>
Oct 16 18:19:53 user nova-compute[74247]:     </arch>
Oct 16 18:19:53 user nova-compute[74247]:     <features>
Oct 16 18:19:53 user nova-compute[74247]:       <cpuselection/>
Oct 16 18:19:53 user nova-compute[74247]:       <deviceboot/>
Oct 16 18:19:53 user nova-compute[74247]:       <disksnapshot default='on' toggle='no'/>
Oct 16 18:19:53 user nova-compute[74247]:     </features>
Oct 16 18:19:53 user nova-compute[74247]:   </guest>
Oct 16 18:19:53 user nova-compute[74247]:   <guest>
Oct 16 18:19:53 user nova-compute[74247]:     <os_type>hvm</os_type>
Oct 16 18:19:53 user nova-compute[74247]:     <arch name='mipsel'>
Oct 16 18:19:53 user nova-compute[74247]:       <wordsize>32</wordsize>
Oct 16 18:19:53 user nova-compute[74247]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='16'>malta</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>mipssim</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <domain type='qemu'/>
Oct 16 18:19:53 user nova-compute[74247]:     </arch>
Oct 16 18:19:53 user nova-compute[74247]:     <features>
Oct 16 18:19:53 user nova-compute[74247]:       <cpuselection/>
Oct 16 18:19:53 user nova-compute[74247]:       <deviceboot/>
Oct 16 18:19:53 user nova-compute[74247]:       <disksnapshot default='on' toggle='no'/>
Oct 16 18:19:53 user nova-compute[74247]:     </features>
Oct 16 18:19:53 user nova-compute[74247]:   </guest>
Oct 16 18:19:53 user nova-compute[74247]:   <guest>
Oct 16 18:19:53 user nova-compute[74247]:     <os_type>hvm</os_type>
Oct 16 18:19:53 user nova-compute[74247]:     <arch name='mips64'>
Oct 16 18:19:53 user nova-compute[74247]:       <wordsize>64</wordsize>
Oct 16 18:19:53 user nova-compute[74247]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='16'>malta</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>mipssim</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>pica61</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>magnum</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <domain type='qemu'/>
Oct 16 18:19:53 user nova-compute[74247]:     </arch>
Oct 16 18:19:53 user nova-compute[74247]:     <features>
Oct 16 18:19:53 user nova-compute[74247]:       <cpuselection/>
Oct 16 18:19:53 user nova-compute[74247]:       <deviceboot/>
Oct 16 18:19:53 user nova-compute[74247]:       <disksnapshot default='on' toggle='no'/>
Oct 16 18:19:53 user nova-compute[74247]:     </features>
Oct 16 18:19:53 user nova-compute[74247]:   </guest>
Oct 16 18:19:53 user nova-compute[74247]:   <guest>
Oct 16 18:19:53 user nova-compute[74247]:     <os_type>hvm</os_type>
Oct 16 18:19:53 user nova-compute[74247]:     <arch name='mips64el'>
Oct 16 18:19:53 user nova-compute[74247]:       <wordsize>64</wordsize>
Oct 16 18:19:53 user nova-compute[74247]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='16'>malta</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='16'>loongson3-virt</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>mipssim</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>pica61</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>magnum</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='16'>boston</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>fuloong2e</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <domain type='qemu'/>
Oct 16 18:19:53 user nova-compute[74247]:     </arch>
Oct 16 18:19:53 user nova-compute[74247]:     <features>
Oct 16 18:19:53 user nova-compute[74247]:       <cpuselection/>
Oct 16 18:19:53 user nova-compute[74247]:       <deviceboot/>
Oct 16 18:19:53 user nova-compute[74247]:       <disksnapshot default='on' toggle='no'/>
Oct 16 18:19:53 user nova-compute[74247]:     </features>
Oct 16 18:19:53 user nova-compute[74247]:   </guest>
Oct 16 18:19:53 user nova-compute[74247]:   <guest>
Oct 16 18:19:53 user nova-compute[74247]:     <os_type>hvm</os_type>
Oct 16 18:19:53 user nova-compute[74247]:     <arch name='ppc'>
Oct 16 18:19:53 user nova-compute[74247]:       <wordsize>32</wordsize>
Oct 16 18:19:53 user nova-compute[74247]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>g3beige</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>mac99</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='32'>ppce500</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>pegasos2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>sam460ex</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>bamboo</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>40p</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>ref405ep</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>taihu</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <domain type='qemu'/>
Oct 16 18:19:53 user nova-compute[74247]:     </arch>
Oct 16 18:19:53 user nova-compute[74247]:     <features>
Oct 16 18:19:53 user nova-compute[74247]:       <cpuselection/>
Oct 16 18:19:53 user nova-compute[74247]:       <deviceboot/>
Oct 16 18:19:53 user nova-compute[74247]:       <disksnapshot default='on' toggle='no'/>
Oct 16 18:19:53 user nova-compute[74247]:     </features>
Oct 16 18:19:53 user nova-compute[74247]:   </guest>
Oct 16 18:19:53 user nova-compute[74247]:   <guest>
Oct 16 18:19:53 user nova-compute[74247]:     <os_type>hvm</os_type>
Oct 16 18:19:53 user nova-compute[74247]:     <arch name='ppc64'>
Oct 16 18:19:53 user nova-compute[74247]:       <wordsize>64</wordsize>
Oct 16 18:19:53 user nova-compute[74247]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2048'>powernv9</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>taihu</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2048'>powernv10</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='32'>ppce500</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>40p</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>pegasos2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>bamboo</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>g3beige</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>mac99</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>sam460ex</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>ref405ep</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2048'>powernv8</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <domain type='qemu'/>
Oct 16 18:19:53 user nova-compute[74247]:     </arch>
Oct 16 18:19:53 user nova-compute[74247]:     <features>
Oct 16 18:19:53 user nova-compute[74247]:       <cpuselection/>
Oct 16 18:19:53 user nova-compute[74247]:       <deviceboot/>
Oct 16 18:19:53 user nova-compute[74247]:       <disksnapshot default='on' toggle='no'/>
Oct 16 18:19:53 user nova-compute[74247]:     </features>
Oct 16 18:19:53 user nova-compute[74247]:   </guest>
Oct 16 18:19:53 user nova-compute[74247]:   <guest>
Oct 16 18:19:53 user nova-compute[74247]:     <os_type>hvm</os_type>
Oct 16 18:19:53 user nova-compute[74247]:     <arch name='ppc64le'>
Oct 16 18:19:53 user nova-compute[74247]:       <wordsize>64</wordsize>
Oct 16 18:19:53 user nova-compute[74247]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2048'>powernv9</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>taihu</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2048'>powernv10</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='32'>ppce500</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>40p</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>pegasos2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>bamboo</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>g3beige</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>mac99</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>sam460ex</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>ref405ep</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2048'>powernv8</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <domain type='qemu'/>
Oct 16 18:19:53 user nova-compute[74247]:     </arch>
Oct 16 18:19:53 user nova-compute[74247]:     <features>
Oct 16 18:19:53 user nova-compute[74247]:       <cpuselection/>
Oct 16 18:19:53 user nova-compute[74247]:       <deviceboot/>
Oct 16 18:19:53 user nova-compute[74247]:       <disksnapshot default='on' toggle='no'/>
Oct 16 18:19:53 user nova-compute[74247]:     </features>
Oct 16 18:19:53 user nova-compute[74247]:   </guest>
Oct 16 18:19:53 user nova-compute[74247]:   <guest>
Oct 16 18:19:53 user nova-compute[74247]:     <os_type>hvm</os_type>
Oct 16 18:19:53 user nova-compute[74247]:     <arch name='riscv32'>
Oct 16 18:19:53 user nova-compute[74247]:       <wordsize>32</wordsize>
Oct 16 18:19:53 user nova-compute[74247]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='8'>spike</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>opentitan</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='5'>sifive_u</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>sifive_e</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='8'>virt</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <domain type='qemu'/>
Oct 16 18:19:53 user nova-compute[74247]:     </arch>
Oct 16 18:19:53 user nova-compute[74247]:     <features>
Oct 16 18:19:53 user nova-compute[74247]:       <cpuselection/>
Oct 16 18:19:53 user nova-compute[74247]:       <deviceboot/>
Oct 16 18:19:53 user nova-compute[74247]:       <disksnapshot default='on' toggle='no'/>
Oct 16 18:19:53 user nova-compute[74247]:     </features>
Oct 16 18:19:53 user nova-compute[74247]:   </guest>
Oct 16 18:19:53 user nova-compute[74247]:   <guest>
Oct 16 18:19:53 user nova-compute[74247]:     <os_type>hvm</os_type>
Oct 16 18:19:53 user nova-compute[74247]:     <arch name='riscv64'>
Oct 16 18:19:53 user nova-compute[74247]:       <wordsize>64</wordsize>
Oct 16 18:19:53 user nova-compute[74247]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='8'>spike</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='5'>sifive_u</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>shakti_c</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>sifive_e</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='8'>virt</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <domain type='qemu'/>
Oct 16 18:19:53 user nova-compute[74247]:     </arch>
Oct 16 18:19:53 user nova-compute[74247]:     <features>
Oct 16 18:19:53 user nova-compute[74247]:       <cpuselection/>
Oct 16 18:19:53 user nova-compute[74247]:       <deviceboot/>
Oct 16 18:19:53 user nova-compute[74247]:       <disksnapshot default='on' toggle='no'/>
Oct 16 18:19:53 user nova-compute[74247]:     </features>
Oct 16 18:19:53 user nova-compute[74247]:   </guest>
Oct 16 18:19:53 user nova-compute[74247]:   <guest>
Oct 16 18:19:53 user nova-compute[74247]:     <os_type>hvm</os_type>
Oct 16 18:19:53 user nova-compute[74247]:     <arch name='s390x'>
Oct 16 18:19:53 user nova-compute[74247]:       <wordsize>64</wordsize>
Oct 16 18:19:53 user nova-compute[74247]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <domain type='qemu'/>
Oct 16 18:19:53 user nova-compute[74247]:     </arch>
Oct 16 18:19:53 user nova-compute[74247]:     <features>
Oct 16 18:19:53 user nova-compute[74247]:       <cpuselection/>
Oct 16 18:19:53 user nova-compute[74247]:       <deviceboot/>
Oct 16 18:19:53 user nova-compute[74247]:       <disksnapshot default='on' toggle='no'/>
Oct 16 18:19:53 user nova-compute[74247]:     </features>
Oct 16 18:19:53 user nova-compute[74247]:   </guest>
Oct 16 18:19:53 user nova-compute[74247]:   <guest>
Oct 16 18:19:53 user nova-compute[74247]:     <os_type>hvm</os_type>
Oct 16 18:19:53 user nova-compute[74247]:     <arch name='sh4'>
Oct 16 18:19:53 user nova-compute[74247]:       <wordsize>32</wordsize>
Oct 16 18:19:53 user nova-compute[74247]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>shix</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>r2d</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <domain type='qemu'/>
Oct 16 18:19:53 user nova-compute[74247]:     </arch>
Oct 16 18:19:53 user nova-compute[74247]:     <features>
Oct 16 18:19:53 user nova-compute[74247]:       <cpuselection/>
Oct 16 18:19:53 user nova-compute[74247]:       <deviceboot/>
Oct 16 18:19:53 user nova-compute[74247]:       <disksnapshot default='on' toggle='no'/>
Oct 16 18:19:53 user nova-compute[74247]:     </features>
Oct 16 18:19:53 user nova-compute[74247]:   </guest>
Oct 16 18:19:53 user nova-compute[74247]:   <guest>
Oct 16 18:19:53 user nova-compute[74247]:     <os_type>hvm</os_type>
Oct 16 18:19:53 user nova-compute[74247]:     <arch name='sh4eb'>
Oct 16 18:19:53 user nova-compute[74247]:       <wordsize>64</wordsize>
Oct 16 18:19:53 user nova-compute[74247]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>shix</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>r2d</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <domain type='qemu'/>
Oct 16 18:19:53 user nova-compute[74247]:     </arch>
Oct 16 18:19:53 user nova-compute[74247]:     <features>
Oct 16 18:19:53 user nova-compute[74247]:       <cpuselection/>
Oct 16 18:19:53 user nova-compute[74247]:       <deviceboot/>
Oct 16 18:19:53 user nova-compute[74247]:       <disksnapshot default='on' toggle='no'/>
Oct 16 18:19:53 user nova-compute[74247]:     </features>
Oct 16 18:19:53 user nova-compute[74247]:   </guest>
Oct 16 18:19:53 user nova-compute[74247]:   <guest>
Oct 16 18:19:53 user nova-compute[74247]:     <os_type>hvm</os_type>
Oct 16 18:19:53 user nova-compute[74247]:     <arch name='sparc'>
Oct 16 18:19:53 user nova-compute[74247]:       <wordsize>32</wordsize>
Oct 16 18:19:53 user nova-compute[74247]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>SS-5</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='4'>SS-20</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>LX</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>SPARCClassic</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>leon3_generic</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>SPARCbook</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>SS-4</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='4'>SS-600MP</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='4'>SS-10</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>Voyager</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <domain type='qemu'/>
Oct 16 18:19:53 user nova-compute[74247]:     </arch>
Oct 16 18:19:53 user nova-compute[74247]:     <features>
Oct 16 18:19:53 user nova-compute[74247]:       <cpuselection/>
Oct 16 18:19:53 user nova-compute[74247]:       <deviceboot/>
Oct 16 18:19:53 user nova-compute[74247]:       <disksnapshot default='on' toggle='no'/>
Oct 16 18:19:53 user nova-compute[74247]:     </features>
Oct 16 18:19:53 user nova-compute[74247]:   </guest>
Oct 16 18:19:53 user nova-compute[74247]:   <guest>
Oct 16 18:19:53 user nova-compute[74247]:     <os_type>hvm</os_type>
Oct 16 18:19:53 user nova-compute[74247]:     <arch name='sparc64'>
Oct 16 18:19:53 user nova-compute[74247]:       <wordsize>64</wordsize>
Oct 16 18:19:53 user nova-compute[74247]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>sun4u</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>niagara</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>sun4v</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <domain type='qemu'/>
Oct 16 18:19:53 user nova-compute[74247]:     </arch>
Oct 16 18:19:53 user nova-compute[74247]:     <features>
Oct 16 18:19:53 user nova-compute[74247]:       <cpuselection/>
Oct 16 18:19:53 user nova-compute[74247]:       <deviceboot/>
Oct 16 18:19:53 user nova-compute[74247]:       <disksnapshot default='on' toggle='no'/>
Oct 16 18:19:53 user nova-compute[74247]:     </features>
Oct 16 18:19:53 user nova-compute[74247]:   </guest>
Oct 16 18:19:53 user nova-compute[74247]:   <guest>
Oct 16 18:19:53 user nova-compute[74247]:     <os_type>hvm</os_type>
Oct 16 18:19:53 user nova-compute[74247]:     <arch name='x86_64'>
Oct 16 18:19:53 user nova-compute[74247]:       <wordsize>64</wordsize>
Oct 16 18:19:53 user nova-compute[74247]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>x-remote</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='1'>isapc</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>microvm</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <domain type='qemu'/>
Oct 16 18:19:53 user nova-compute[74247]:       <domain type='kvm'/>
Oct 16 18:19:53 user nova-compute[74247]:     </arch>
Oct 16 18:19:53 user nova-compute[74247]:     <features>
Oct 16 18:19:53 user nova-compute[74247]:       <acpi default='on' toggle='yes'/>
Oct 16 18:19:53 user nova-compute[74247]:       <apic default='on' toggle='no'/>
Oct 16 18:19:53 user nova-compute[74247]:       <cpuselection/>
Oct 16 18:19:53 user nova-compute[74247]:       <deviceboot/>
Oct 16 18:19:53 user nova-compute[74247]:       <disksnapshot default='on' toggle='no'/>
Oct 16 18:19:53 user nova-compute[74247]:     </features>
Oct 16 18:19:53 user nova-compute[74247]:   </guest>
Oct 16 18:19:53 user nova-compute[74247]:   <guest>
Oct 16 18:19:53 user nova-compute[74247]:     <os_type>hvm</os_type>
Oct 16 18:19:53 user nova-compute[74247]:     <arch name='xtensa'>
Oct 16 18:19:53 user nova-compute[74247]:       <wordsize>32</wordsize>
Oct 16 18:19:53 user nova-compute[74247]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='4'>sim</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='32'>kc705</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='32'>ml605</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='32'>virt</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='32'>lx200</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='32'>lx60</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <domain type='qemu'/>
Oct 16 18:19:53 user nova-compute[74247]:     </arch>
Oct 16 18:19:53 user nova-compute[74247]:     <features>
Oct 16 18:19:53 user nova-compute[74247]:       <cpuselection/>
Oct 16 18:19:53 user nova-compute[74247]:       <deviceboot/>
Oct 16 18:19:53 user nova-compute[74247]:       <disksnapshot default='on' toggle='no'/>
Oct 16 18:19:53 user nova-compute[74247]:     </features>
Oct 16 18:19:53 user nova-compute[74247]:   </guest>
Oct 16 18:19:53 user nova-compute[74247]:   <guest>
Oct 16 18:19:53 user nova-compute[74247]:     <os_type>hvm</os_type>
Oct 16 18:19:53 user nova-compute[74247]:     <arch name='xtensaeb'>
Oct 16 18:19:53 user nova-compute[74247]:       <wordsize>32</wordsize>
Oct 16 18:19:53 user nova-compute[74247]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='4'>sim</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='32'>kc705</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='32'>ml605</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='32'>virt</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='32'>lx200</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='32'>lx60</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 16 18:19:53 user nova-compute[74247]:       <domain type='qemu'/>
Oct 16 18:19:53 user nova-compute[74247]:     </arch>
Oct 16 18:19:53 user nova-compute[74247]:     <features>
Oct 16 18:19:53 user nova-compute[74247]:       <cpuselection/>
Oct 16 18:19:53 user nova-compute[74247]:       <deviceboot/>
Oct 16 18:19:53 user nova-compute[74247]:       <disksnapshot default='on' toggle='no'/>
Oct 16 18:19:53 user nova-compute[74247]:     </features>
Oct 16 18:19:53 user nova-compute[74247]:   </guest>
Oct 16 18:19:53 user nova-compute[74247]: </capabilities>
Oct 16 18:19:53 user nova-compute[74247]: 
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu', 'ubuntu-q35', 'pc'} {{(pid=74247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Oct 16 18:19:53 user nova-compute[74247]: <domainCapabilities>
Oct 16 18:19:53 user nova-compute[74247]:   <path>/usr/bin/qemu-system-i386</path>
Oct 16 18:19:53 user nova-compute[74247]:   <domain>kvm</domain>
Oct 16 18:19:53 user nova-compute[74247]:   <machine>pc-q35-6.2</machine>
Oct 16 18:19:53 user nova-compute[74247]:   <arch>i686</arch>
Oct 16 18:19:53 user nova-compute[74247]:   <vcpu max='288'/>
Oct 16 18:19:53 user nova-compute[74247]:   <iothreads supported='yes'/>
Oct 16 18:19:53 user nova-compute[74247]:   <os supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:     <enum name='firmware'/>
Oct 16 18:19:53 user nova-compute[74247]:     <loader supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 16 18:19:53 user nova-compute[74247]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 16 18:19:53 user nova-compute[74247]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 16 18:19:53 user nova-compute[74247]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 16 18:19:53 user nova-compute[74247]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='type'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>rom</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>pflash</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='readonly'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>yes</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>no</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='secure'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>no</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </loader>
Oct 16 18:19:53 user nova-compute[74247]:   </os>
Oct 16 18:19:53 user nova-compute[74247]:   <cpu>
Oct 16 18:19:53 user nova-compute[74247]:     <mode name='host-passthrough' supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='hostPassthroughMigratable'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>off</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </mode>
Oct 16 18:19:53 user nova-compute[74247]:     <mode name='maximum' supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='maximumMigratable'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>on</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>off</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </mode>
Oct 16 18:19:53 user nova-compute[74247]:     <mode name='host-model' supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <vendor>Intel</vendor>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='ss'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='vmx'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='pcid'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='hypervisor'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='arat'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='tsc_adjust'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='umip'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='md-clear'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='stibp'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='arch-capabilities'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='ssbd'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='ibpb'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='ibrs'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='amd-stibp'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='amd-ssbd'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='disable' name='erms'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='disable' name='xsaveopt'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='disable' name='lm'/>
Oct 16 18:19:53 user nova-compute[74247]:     </mode>
Oct 16 18:19:53 user nova-compute[74247]:     <mode name='custom' supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>qemu64</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>qemu32</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>phenom</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>pentium3</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>pentium2</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>pentium</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>n270</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>kvm64</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>kvm32</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>coreduo</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>core2duo</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>athlon</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Westmere-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Westmere</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Snowridge</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Server</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Client</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>SandyBridge</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Penryn</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Opteron_G5</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Opteron_G4</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Opteron_G3</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Opteron_G2</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Opteron_G1</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Nehalem-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Nehalem</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>IvyBridge</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Icelake-Server</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Haswell-noTSX</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Haswell-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Haswell</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>EPYC-Rome</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>EPYC-Milan</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>EPYC-IBPB</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>EPYC</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Dhyana</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Cooperlake</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Conroe</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Cascadelake-Server</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Broadwell-noTSX</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Broadwell-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Broadwell</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>486</model>
Oct 16 18:19:53 user nova-compute[74247]:     </mode>
Oct 16 18:19:53 user nova-compute[74247]:   </cpu>
Oct 16 18:19:53 user nova-compute[74247]:   <memoryBacking supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:     <enum name='sourceType'>
Oct 16 18:19:53 user nova-compute[74247]:       <value>file</value>
Oct 16 18:19:53 user nova-compute[74247]:       <value>anonymous</value>
Oct 16 18:19:53 user nova-compute[74247]:       <value>memfd</value>
Oct 16 18:19:53 user nova-compute[74247]:     </enum>
Oct 16 18:19:53 user nova-compute[74247]:   </memoryBacking>
Oct 16 18:19:53 user nova-compute[74247]:   <devices>
Oct 16 18:19:53 user nova-compute[74247]:     <disk supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='diskDevice'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>disk</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>cdrom</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>floppy</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>lun</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='bus'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>fdc</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>scsi</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>usb</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>sata</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='model'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio-transitional</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio-non-transitional</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </disk>
Oct 16 18:19:53 user nova-compute[74247]:     <graphics supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='type'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>sdl</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>vnc</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>spice</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>egl-headless</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </graphics>
Oct 16 18:19:53 user nova-compute[74247]:     <video supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='modelType'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>vga</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>cirrus</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>vmvga</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>qxl</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>none</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>bochs</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>ramfb</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </video>
Oct 16 18:19:53 user nova-compute[74247]:     <hostdev supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='mode'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>subsystem</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='startupPolicy'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>default</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>mandatory</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>requisite</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>optional</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='subsysType'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>usb</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>pci</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>scsi</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='capsType'/>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='pciBackend'/>
Oct 16 18:19:53 user nova-compute[74247]:     </hostdev>
Oct 16 18:19:53 user nova-compute[74247]:     <rng supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='model'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio-transitional</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio-non-transitional</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='backendModel'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>random</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>egd</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>builtin</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </rng>
Oct 16 18:19:53 user nova-compute[74247]:     <filesystem supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='driverType'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>path</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>handle</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtiofs</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </filesystem>
Oct 16 18:19:53 user nova-compute[74247]:     <tpm supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='model'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>tpm-tis</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>tpm-crb</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='backendModel'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>passthrough</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>emulator</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </tpm>
Oct 16 18:19:53 user nova-compute[74247]:   </devices>
Oct 16 18:19:53 user nova-compute[74247]:   <features>
Oct 16 18:19:53 user nova-compute[74247]:     <gic supported='no'/>
Oct 16 18:19:53 user nova-compute[74247]:     <vmcoreinfo supported='yes'/>
Oct 16 18:19:53 user nova-compute[74247]:     <genid supported='yes'/>
Oct 16 18:19:53 user nova-compute[74247]:     <backingStoreInput supported='yes'/>
Oct 16 18:19:53 user nova-compute[74247]:     <backup supported='yes'/>
Oct 16 18:19:53 user nova-compute[74247]:     <sev supported='no'/>
Oct 16 18:19:53 user nova-compute[74247]:   </features>
Oct 16 18:19:53 user nova-compute[74247]: </domainCapabilities>
Oct 16 18:19:53 user nova-compute[74247]:  {{(pid=74247) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Oct 16 18:19:53 user nova-compute[74247]: <domainCapabilities>
Oct 16 18:19:53 user nova-compute[74247]:   <path>/usr/bin/qemu-system-i386</path>
Oct 16 18:19:53 user nova-compute[74247]:   <domain>kvm</domain>
Oct 16 18:19:53 user nova-compute[74247]:   <machine>pc-i440fx-jammy</machine>
Oct 16 18:19:53 user nova-compute[74247]:   <arch>i686</arch>
Oct 16 18:19:53 user nova-compute[74247]:   <vcpu max='255'/>
Oct 16 18:19:53 user nova-compute[74247]:   <iothreads supported='yes'/>
Oct 16 18:19:53 user nova-compute[74247]:   <os supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:     <enum name='firmware'/>
Oct 16 18:19:53 user nova-compute[74247]:     <loader supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 16 18:19:53 user nova-compute[74247]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 16 18:19:53 user nova-compute[74247]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 16 18:19:53 user nova-compute[74247]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 16 18:19:53 user nova-compute[74247]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='type'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>rom</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>pflash</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='readonly'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>yes</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>no</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='secure'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>no</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </loader>
Oct 16 18:19:53 user nova-compute[74247]:   </os>
Oct 16 18:19:53 user nova-compute[74247]:   <cpu>
Oct 16 18:19:53 user nova-compute[74247]:     <mode name='host-passthrough' supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='hostPassthroughMigratable'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>off</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </mode>
Oct 16 18:19:53 user nova-compute[74247]:     <mode name='maximum' supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='maximumMigratable'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>on</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>off</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </mode>
Oct 16 18:19:53 user nova-compute[74247]:     <mode name='host-model' supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <vendor>Intel</vendor>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='ss'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='vmx'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='pcid'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='hypervisor'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='arat'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='tsc_adjust'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='umip'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='md-clear'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='stibp'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='arch-capabilities'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='ssbd'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='ibpb'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='ibrs'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='amd-stibp'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='amd-ssbd'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='disable' name='erms'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='disable' name='xsaveopt'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='disable' name='lm'/>
Oct 16 18:19:53 user nova-compute[74247]:     </mode>
Oct 16 18:19:53 user nova-compute[74247]:     <mode name='custom' supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>qemu64</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>qemu32</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>phenom</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>pentium3</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>pentium2</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>pentium</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>n270</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>kvm64</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>kvm32</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>coreduo</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>core2duo</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>athlon</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Westmere-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Westmere</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Snowridge</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Server</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Client</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>SandyBridge</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Penryn</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Opteron_G5</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Opteron_G4</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Opteron_G3</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Opteron_G2</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Opteron_G1</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Nehalem-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Nehalem</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>IvyBridge</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Icelake-Server</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Haswell-noTSX</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Haswell-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Haswell</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>EPYC-Rome</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>EPYC-Milan</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>EPYC-IBPB</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>EPYC</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Dhyana</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Cooperlake</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Conroe</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Cascadelake-Server</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Broadwell-noTSX</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Broadwell-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Broadwell</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>486</model>
Oct 16 18:19:53 user nova-compute[74247]:     </mode>
Oct 16 18:19:53 user nova-compute[74247]:   </cpu>
Oct 16 18:19:53 user nova-compute[74247]:   <memoryBacking supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:     <enum name='sourceType'>
Oct 16 18:19:53 user nova-compute[74247]:       <value>file</value>
Oct 16 18:19:53 user nova-compute[74247]:       <value>anonymous</value>
Oct 16 18:19:53 user nova-compute[74247]:       <value>memfd</value>
Oct 16 18:19:53 user nova-compute[74247]:     </enum>
Oct 16 18:19:53 user nova-compute[74247]:   </memoryBacking>
Oct 16 18:19:53 user nova-compute[74247]:   <devices>
Oct 16 18:19:53 user nova-compute[74247]:     <disk supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='diskDevice'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>disk</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>cdrom</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>floppy</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>lun</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='bus'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>ide</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>fdc</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>scsi</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>usb</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>sata</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='model'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio-transitional</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio-non-transitional</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </disk>
Oct 16 18:19:53 user nova-compute[74247]:     <graphics supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='type'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>sdl</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>vnc</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>spice</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>egl-headless</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </graphics>
Oct 16 18:19:53 user nova-compute[74247]:     <video supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='modelType'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>vga</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>cirrus</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>vmvga</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>qxl</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>none</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>bochs</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>ramfb</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </video>
Oct 16 18:19:53 user nova-compute[74247]:     <hostdev supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='mode'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>subsystem</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='startupPolicy'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>default</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>mandatory</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>requisite</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>optional</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='subsysType'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>usb</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>pci</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>scsi</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='capsType'/>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='pciBackend'/>
Oct 16 18:19:53 user nova-compute[74247]:     </hostdev>
Oct 16 18:19:53 user nova-compute[74247]:     <rng supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='model'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio-transitional</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio-non-transitional</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='backendModel'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>random</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>egd</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>builtin</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </rng>
Oct 16 18:19:53 user nova-compute[74247]:     <filesystem supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='driverType'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>path</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>handle</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtiofs</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </filesystem>
Oct 16 18:19:53 user nova-compute[74247]:     <tpm supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='model'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>tpm-tis</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>tpm-crb</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='backendModel'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>passthrough</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>emulator</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </tpm>
Oct 16 18:19:53 user nova-compute[74247]:   </devices>
Oct 16 18:19:53 user nova-compute[74247]:   <features>
Oct 16 18:19:53 user nova-compute[74247]:     <gic supported='no'/>
Oct 16 18:19:53 user nova-compute[74247]:     <vmcoreinfo supported='yes'/>
Oct 16 18:19:53 user nova-compute[74247]:     <genid supported='yes'/>
Oct 16 18:19:53 user nova-compute[74247]:     <backingStoreInput supported='yes'/>
Oct 16 18:19:53 user nova-compute[74247]:     <backup supported='yes'/>
Oct 16 18:19:53 user nova-compute[74247]:     <sev supported='no'/>
Oct 16 18:19:53 user nova-compute[74247]:   </features>
Oct 16 18:19:53 user nova-compute[74247]: </domainCapabilities>
Oct 16 18:19:53 user nova-compute[74247]:  {{(pid=74247) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Oct 16 18:19:53 user nova-compute[74247]: <domainCapabilities>
Oct 16 18:19:53 user nova-compute[74247]:   <path>/usr/bin/qemu-system-i386</path>
Oct 16 18:19:53 user nova-compute[74247]:   <domain>kvm</domain>
Oct 16 18:19:53 user nova-compute[74247]:   <machine>pc-q35-jammy</machine>
Oct 16 18:19:53 user nova-compute[74247]:   <arch>i686</arch>
Oct 16 18:19:53 user nova-compute[74247]:   <vcpu max='288'/>
Oct 16 18:19:53 user nova-compute[74247]:   <iothreads supported='yes'/>
Oct 16 18:19:53 user nova-compute[74247]:   <os supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:     <enum name='firmware'/>
Oct 16 18:19:53 user nova-compute[74247]:     <loader supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 16 18:19:53 user nova-compute[74247]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 16 18:19:53 user nova-compute[74247]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 16 18:19:53 user nova-compute[74247]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 16 18:19:53 user nova-compute[74247]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='type'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>rom</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>pflash</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='readonly'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>yes</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>no</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='secure'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>no</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </loader>
Oct 16 18:19:53 user nova-compute[74247]:   </os>
Oct 16 18:19:53 user nova-compute[74247]:   <cpu>
Oct 16 18:19:53 user nova-compute[74247]:     <mode name='host-passthrough' supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='hostPassthroughMigratable'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>off</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </mode>
Oct 16 18:19:53 user nova-compute[74247]:     <mode name='maximum' supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='maximumMigratable'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>on</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>off</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </mode>
Oct 16 18:19:53 user nova-compute[74247]:     <mode name='host-model' supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <vendor>Intel</vendor>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='ss'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='vmx'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='pcid'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='hypervisor'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='arat'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='tsc_adjust'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='umip'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='md-clear'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='stibp'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='arch-capabilities'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='ssbd'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='ibpb'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='ibrs'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='amd-stibp'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='amd-ssbd'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='disable' name='erms'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='disable' name='xsaveopt'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='disable' name='lm'/>
Oct 16 18:19:53 user nova-compute[74247]:     </mode>
Oct 16 18:19:53 user nova-compute[74247]:     <mode name='custom' supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>qemu64</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>qemu32</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>phenom</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>pentium3</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>pentium2</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>pentium</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>n270</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>kvm64</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>kvm32</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>coreduo</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>core2duo</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>athlon</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Westmere-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Westmere</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Snowridge</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Server</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Client</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>SandyBridge</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Penryn</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Opteron_G5</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Opteron_G4</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Opteron_G3</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Opteron_G2</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Opteron_G1</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Nehalem-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Nehalem</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>IvyBridge</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Icelake-Server</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Haswell-noTSX</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Haswell-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Haswell</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>EPYC-Rome</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>EPYC-Milan</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>EPYC-IBPB</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>EPYC</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Dhyana</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Cooperlake</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Conroe</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Cascadelake-Server</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Broadwell-noTSX</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Broadwell-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Broadwell</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>486</model>
Oct 16 18:19:53 user nova-compute[74247]:     </mode>
Oct 16 18:19:53 user nova-compute[74247]:   </cpu>
Oct 16 18:19:53 user nova-compute[74247]:   <memoryBacking supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:     <enum name='sourceType'>
Oct 16 18:19:53 user nova-compute[74247]:       <value>file</value>
Oct 16 18:19:53 user nova-compute[74247]:       <value>anonymous</value>
Oct 16 18:19:53 user nova-compute[74247]:       <value>memfd</value>
Oct 16 18:19:53 user nova-compute[74247]:     </enum>
Oct 16 18:19:53 user nova-compute[74247]:   </memoryBacking>
Oct 16 18:19:53 user nova-compute[74247]:   <devices>
Oct 16 18:19:53 user nova-compute[74247]:     <disk supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='diskDevice'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>disk</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>cdrom</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>floppy</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>lun</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='bus'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>fdc</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>scsi</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>usb</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>sata</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='model'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio-transitional</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio-non-transitional</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </disk>
Oct 16 18:19:53 user nova-compute[74247]:     <graphics supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='type'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>sdl</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>vnc</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>spice</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>egl-headless</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </graphics>
Oct 16 18:19:53 user nova-compute[74247]:     <video supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='modelType'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>vga</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>cirrus</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>vmvga</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>qxl</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>none</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>bochs</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>ramfb</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </video>
Oct 16 18:19:53 user nova-compute[74247]:     <hostdev supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='mode'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>subsystem</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='startupPolicy'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>default</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>mandatory</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>requisite</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>optional</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='subsysType'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>usb</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>pci</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>scsi</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='capsType'/>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='pciBackend'/>
Oct 16 18:19:53 user nova-compute[74247]:     </hostdev>
Oct 16 18:19:53 user nova-compute[74247]:     <rng supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='model'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio-transitional</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio-non-transitional</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='backendModel'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>random</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>egd</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>builtin</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </rng>
Oct 16 18:19:53 user nova-compute[74247]:     <filesystem supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='driverType'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>path</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>handle</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtiofs</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </filesystem>
Oct 16 18:19:53 user nova-compute[74247]:     <tpm supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='model'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>tpm-tis</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>tpm-crb</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='backendModel'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>passthrough</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>emulator</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </tpm>
Oct 16 18:19:53 user nova-compute[74247]:   </devices>
Oct 16 18:19:53 user nova-compute[74247]:   <features>
Oct 16 18:19:53 user nova-compute[74247]:     <gic supported='no'/>
Oct 16 18:19:53 user nova-compute[74247]:     <vmcoreinfo supported='yes'/>
Oct 16 18:19:53 user nova-compute[74247]:     <genid supported='yes'/>
Oct 16 18:19:53 user nova-compute[74247]:     <backingStoreInput supported='yes'/>
Oct 16 18:19:53 user nova-compute[74247]:     <backup supported='yes'/>
Oct 16 18:19:53 user nova-compute[74247]:     <sev supported='no'/>
Oct 16 18:19:53 user nova-compute[74247]:   </features>
Oct 16 18:19:53 user nova-compute[74247]: </domainCapabilities>
Oct 16 18:19:53 user nova-compute[74247]:  {{(pid=74247) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Oct 16 18:19:53 user nova-compute[74247]: <domainCapabilities>
Oct 16 18:19:53 user nova-compute[74247]:   <path>/usr/bin/qemu-system-i386</path>
Oct 16 18:19:53 user nova-compute[74247]:   <domain>kvm</domain>
Oct 16 18:19:53 user nova-compute[74247]:   <machine>pc-i440fx-6.2</machine>
Oct 16 18:19:53 user nova-compute[74247]:   <arch>i686</arch>
Oct 16 18:19:53 user nova-compute[74247]:   <vcpu max='255'/>
Oct 16 18:19:53 user nova-compute[74247]:   <iothreads supported='yes'/>
Oct 16 18:19:53 user nova-compute[74247]:   <os supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:     <enum name='firmware'/>
Oct 16 18:19:53 user nova-compute[74247]:     <loader supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 16 18:19:53 user nova-compute[74247]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 16 18:19:53 user nova-compute[74247]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 16 18:19:53 user nova-compute[74247]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 16 18:19:53 user nova-compute[74247]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='type'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>rom</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>pflash</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='readonly'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>yes</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>no</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='secure'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>no</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </loader>
Oct 16 18:19:53 user nova-compute[74247]:   </os>
Oct 16 18:19:53 user nova-compute[74247]:   <cpu>
Oct 16 18:19:53 user nova-compute[74247]:     <mode name='host-passthrough' supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='hostPassthroughMigratable'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>off</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </mode>
Oct 16 18:19:53 user nova-compute[74247]:     <mode name='maximum' supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='maximumMigratable'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>on</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>off</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </mode>
Oct 16 18:19:53 user nova-compute[74247]:     <mode name='host-model' supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <vendor>Intel</vendor>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='ss'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='vmx'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='pcid'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='hypervisor'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='arat'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='tsc_adjust'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='umip'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='md-clear'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='stibp'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='arch-capabilities'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='ssbd'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='ibpb'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='ibrs'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='amd-stibp'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='amd-ssbd'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='disable' name='erms'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='disable' name='xsaveopt'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='disable' name='lm'/>
Oct 16 18:19:53 user nova-compute[74247]:     </mode>
Oct 16 18:19:53 user nova-compute[74247]:     <mode name='custom' supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>qemu64</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>qemu32</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>phenom</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>pentium3</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>pentium2</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>pentium</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>n270</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>kvm64</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>kvm32</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>coreduo</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>core2duo</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>athlon</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Westmere-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Westmere</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Snowridge</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Server</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Client</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>SandyBridge</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Penryn</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Opteron_G5</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Opteron_G4</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Opteron_G3</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Opteron_G2</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Opteron_G1</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Nehalem-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Nehalem</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>IvyBridge</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Icelake-Server</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Haswell-noTSX</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Haswell-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Haswell</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>EPYC-Rome</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>EPYC-Milan</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>EPYC-IBPB</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>EPYC</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Dhyana</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Cooperlake</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Conroe</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Cascadelake-Server</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Broadwell-noTSX</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Broadwell-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Broadwell</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>486</model>
Oct 16 18:19:53 user nova-compute[74247]:     </mode>
Oct 16 18:19:53 user nova-compute[74247]:   </cpu>
Oct 16 18:19:53 user nova-compute[74247]:   <memoryBacking supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:     <enum name='sourceType'>
Oct 16 18:19:53 user nova-compute[74247]:       <value>file</value>
Oct 16 18:19:53 user nova-compute[74247]:       <value>anonymous</value>
Oct 16 18:19:53 user nova-compute[74247]:       <value>memfd</value>
Oct 16 18:19:53 user nova-compute[74247]:     </enum>
Oct 16 18:19:53 user nova-compute[74247]:   </memoryBacking>
Oct 16 18:19:53 user nova-compute[74247]:   <devices>
Oct 16 18:19:53 user nova-compute[74247]:     <disk supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='diskDevice'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>disk</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>cdrom</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>floppy</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>lun</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='bus'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>ide</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>fdc</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>scsi</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>usb</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>sata</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='model'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio-transitional</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio-non-transitional</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </disk>
Oct 16 18:19:53 user nova-compute[74247]:     <graphics supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='type'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>sdl</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>vnc</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>spice</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>egl-headless</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </graphics>
Oct 16 18:19:53 user nova-compute[74247]:     <video supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='modelType'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>vga</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>cirrus</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>vmvga</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>qxl</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>none</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>bochs</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>ramfb</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </video>
Oct 16 18:19:53 user nova-compute[74247]:     <hostdev supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='mode'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>subsystem</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='startupPolicy'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>default</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>mandatory</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>requisite</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>optional</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='subsysType'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>usb</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>pci</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>scsi</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='capsType'/>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='pciBackend'/>
Oct 16 18:19:53 user nova-compute[74247]:     </hostdev>
Oct 16 18:19:53 user nova-compute[74247]:     <rng supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='model'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio-transitional</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio-non-transitional</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='backendModel'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>random</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>egd</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>builtin</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </rng>
Oct 16 18:19:53 user nova-compute[74247]:     <filesystem supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='driverType'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>path</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>handle</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtiofs</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </filesystem>
Oct 16 18:19:53 user nova-compute[74247]:     <tpm supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='model'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>tpm-tis</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>tpm-crb</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='backendModel'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>passthrough</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>emulator</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </tpm>
Oct 16 18:19:53 user nova-compute[74247]:   </devices>
Oct 16 18:19:53 user nova-compute[74247]:   <features>
Oct 16 18:19:53 user nova-compute[74247]:     <gic supported='no'/>
Oct 16 18:19:53 user nova-compute[74247]:     <vmcoreinfo supported='yes'/>
Oct 16 18:19:53 user nova-compute[74247]:     <genid supported='yes'/>
Oct 16 18:19:53 user nova-compute[74247]:     <backingStoreInput supported='yes'/>
Oct 16 18:19:53 user nova-compute[74247]:     <backup supported='yes'/>
Oct 16 18:19:53 user nova-compute[74247]:     <sev supported='no'/>
Oct 16 18:19:53 user nova-compute[74247]:   </features>
Oct 16 18:19:53 user nova-compute[74247]: </domainCapabilities>
Oct 16 18:19:53 user nova-compute[74247]:  {{(pid=74247) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Getting domain capabilities for ppc64 via machine types: {'powernv', None, 'pseries'} {{(pid=74247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=74247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu', 'ubuntu-q35', 'pc'} {{(pid=74247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Oct 16 18:19:53 user nova-compute[74247]: <domainCapabilities>
Oct 16 18:19:53 user nova-compute[74247]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 16 18:19:53 user nova-compute[74247]:   <domain>kvm</domain>
Oct 16 18:19:53 user nova-compute[74247]:   <machine>pc-q35-6.2</machine>
Oct 16 18:19:53 user nova-compute[74247]:   <arch>x86_64</arch>
Oct 16 18:19:53 user nova-compute[74247]:   <vcpu max='288'/>
Oct 16 18:19:53 user nova-compute[74247]:   <iothreads supported='yes'/>
Oct 16 18:19:53 user nova-compute[74247]:   <os supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:     <enum name='firmware'>
Oct 16 18:19:53 user nova-compute[74247]:       <value>efi</value>
Oct 16 18:19:53 user nova-compute[74247]:     </enum>
Oct 16 18:19:53 user nova-compute[74247]:     <loader supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 16 18:19:53 user nova-compute[74247]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 16 18:19:53 user nova-compute[74247]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='type'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>rom</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>pflash</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='readonly'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>yes</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>no</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='secure'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>yes</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>no</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </loader>
Oct 16 18:19:53 user nova-compute[74247]:   </os>
Oct 16 18:19:53 user nova-compute[74247]:   <cpu>
Oct 16 18:19:53 user nova-compute[74247]:     <mode name='host-passthrough' supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='hostPassthroughMigratable'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>on</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>off</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </mode>
Oct 16 18:19:53 user nova-compute[74247]:     <mode name='maximum' supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='maximumMigratable'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>on</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>off</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </mode>
Oct 16 18:19:53 user nova-compute[74247]:     <mode name='host-model' supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <vendor>Intel</vendor>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='ss'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='vmx'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='pcid'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='hypervisor'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='arat'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='tsc_adjust'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='umip'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='md-clear'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='stibp'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='arch-capabilities'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='ssbd'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='invtsc'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='ibpb'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='ibrs'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='amd-stibp'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='amd-ssbd'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='rsba'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='pschange-mc-no'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='disable' name='erms'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='disable' name='xsaveopt'/>
Oct 16 18:19:53 user nova-compute[74247]:     </mode>
Oct 16 18:19:53 user nova-compute[74247]:     <mode name='custom' supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>qemu64</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>qemu32</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>phenom</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>pentium3</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>pentium2</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>pentium</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>n270</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>kvm64</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>kvm32</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>coreduo</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>core2duo</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>athlon</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>Westmere-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>Westmere</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Snowridge</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Server</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Client</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>SandyBridge</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>Penryn</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Opteron_G5</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Opteron_G4</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Opteron_G3</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Opteron_G2</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>Opteron_G1</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>Nehalem</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>IvyBridge</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Icelake-Server</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Haswell-noTSX</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Haswell-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Haswell</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>EPYC-Rome</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>EPYC-Milan</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>EPYC-IBPB</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>EPYC</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Dhyana</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Cooperlake</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>Conroe</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Cascadelake-Server</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Broadwell-noTSX</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Broadwell-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Broadwell</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>486</model>
Oct 16 18:19:53 user nova-compute[74247]:     </mode>
Oct 16 18:19:53 user nova-compute[74247]:   </cpu>
Oct 16 18:19:53 user nova-compute[74247]:   <memoryBacking supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:     <enum name='sourceType'>
Oct 16 18:19:53 user nova-compute[74247]:       <value>file</value>
Oct 16 18:19:53 user nova-compute[74247]:       <value>anonymous</value>
Oct 16 18:19:53 user nova-compute[74247]:       <value>memfd</value>
Oct 16 18:19:53 user nova-compute[74247]:     </enum>
Oct 16 18:19:53 user nova-compute[74247]:   </memoryBacking>
Oct 16 18:19:53 user nova-compute[74247]:   <devices>
Oct 16 18:19:53 user nova-compute[74247]:     <disk supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='diskDevice'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>disk</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>cdrom</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>floppy</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>lun</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='bus'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>fdc</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>scsi</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>usb</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>sata</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='model'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio-transitional</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio-non-transitional</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </disk>
Oct 16 18:19:53 user nova-compute[74247]:     <graphics supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='type'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>sdl</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>vnc</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>spice</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>egl-headless</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </graphics>
Oct 16 18:19:53 user nova-compute[74247]:     <video supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='modelType'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>vga</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>cirrus</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>vmvga</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>qxl</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>none</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>bochs</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>ramfb</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </video>
Oct 16 18:19:53 user nova-compute[74247]:     <hostdev supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='mode'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>subsystem</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='startupPolicy'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>default</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>mandatory</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>requisite</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>optional</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='subsysType'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>usb</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>pci</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>scsi</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='capsType'/>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='pciBackend'/>
Oct 16 18:19:53 user nova-compute[74247]:     </hostdev>
Oct 16 18:19:53 user nova-compute[74247]:     <rng supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='model'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio-transitional</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio-non-transitional</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='backendModel'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>random</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>egd</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>builtin</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </rng>
Oct 16 18:19:53 user nova-compute[74247]:     <filesystem supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='driverType'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>path</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>handle</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtiofs</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </filesystem>
Oct 16 18:19:53 user nova-compute[74247]:     <tpm supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='model'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>tpm-tis</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>tpm-crb</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='backendModel'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>passthrough</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>emulator</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </tpm>
Oct 16 18:19:53 user nova-compute[74247]:   </devices>
Oct 16 18:19:53 user nova-compute[74247]:   <features>
Oct 16 18:19:53 user nova-compute[74247]:     <gic supported='no'/>
Oct 16 18:19:53 user nova-compute[74247]:     <vmcoreinfo supported='yes'/>
Oct 16 18:19:53 user nova-compute[74247]:     <genid supported='yes'/>
Oct 16 18:19:53 user nova-compute[74247]:     <backingStoreInput supported='yes'/>
Oct 16 18:19:53 user nova-compute[74247]:     <backup supported='yes'/>
Oct 16 18:19:53 user nova-compute[74247]:     <sev supported='no'/>
Oct 16 18:19:53 user nova-compute[74247]:   </features>
Oct 16 18:19:53 user nova-compute[74247]: </domainCapabilities>
Oct 16 18:19:53 user nova-compute[74247]:  {{(pid=74247) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Oct 16 18:19:53 user nova-compute[74247]: <domainCapabilities>
Oct 16 18:19:53 user nova-compute[74247]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 16 18:19:53 user nova-compute[74247]:   <domain>kvm</domain>
Oct 16 18:19:53 user nova-compute[74247]:   <machine>pc-i440fx-jammy</machine>
Oct 16 18:19:53 user nova-compute[74247]:   <arch>x86_64</arch>
Oct 16 18:19:53 user nova-compute[74247]:   <vcpu max='255'/>
Oct 16 18:19:53 user nova-compute[74247]:   <iothreads supported='yes'/>
Oct 16 18:19:53 user nova-compute[74247]:   <os supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:     <enum name='firmware'>
Oct 16 18:19:53 user nova-compute[74247]:       <value>efi</value>
Oct 16 18:19:53 user nova-compute[74247]:     </enum>
Oct 16 18:19:53 user nova-compute[74247]:     <loader supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='type'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>rom</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>pflash</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='readonly'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>yes</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>no</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='secure'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>no</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </loader>
Oct 16 18:19:53 user nova-compute[74247]:   </os>
Oct 16 18:19:53 user nova-compute[74247]:   <cpu>
Oct 16 18:19:53 user nova-compute[74247]:     <mode name='host-passthrough' supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='hostPassthroughMigratable'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>on</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>off</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </mode>
Oct 16 18:19:53 user nova-compute[74247]:     <mode name='maximum' supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='maximumMigratable'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>on</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>off</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </mode>
Oct 16 18:19:53 user nova-compute[74247]:     <mode name='host-model' supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <vendor>Intel</vendor>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='ss'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='vmx'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='pcid'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='hypervisor'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='arat'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='tsc_adjust'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='umip'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='md-clear'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='stibp'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='arch-capabilities'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='ssbd'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='invtsc'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='ibpb'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='ibrs'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='amd-stibp'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='amd-ssbd'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='rsba'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='pschange-mc-no'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='disable' name='erms'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='disable' name='xsaveopt'/>
Oct 16 18:19:53 user nova-compute[74247]:     </mode>
Oct 16 18:19:53 user nova-compute[74247]:     <mode name='custom' supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>qemu64</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>qemu32</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>phenom</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>pentium3</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>pentium2</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>pentium</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>n270</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>kvm64</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>kvm32</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>coreduo</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>core2duo</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>athlon</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>Westmere-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>Westmere</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Snowridge</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Server</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Client</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>SandyBridge</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>Penryn</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Opteron_G5</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Opteron_G4</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Opteron_G3</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Opteron_G2</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>Opteron_G1</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>Nehalem</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>IvyBridge</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Icelake-Server</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Haswell-noTSX</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Haswell-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Haswell</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>EPYC-Rome</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>EPYC-Milan</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>EPYC-IBPB</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>EPYC</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Dhyana</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Cooperlake</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>Conroe</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Cascadelake-Server</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Broadwell-noTSX</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Broadwell-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Broadwell</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>486</model>
Oct 16 18:19:53 user nova-compute[74247]:     </mode>
Oct 16 18:19:53 user nova-compute[74247]:   </cpu>
Oct 16 18:19:53 user nova-compute[74247]:   <memoryBacking supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:     <enum name='sourceType'>
Oct 16 18:19:53 user nova-compute[74247]:       <value>file</value>
Oct 16 18:19:53 user nova-compute[74247]:       <value>anonymous</value>
Oct 16 18:19:53 user nova-compute[74247]:       <value>memfd</value>
Oct 16 18:19:53 user nova-compute[74247]:     </enum>
Oct 16 18:19:53 user nova-compute[74247]:   </memoryBacking>
Oct 16 18:19:53 user nova-compute[74247]:   <devices>
Oct 16 18:19:53 user nova-compute[74247]:     <disk supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='diskDevice'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>disk</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>cdrom</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>floppy</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>lun</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='bus'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>ide</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>fdc</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>scsi</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>usb</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>sata</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='model'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio-transitional</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio-non-transitional</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </disk>
Oct 16 18:19:53 user nova-compute[74247]:     <graphics supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='type'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>sdl</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>vnc</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>spice</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>egl-headless</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </graphics>
Oct 16 18:19:53 user nova-compute[74247]:     <video supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='modelType'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>vga</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>cirrus</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>vmvga</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>qxl</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>none</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>bochs</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>ramfb</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </video>
Oct 16 18:19:53 user nova-compute[74247]:     <hostdev supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='mode'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>subsystem</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='startupPolicy'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>default</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>mandatory</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>requisite</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>optional</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='subsysType'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>usb</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>pci</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>scsi</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='capsType'/>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='pciBackend'/>
Oct 16 18:19:53 user nova-compute[74247]:     </hostdev>
Oct 16 18:19:53 user nova-compute[74247]:     <rng supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='model'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio-transitional</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio-non-transitional</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='backendModel'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>random</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>egd</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>builtin</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </rng>
Oct 16 18:19:53 user nova-compute[74247]:     <filesystem supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='driverType'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>path</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>handle</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtiofs</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </filesystem>
Oct 16 18:19:53 user nova-compute[74247]:     <tpm supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='model'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>tpm-tis</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>tpm-crb</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='backendModel'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>passthrough</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>emulator</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </tpm>
Oct 16 18:19:53 user nova-compute[74247]:   </devices>
Oct 16 18:19:53 user nova-compute[74247]:   <features>
Oct 16 18:19:53 user nova-compute[74247]:     <gic supported='no'/>
Oct 16 18:19:53 user nova-compute[74247]:     <vmcoreinfo supported='yes'/>
Oct 16 18:19:53 user nova-compute[74247]:     <genid supported='yes'/>
Oct 16 18:19:53 user nova-compute[74247]:     <backingStoreInput supported='yes'/>
Oct 16 18:19:53 user nova-compute[74247]:     <backup supported='yes'/>
Oct 16 18:19:53 user nova-compute[74247]:     <sev supported='no'/>
Oct 16 18:19:53 user nova-compute[74247]:   </features>
Oct 16 18:19:53 user nova-compute[74247]: </domainCapabilities>
Oct 16 18:19:53 user nova-compute[74247]:  {{(pid=74247) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Oct 16 18:19:53 user nova-compute[74247]: <domainCapabilities>
Oct 16 18:19:53 user nova-compute[74247]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 16 18:19:53 user nova-compute[74247]:   <domain>kvm</domain>
Oct 16 18:19:53 user nova-compute[74247]:   <machine>pc-q35-jammy</machine>
Oct 16 18:19:53 user nova-compute[74247]:   <arch>x86_64</arch>
Oct 16 18:19:53 user nova-compute[74247]:   <vcpu max='288'/>
Oct 16 18:19:53 user nova-compute[74247]:   <iothreads supported='yes'/>
Oct 16 18:19:53 user nova-compute[74247]:   <os supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:     <enum name='firmware'>
Oct 16 18:19:53 user nova-compute[74247]:       <value>efi</value>
Oct 16 18:19:53 user nova-compute[74247]:     </enum>
Oct 16 18:19:53 user nova-compute[74247]:     <loader supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 16 18:19:53 user nova-compute[74247]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 16 18:19:53 user nova-compute[74247]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='type'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>rom</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>pflash</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='readonly'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>yes</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>no</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='secure'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>yes</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>no</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </loader>
Oct 16 18:19:53 user nova-compute[74247]:   </os>
Oct 16 18:19:53 user nova-compute[74247]:   <cpu>
Oct 16 18:19:53 user nova-compute[74247]:     <mode name='host-passthrough' supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='hostPassthroughMigratable'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>on</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>off</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </mode>
Oct 16 18:19:53 user nova-compute[74247]:     <mode name='maximum' supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='maximumMigratable'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>on</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>off</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </mode>
Oct 16 18:19:53 user nova-compute[74247]:     <mode name='host-model' supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <vendor>Intel</vendor>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='ss'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='vmx'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='pcid'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='hypervisor'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='arat'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='tsc_adjust'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='umip'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='md-clear'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='stibp'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='arch-capabilities'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='ssbd'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='invtsc'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='ibpb'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='ibrs'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='amd-stibp'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='amd-ssbd'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='rsba'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='pschange-mc-no'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='disable' name='erms'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='disable' name='xsaveopt'/>
Oct 16 18:19:53 user nova-compute[74247]:     </mode>
Oct 16 18:19:53 user nova-compute[74247]:     <mode name='custom' supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>qemu64</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>qemu32</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>phenom</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>pentium3</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>pentium2</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>pentium</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>n270</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>kvm64</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>kvm32</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>coreduo</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>core2duo</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>athlon</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>Westmere-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>Westmere</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Snowridge</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Server</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Client</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>SandyBridge</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>Penryn</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Opteron_G5</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Opteron_G4</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Opteron_G3</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Opteron_G2</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>Opteron_G1</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>Nehalem</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>IvyBridge</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Icelake-Server</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Haswell-noTSX</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Haswell-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Haswell</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>EPYC-Rome</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>EPYC-Milan</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>EPYC-IBPB</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>EPYC</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Dhyana</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Cooperlake</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>Conroe</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Cascadelake-Server</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Broadwell-noTSX</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Broadwell-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Broadwell</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>486</model>
Oct 16 18:19:53 user nova-compute[74247]:     </mode>
Oct 16 18:19:53 user nova-compute[74247]:   </cpu>
Oct 16 18:19:53 user nova-compute[74247]:   <memoryBacking supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:     <enum name='sourceType'>
Oct 16 18:19:53 user nova-compute[74247]:       <value>file</value>
Oct 16 18:19:53 user nova-compute[74247]:       <value>anonymous</value>
Oct 16 18:19:53 user nova-compute[74247]:       <value>memfd</value>
Oct 16 18:19:53 user nova-compute[74247]:     </enum>
Oct 16 18:19:53 user nova-compute[74247]:   </memoryBacking>
Oct 16 18:19:53 user nova-compute[74247]:   <devices>
Oct 16 18:19:53 user nova-compute[74247]:     <disk supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='diskDevice'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>disk</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>cdrom</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>floppy</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>lun</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='bus'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>fdc</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>scsi</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>usb</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>sata</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='model'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio-transitional</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio-non-transitional</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </disk>
Oct 16 18:19:53 user nova-compute[74247]:     <graphics supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='type'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>sdl</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>vnc</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>spice</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>egl-headless</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </graphics>
Oct 16 18:19:53 user nova-compute[74247]:     <video supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='modelType'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>vga</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>cirrus</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>vmvga</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>qxl</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>none</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>bochs</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>ramfb</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </video>
Oct 16 18:19:53 user nova-compute[74247]:     <hostdev supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='mode'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>subsystem</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='startupPolicy'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>default</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>mandatory</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>requisite</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>optional</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='subsysType'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>usb</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>pci</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>scsi</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='capsType'/>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='pciBackend'/>
Oct 16 18:19:53 user nova-compute[74247]:     </hostdev>
Oct 16 18:19:53 user nova-compute[74247]:     <rng supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='model'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio-transitional</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio-non-transitional</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='backendModel'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>random</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>egd</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>builtin</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </rng>
Oct 16 18:19:53 user nova-compute[74247]:     <filesystem supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='driverType'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>path</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>handle</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtiofs</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </filesystem>
Oct 16 18:19:53 user nova-compute[74247]:     <tpm supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='model'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>tpm-tis</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>tpm-crb</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='backendModel'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>passthrough</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>emulator</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </tpm>
Oct 16 18:19:53 user nova-compute[74247]:   </devices>
Oct 16 18:19:53 user nova-compute[74247]:   <features>
Oct 16 18:19:53 user nova-compute[74247]:     <gic supported='no'/>
Oct 16 18:19:53 user nova-compute[74247]:     <vmcoreinfo supported='yes'/>
Oct 16 18:19:53 user nova-compute[74247]:     <genid supported='yes'/>
Oct 16 18:19:53 user nova-compute[74247]:     <backingStoreInput supported='yes'/>
Oct 16 18:19:53 user nova-compute[74247]:     <backup supported='yes'/>
Oct 16 18:19:53 user nova-compute[74247]:     <sev supported='no'/>
Oct 16 18:19:53 user nova-compute[74247]:   </features>
Oct 16 18:19:53 user nova-compute[74247]: </domainCapabilities>
Oct 16 18:19:53 user nova-compute[74247]:  {{(pid=74247) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Oct 16 18:19:53 user nova-compute[74247]: <domainCapabilities>
Oct 16 18:19:53 user nova-compute[74247]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 16 18:19:53 user nova-compute[74247]:   <domain>kvm</domain>
Oct 16 18:19:53 user nova-compute[74247]:   <machine>pc-i440fx-6.2</machine>
Oct 16 18:19:53 user nova-compute[74247]:   <arch>x86_64</arch>
Oct 16 18:19:53 user nova-compute[74247]:   <vcpu max='255'/>
Oct 16 18:19:53 user nova-compute[74247]:   <iothreads supported='yes'/>
Oct 16 18:19:53 user nova-compute[74247]:   <os supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:     <enum name='firmware'>
Oct 16 18:19:53 user nova-compute[74247]:       <value>efi</value>
Oct 16 18:19:53 user nova-compute[74247]:     </enum>
Oct 16 18:19:53 user nova-compute[74247]:     <loader supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='type'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>rom</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>pflash</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='readonly'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>yes</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>no</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='secure'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>no</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </loader>
Oct 16 18:19:53 user nova-compute[74247]:   </os>
Oct 16 18:19:53 user nova-compute[74247]:   <cpu>
Oct 16 18:19:53 user nova-compute[74247]:     <mode name='host-passthrough' supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='hostPassthroughMigratable'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>on</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>off</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </mode>
Oct 16 18:19:53 user nova-compute[74247]:     <mode name='maximum' supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='maximumMigratable'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>on</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>off</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </mode>
Oct 16 18:19:53 user nova-compute[74247]:     <mode name='host-model' supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <vendor>Intel</vendor>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='ss'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='vmx'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='pcid'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='hypervisor'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='arat'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='tsc_adjust'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='umip'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='md-clear'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='stibp'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='arch-capabilities'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='ssbd'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='invtsc'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='ibpb'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='ibrs'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='amd-stibp'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='amd-ssbd'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='rsba'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='require' name='pschange-mc-no'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='disable' name='erms'/>
Oct 16 18:19:53 user nova-compute[74247]:       <feature policy='disable' name='xsaveopt'/>
Oct 16 18:19:53 user nova-compute[74247]:     </mode>
Oct 16 18:19:53 user nova-compute[74247]:     <mode name='custom' supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>qemu64</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>qemu32</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>phenom</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>pentium3</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>pentium2</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>pentium</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>n270</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>kvm64</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>kvm32</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>coreduo</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>core2duo</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>athlon</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>Westmere-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>Westmere</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Snowridge</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Server</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Skylake-Client</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>SandyBridge</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>Penryn</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Opteron_G5</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Opteron_G4</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Opteron_G3</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Opteron_G2</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>Opteron_G1</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>Nehalem</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>IvyBridge</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Icelake-Server</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Haswell-noTSX</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Haswell-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Haswell</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>EPYC-Rome</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>EPYC-Milan</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>EPYC-IBPB</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>EPYC</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Dhyana</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Cooperlake</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>Conroe</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Cascadelake-Server</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Broadwell-noTSX</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Broadwell-IBRS</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='no'>Broadwell</model>
Oct 16 18:19:53 user nova-compute[74247]:       <model usable='yes'>486</model>
Oct 16 18:19:53 user nova-compute[74247]:     </mode>
Oct 16 18:19:53 user nova-compute[74247]:   </cpu>
Oct 16 18:19:53 user nova-compute[74247]:   <memoryBacking supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:     <enum name='sourceType'>
Oct 16 18:19:53 user nova-compute[74247]:       <value>file</value>
Oct 16 18:19:53 user nova-compute[74247]:       <value>anonymous</value>
Oct 16 18:19:53 user nova-compute[74247]:       <value>memfd</value>
Oct 16 18:19:53 user nova-compute[74247]:     </enum>
Oct 16 18:19:53 user nova-compute[74247]:   </memoryBacking>
Oct 16 18:19:53 user nova-compute[74247]:   <devices>
Oct 16 18:19:53 user nova-compute[74247]:     <disk supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='diskDevice'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>disk</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>cdrom</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>floppy</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>lun</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='bus'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>ide</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>fdc</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>scsi</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>usb</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>sata</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='model'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio-transitional</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio-non-transitional</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </disk>
Oct 16 18:19:53 user nova-compute[74247]:     <graphics supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='type'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>sdl</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>vnc</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>spice</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>egl-headless</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </graphics>
Oct 16 18:19:53 user nova-compute[74247]:     <video supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='modelType'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>vga</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>cirrus</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>vmvga</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>qxl</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>none</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>bochs</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>ramfb</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </video>
Oct 16 18:19:53 user nova-compute[74247]:     <hostdev supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='mode'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>subsystem</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='startupPolicy'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>default</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>mandatory</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>requisite</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>optional</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='subsysType'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>usb</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>pci</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>scsi</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='capsType'/>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='pciBackend'/>
Oct 16 18:19:53 user nova-compute[74247]:     </hostdev>
Oct 16 18:19:53 user nova-compute[74247]:     <rng supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='model'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio-transitional</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtio-non-transitional</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='backendModel'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>random</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>egd</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>builtin</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </rng>
Oct 16 18:19:53 user nova-compute[74247]:     <filesystem supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='driverType'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>path</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>handle</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>virtiofs</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </filesystem>
Oct 16 18:19:53 user nova-compute[74247]:     <tpm supported='yes'>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='model'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>tpm-tis</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>tpm-crb</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:       <enum name='backendModel'>
Oct 16 18:19:53 user nova-compute[74247]:         <value>passthrough</value>
Oct 16 18:19:53 user nova-compute[74247]:         <value>emulator</value>
Oct 16 18:19:53 user nova-compute[74247]:       </enum>
Oct 16 18:19:53 user nova-compute[74247]:     </tpm>
Oct 16 18:19:53 user nova-compute[74247]:   </devices>
Oct 16 18:19:53 user nova-compute[74247]:   <features>
Oct 16 18:19:53 user nova-compute[74247]:     <gic supported='no'/>
Oct 16 18:19:53 user nova-compute[74247]:     <vmcoreinfo supported='yes'/>
Oct 16 18:19:53 user nova-compute[74247]:     <genid supported='yes'/>
Oct 16 18:19:53 user nova-compute[74247]:     <backingStoreInput supported='yes'/>
Oct 16 18:19:53 user nova-compute[74247]:     <backup supported='yes'/>
Oct 16 18:19:53 user nova-compute[74247]:     <sev supported='no'/>
Oct 16 18:19:53 user nova-compute[74247]:   </features>
Oct 16 18:19:53 user nova-compute[74247]: </domainCapabilities>
Oct 16 18:19:53 user nova-compute[74247]:  {{(pid=74247) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Checking secure boot support for host arch (x86_64) {{(pid=74247) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 16 18:19:53 user nova-compute[74247]: INFO nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Secure Boot support detected
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] cpu compare xml: <cpu match="exact">
Oct 16 18:19:53 user nova-compute[74247]:   <model>Nehalem</model>
Oct 16 18:19:53 user nova-compute[74247]: </cpu>
Oct 16 18:19:53 user nova-compute[74247]:  {{(pid=74247) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Oct 16 18:19:53 user nova-compute[74247]: INFO nova.virt.node [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Generated node identity 7b8a7b7b-c686-4162-903b-700fbc4d7273
Oct 16 18:19:53 user nova-compute[74247]: INFO nova.virt.node [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Wrote node identity 7b8a7b7b-c686-4162-903b-700fbc4d7273 to /opt/stack/data/nova/compute_id
Oct 16 18:19:53 user nova-compute[74247]: WARNING nova.compute.manager [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Compute nodes ['7b8a7b7b-c686-4162-903b-700fbc4d7273'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Oct 16 18:19:53 user nova-compute[74247]: INFO nova.compute.manager [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Oct 16 18:19:53 user nova-compute[74247]: WARNING nova.compute.manager [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 16 18:19:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:19:53 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 18:19:54 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:19:54 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:19:54 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Hypervisor/Node resource view: name=user free_ram=10932MB free_disk=26.004165649414062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 18:19:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:19:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:19:54 user nova-compute[74247]: WARNING nova.compute.resource_tracker [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] No compute node record for user:7b8a7b7b-c686-4162-903b-700fbc4d7273: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 7b8a7b7b-c686-4162-903b-700fbc4d7273 could not be found.
Oct 16 18:19:54 user nova-compute[74247]: INFO nova.compute.resource_tracker [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Compute node record created for user:user with uuid: 7b8a7b7b-c686-4162-903b-700fbc4d7273
Oct 16 18:19:54 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 18:19:54 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 18:19:54 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] [req-ab1f95b4-0f65-4ad7-92d5-e7afa8958f33] Created resource provider record via placement API for resource provider with UUID 7b8a7b7b-c686-4162-903b-700fbc4d7273 and name user.
Oct 16 18:19:54 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74247) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Oct 16 18:19:54 user nova-compute[74247]: INFO nova.virt.libvirt.host [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] kernel doesn't support AMD SEV
Oct 16 18:19:54 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Updating inventory in ProviderTree for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 16 18:19:54 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:19:54 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Libvirt baseline CPU <cpu>
Oct 16 18:19:54 user nova-compute[74247]:   <arch>x86_64</arch>
Oct 16 18:19:54 user nova-compute[74247]:   <model>Nehalem</model>
Oct 16 18:19:54 user nova-compute[74247]:   <vendor>Intel</vendor>
Oct 16 18:19:54 user nova-compute[74247]:   <topology sockets="6" cores="1" threads="1"/>
Oct 16 18:19:54 user nova-compute[74247]: </cpu>
Oct 16 18:19:54 user nova-compute[74247]:  {{(pid=74247) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Oct 16 18:19:54 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Updated inventory for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Oct 16 18:19:54 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Updating resource provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 generation from 0 to 1 during operation: update_inventory {{(pid=74247) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 16 18:19:54 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Updating inventory in ProviderTree for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 16 18:19:54 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Updating resource provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 generation from 1 to 2 during operation: update_traits {{(pid=74247) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 16 18:19:54 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 18:19:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.678s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:19:54 user nova-compute[74247]: DEBUG nova.service [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Creating RPC server for service compute {{(pid=74247) start /opt/stack/nova/nova/service.py:182}}
Oct 16 18:19:54 user nova-compute[74247]: DEBUG nova.service [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] Join ServiceGroup membership for this service compute {{(pid=74247) start /opt/stack/nova/nova/service.py:199}}
Oct 16 18:19:54 user nova-compute[74247]: DEBUG nova.servicegroup.drivers.db [None req-fa23c042-87bc-40d7-909b-b181fbc74c6d None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74247) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Oct 16 18:20:15 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._sync_power_states {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:20:15 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:20:45 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:20:45 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:20:45 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 18:20:45 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Rebuilding the list of instances to heal {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 18:20:45 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Didn't find any instances for network info cache update. {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 18:20:45 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:20:45 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:20:45 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:20:45 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:20:45 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:20:45 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:20:45 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 18:20:45 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:20:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:20:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:20:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:20:45 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 18:20:45 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:20:45 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:20:45 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=10393MB free_disk=25.907878875732422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 18:20:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:20:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:20:46 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 18:20:46 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 18:20:46 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:20:46 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:20:46 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 18:20:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.149s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:21:46 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:21:46 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:21:46 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:21:46 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:21:46 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:21:46 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 18:21:46 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:21:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:21:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:21:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:21:46 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 18:21:46 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:21:46 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:21:46 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=10297MB free_disk=25.972129821777344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 18:21:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:21:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:21:46 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 18:21:46 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 18:21:47 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:21:47 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:21:47 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 18:21:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.108s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:21:48 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:21:48 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:21:48 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 18:21:48 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Rebuilding the list of instances to heal {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 18:21:48 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Didn't find any instances for network info cache update. {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 18:21:48 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:21:48 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:22:45 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:22:45 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:22:47 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:22:47 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 18:22:47 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Rebuilding the list of instances to heal {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 18:22:47 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Didn't find any instances for network info cache update. {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 18:22:47 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:22:47 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:22:47 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 18:22:48 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:22:48 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:22:48 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:22:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:22:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:22:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:22:48 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 18:22:48 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:22:48 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:22:48 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=10321MB free_disk=25.725543975830078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 18:22:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:22:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:22:49 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 18:22:49 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 18:22:49 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:22:49 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:22:49 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 18:22:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:22:50 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:23:45 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:23:45 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:23:47 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:23:48 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:23:48 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 18:23:48 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Rebuilding the list of instances to heal {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 18:23:48 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Didn't find any instances for network info cache update. {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 18:23:48 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:23:48 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:23:48 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:23:48 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:23:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:23:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:23:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:23:48 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 18:23:49 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:23:49 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:23:49 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=9599MB free_disk=25.745574951171875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 18:23:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:23:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:23:49 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 18:23:49 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 18:23:49 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:23:49 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:23:49 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 18:23:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:23:50 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:23:50 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 18:23:51 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:23:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Acquiring lock "b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:23:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Lock "b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:23:55 user nova-compute[74247]: DEBUG nova.compute.manager [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 18:23:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:23:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:23:55 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:23:55 user nova-compute[74247]: INFO nova.compute.claims [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Claim successful on node user
Oct 16 18:23:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "e37fbc27-3404-479a-be08-4d590391cf30" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:23:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "e37fbc27-3404-479a-be08-4d590391cf30" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:23:56 user nova-compute[74247]: DEBUG nova.compute.manager [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 18:23:56 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:23:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:23:56 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:23:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.764s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:23:56 user nova-compute[74247]: DEBUG nova.compute.manager [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 18:23:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.069s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:23:56 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:23:56 user nova-compute[74247]: INFO nova.compute.claims [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Claim successful on node user
Oct 16 18:23:56 user nova-compute[74247]: DEBUG nova.compute.manager [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 18:23:56 user nova-compute[74247]: DEBUG nova.network.neutron [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 18:23:56 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 18:23:56 user nova-compute[74247]: DEBUG nova.compute.manager [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 18:23:56 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:23:56 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:23:56 user nova-compute[74247]: DEBUG nova.compute.manager [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 18:23:56 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:23:56 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Creating image(s)
Oct 16 18:23:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Acquiring lock "/opt/stack/data/nova/instances/b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:23:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Lock "/opt/stack/data/nova/instances/b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:23:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Lock "/opt/stack/data/nova/instances/b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:23:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Acquiring lock "37399febbd18f60b85fd0f833558f6a3539ab231" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:23:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:23:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.436s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:23:56 user nova-compute[74247]: DEBUG nova.compute.manager [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 18:23:56 user nova-compute[74247]: DEBUG nova.compute.manager [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 18:23:56 user nova-compute[74247]: DEBUG nova.network.neutron [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: e37fbc27-3404-479a-be08-4d590391cf30] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 18:23:56 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 18:23:56 user nova-compute[74247]: DEBUG nova.compute.manager [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 18:23:57 user nova-compute[74247]: DEBUG nova.policy [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c82a90fcbed4a38b4f69a18de607f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e9d0485eec462990dd029379397962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 18:23:57 user nova-compute[74247]: DEBUG nova.policy [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3635a30f06234f0d9a8e0604c25f1208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd3eb752f04fd48dfe0623fdf2fe9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 18:23:57 user nova-compute[74247]: DEBUG nova.compute.manager [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 18:23:57 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:23:57 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Creating image(s)
Oct 16 18:23:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "/opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:23:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "/opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:23:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "/opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:23:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "37399febbd18f60b85fd0f833558f6a3539ab231" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:23:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231.part --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:23:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231.part --force-share --output=json" returned: 0 in 0.183s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:23:57 user nova-compute[74247]: DEBUG nova.virt.images [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] 83126bb1-29f5-42fe-8620-72ab0797f776 was qcow2, converting to raw {{(pid=74247) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 16 18:23:57 user nova-compute[74247]: DEBUG nova.privsep.utils [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74247) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 18:23:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231.part /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231.converted {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:23:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231.part /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231.converted" returned: 0 in 0.243s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:23:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231.converted --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:23:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231.converted --force-share --output=json" returned: 0 in 0.198s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:23:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.356s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:23:58 user nova-compute[74247]: INFO oslo.privsep.daemon [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmppan_3b9r/privsep.sock']
Oct 16 18:23:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.715s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:23:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:23:58 user sudo[83476]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmppan_3b9r/privsep.sock
Oct 16 18:23:58 user sudo[83476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 16 18:23:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Acquiring lock "738eb591-f3dc-4392-b8f2-41530d30ff58" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:23:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Lock "738eb591-f3dc-4392-b8f2-41530d30ff58" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:23:58 user nova-compute[74247]: DEBUG nova.compute.manager [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 18:23:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:23:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:23:58 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:23:58 user nova-compute[74247]: INFO nova.compute.claims [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Claim successful on node user
Oct 16 18:23:58 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:23:58 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:23:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.611s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:23:58 user nova-compute[74247]: DEBUG nova.compute.manager [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 18:23:58 user nova-compute[74247]: DEBUG nova.compute.manager [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 18:23:58 user nova-compute[74247]: DEBUG nova.network.neutron [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 18:23:59 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 18:23:59 user nova-compute[74247]: DEBUG nova.compute.manager [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 18:23:59 user nova-compute[74247]: DEBUG nova.compute.manager [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 18:23:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:23:59 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Creating image(s)
Oct 16 18:23:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Acquiring lock "/opt/stack/data/nova/instances/738eb591-f3dc-4392-b8f2-41530d30ff58/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:23:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Lock "/opt/stack/data/nova/instances/738eb591-f3dc-4392-b8f2-41530d30ff58/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:23:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Lock "/opt/stack/data/nova/instances/738eb591-f3dc-4392-b8f2-41530d30ff58/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:23:59 user nova-compute[74247]: DEBUG nova.policy [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '179ec1d05cf849078826929622dbfc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdc21ff13d14516bf4b96c7b6fee216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 18:23:59 user nova-compute[74247]: DEBUG nova.network.neutron [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Successfully created port: f4db2672-7205-43d7-ac3b-3f6ea5c336c6 {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:23:59 user nova-compute[74247]: DEBUG nova.network.neutron [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Successfully created port: 634511f9-ce96-4fe6-8bfc-51846e4dcb4f {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:23:59 user sudo[83476]: pam_unix(sudo:session): session closed for user root
Oct 16 18:23:59 user nova-compute[74247]: INFO oslo.privsep.daemon [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Spawned new privsep daemon via rootwrap
Oct 16 18:23:59 user nova-compute[74247]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 16 18:23:59 user nova-compute[74247]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 16 18:23:59 user nova-compute[74247]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Oct 16 18:23:59 user nova-compute[74247]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83479
Oct 16 18:23:59 user nova-compute[74247]: WARNING oslo_privsep.priv_context [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] privsep daemon already running
Oct 16 18:23:59 user nova-compute[74247]: WARNING oslo_privsep.priv_context [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] privsep daemon already running
Oct 16 18:23:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:23:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:23:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:23:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.175s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:23:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Acquiring lock "37399febbd18f60b85fd0f833558f6a3539ab231" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:23:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:23:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:23:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.186s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:23:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Acquiring lock "37399febbd18f60b85fd0f833558f6a3539ab231" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:23:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.172s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:23:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "37399febbd18f60b85fd0f833558f6a3539ab231" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.191s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/738eb591-f3dc-4392-b8f2-41530d30ff58/disk 1073741824 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/738eb591-f3dc-4392-b8f2-41530d30ff58/disk 1073741824" returned: 0 in 0.052s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.227s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.193s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:00 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Checking if we can resize image /opt/stack/data/nova/instances/738eb591-f3dc-4392-b8f2-41530d30ff58/disk. size=1073741824 {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 18:24:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/738eb591-f3dc-4392-b8f2-41530d30ff58/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.188s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d/disk 1073741824 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d/disk 1073741824" returned: 0 in 0.055s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.486s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/738eb591-f3dc-4392-b8f2-41530d30ff58/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:00 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Cannot resize image /opt/stack/data/nova/instances/738eb591-f3dc-4392-b8f2-41530d30ff58/disk to a smaller size. {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 18:24:00 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 18:24:00 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Ensure instance console log exists: /opt/stack/data/nova/instances/738eb591-f3dc-4392-b8f2-41530d30ff58/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:24:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.186s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:00 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d/disk. size=1073741824 {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 18:24:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.210s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk 1073741824 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk 1073741824" returned: 0 in 0.047s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:00 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Cannot resize image /opt/stack/data/nova/instances/b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d/disk to a smaller size. {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 18:24:00 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 18:24:00 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Ensure instance console log exists: /opt/stack/data/nova/instances/b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:24:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.195s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:00 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk. size=1073741824 {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 18:24:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:01 user nova-compute[74247]: DEBUG nova.network.neutron [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Successfully created port: 69bb0aea-e59a-49fc-8049-c04a3dc8597c {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:24:01 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:01 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Cannot resize image /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk to a smaller size. {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 18:24:01 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 18:24:01 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Ensure instance console log exists: /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:24:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:01 user nova-compute[74247]: DEBUG nova.network.neutron [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Successfully updated port: f4db2672-7205-43d7-ac3b-3f6ea5c336c6 {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:24:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Acquiring lock "refresh_cache-b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:24:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Acquired lock "refresh_cache-b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:24:01 user nova-compute[74247]: DEBUG nova.network.neutron [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:24:02 user nova-compute[74247]: DEBUG nova.network.neutron [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Successfully updated port: 634511f9-ce96-4fe6-8bfc-51846e4dcb4f {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:24:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "refresh_cache-e37fbc27-3404-479a-be08-4d590391cf30" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:24:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquired lock "refresh_cache-e37fbc27-3404-479a-be08-4d590391cf30" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:24:02 user nova-compute[74247]: DEBUG nova.network.neutron [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:24:02 user nova-compute[74247]: DEBUG nova.network.neutron [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:24:02 user nova-compute[74247]: DEBUG nova.network.neutron [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:24:02 user nova-compute[74247]: DEBUG nova.compute.manager [req-6fe41a2e-7cf4-44ea-b52e-5f6c7dde3feb req-ae8615bd-af1b-4d78-9d57-4b42149fc896 service nova] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Received event network-changed-f4db2672-7205-43d7-ac3b-3f6ea5c336c6 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:24:02 user nova-compute[74247]: DEBUG nova.compute.manager [req-6fe41a2e-7cf4-44ea-b52e-5f6c7dde3feb req-ae8615bd-af1b-4d78-9d57-4b42149fc896 service nova] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Refreshing instance network info cache due to event network-changed-f4db2672-7205-43d7-ac3b-3f6ea5c336c6. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:24:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-6fe41a2e-7cf4-44ea-b52e-5f6c7dde3feb req-ae8615bd-af1b-4d78-9d57-4b42149fc896 service nova] Acquiring lock "refresh_cache-b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:24:02 user nova-compute[74247]: DEBUG nova.compute.manager [req-2279f165-bfa8-4a39-a28c-c1f67f67873a req-97edf0dc-18a3-45bd-a238-033abe68bcd8 service nova] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Received event network-changed-634511f9-ce96-4fe6-8bfc-51846e4dcb4f {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:24:02 user nova-compute[74247]: DEBUG nova.compute.manager [req-2279f165-bfa8-4a39-a28c-c1f67f67873a req-97edf0dc-18a3-45bd-a238-033abe68bcd8 service nova] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Refreshing instance network info cache due to event network-changed-634511f9-ce96-4fe6-8bfc-51846e4dcb4f. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:24:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-2279f165-bfa8-4a39-a28c-c1f67f67873a req-97edf0dc-18a3-45bd-a238-033abe68bcd8 service nova] Acquiring lock "refresh_cache-e37fbc27-3404-479a-be08-4d590391cf30" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.network.neutron [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Successfully updated port: 69bb0aea-e59a-49fc-8049-c04a3dc8597c {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Acquiring lock "refresh_cache-738eb591-f3dc-4392-b8f2-41530d30ff58" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Acquired lock "refresh_cache-738eb591-f3dc-4392-b8f2-41530d30ff58" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.network.neutron [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.network.neutron [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Updating instance_info_cache with network_info: [{"id": "f4db2672-7205-43d7-ac3b-3f6ea5c336c6", "address": "fa:16:3e:5f:52:2e", "network": {"id": "f99cbf0c-7d0c-4ef8-934a-aaac218e9381", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2096188408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94e9d0485eec462990dd029379397962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4db2672-72", "ovs_interfaceid": "f4db2672-7205-43d7-ac3b-3f6ea5c336c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Releasing lock "refresh_cache-b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.compute.manager [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Instance network_info: |[{"id": "f4db2672-7205-43d7-ac3b-3f6ea5c336c6", "address": "fa:16:3e:5f:52:2e", "network": {"id": "f99cbf0c-7d0c-4ef8-934a-aaac218e9381", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2096188408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94e9d0485eec462990dd029379397962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4db2672-72", "ovs_interfaceid": "f4db2672-7205-43d7-ac3b-3f6ea5c336c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-6fe41a2e-7cf4-44ea-b52e-5f6c7dde3feb req-ae8615bd-af1b-4d78-9d57-4b42149fc896 service nova] Acquired lock "refresh_cache-b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.network.neutron [req-6fe41a2e-7cf4-44ea-b52e-5f6c7dde3feb req-ae8615bd-af1b-4d78-9d57-4b42149fc896 service nova] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Refreshing network info cache for port f4db2672-7205-43d7-ac3b-3f6ea5c336c6 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Start _get_guest_xml network_info=[{"id": "f4db2672-7205-43d7-ac3b-3f6ea5c336c6", "address": "fa:16:3e:5f:52:2e", "network": {"id": "f99cbf0c-7d0c-4ef8-934a-aaac218e9381", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2096188408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94e9d0485eec462990dd029379397962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4db2672-72", "ovs_interfaceid": "f4db2672-7205-43d7-ac3b-3f6ea5c336c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': '83126bb1-29f5-42fe-8620-72ab0797f776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:24:03 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:24:03 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.privsep.utils [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74247) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:23:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-716225271',display_name='tempest-ServersNegativeTestJSON-server-716225271',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-716225271',id=1,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94e9d0485eec462990dd029379397962',ramdisk_id='',reservation_id='r-k2w0anvk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1696683961',owner_user_name='tempest-ServersNegativeTestJSON-1696683961-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:23:56Z,user_data=None,user_id='8c82a90fcbed4a38b4f69a18de607f1f',uuid=b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4db2672-7205-43d7-ac3b-3f6ea5c336c6", "address": "fa:16:3e:5f:52:2e", "network": {"id": "f99cbf0c-7d0c-4ef8-934a-aaac218e9381", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2096188408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94e9d0485eec462990dd029379397962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4db2672-72", "ovs_interfaceid": "f4db2672-7205-43d7-ac3b-3f6ea5c336c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Converting VIF {"id": "f4db2672-7205-43d7-ac3b-3f6ea5c336c6", "address": "fa:16:3e:5f:52:2e", "network": {"id": "f99cbf0c-7d0c-4ef8-934a-aaac218e9381", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2096188408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94e9d0485eec462990dd029379397962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4db2672-72", "ovs_interfaceid": "f4db2672-7205-43d7-ac3b-3f6ea5c336c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:52:2e,bridge_name='br-int',has_traffic_filtering=True,id=f4db2672-7205-43d7-ac3b-3f6ea5c336c6,network=Network(f99cbf0c-7d0c-4ef8-934a-aaac218e9381),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4db2672-72') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.objects.instance [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Lazy-loading 'pci_devices' on Instance uuid b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.network.neutron [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Acquiring lock "a686ee86-272c-47be-8801-9c1500af272f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lock "a686ee86-272c-47be-8801-9c1500af272f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:24:03 user nova-compute[74247]:   <uuid>b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d</uuid>
Oct 16 18:24:03 user nova-compute[74247]:   <name>instance-00000001</name>
Oct 16 18:24:03 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:24:03 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:24:03 user nova-compute[74247]:   <metadata>
Oct 16 18:24:03 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:24:03 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:24:03 user nova-compute[74247]:       <nova:name>tempest-ServersNegativeTestJSON-server-716225271</nova:name>
Oct 16 18:24:03 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:24:03</nova:creationTime>
Oct 16 18:24:03 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:24:03 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:24:03 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:24:03 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:24:03 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:24:03 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:24:03 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:24:03 user nova-compute[74247]:       <nova:owner>
Oct 16 18:24:03 user nova-compute[74247]:         <nova:user uuid="8c82a90fcbed4a38b4f69a18de607f1f">tempest-ServersNegativeTestJSON-1696683961-project-member</nova:user>
Oct 16 18:24:03 user nova-compute[74247]:         <nova:project uuid="94e9d0485eec462990dd029379397962">tempest-ServersNegativeTestJSON-1696683961</nova:project>
Oct 16 18:24:03 user nova-compute[74247]:       </nova:owner>
Oct 16 18:24:03 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:24:03 user nova-compute[74247]:       <nova:ports>
Oct 16 18:24:03 user nova-compute[74247]:         <nova:port uuid="f4db2672-7205-43d7-ac3b-3f6ea5c336c6">
Oct 16 18:24:03 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 16 18:24:03 user nova-compute[74247]:         </nova:port>
Oct 16 18:24:03 user nova-compute[74247]:       </nova:ports>
Oct 16 18:24:03 user nova-compute[74247]:     </nova:instance>
Oct 16 18:24:03 user nova-compute[74247]:   </metadata>
Oct 16 18:24:03 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:24:03 user nova-compute[74247]:     <system>
Oct 16 18:24:03 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:24:03 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:24:03 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:24:03 user nova-compute[74247]:       <entry name="serial">b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d</entry>
Oct 16 18:24:03 user nova-compute[74247]:       <entry name="uuid">b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d</entry>
Oct 16 18:24:03 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:24:03 user nova-compute[74247]:     </system>
Oct 16 18:24:03 user nova-compute[74247]:   </sysinfo>
Oct 16 18:24:03 user nova-compute[74247]:   <os>
Oct 16 18:24:03 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:24:03 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:24:03 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:24:03 user nova-compute[74247]:   </os>
Oct 16 18:24:03 user nova-compute[74247]:   <features>
Oct 16 18:24:03 user nova-compute[74247]:     <acpi/>
Oct 16 18:24:03 user nova-compute[74247]:     <apic/>
Oct 16 18:24:03 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:24:03 user nova-compute[74247]:   </features>
Oct 16 18:24:03 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:24:03 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:24:03 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:24:03 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:24:03 user nova-compute[74247]:   </clock>
Oct 16 18:24:03 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:24:03 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:24:03 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:24:03 user nova-compute[74247]:   </cpu>
Oct 16 18:24:03 user nova-compute[74247]:   <devices>
Oct 16 18:24:03 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:24:03 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:24:03 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d/disk"/>
Oct 16 18:24:03 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:24:03 user nova-compute[74247]:     </disk>
Oct 16 18:24:03 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:24:03 user nova-compute[74247]:       <mac address="fa:16:3e:5f:52:2e"/>
Oct 16 18:24:03 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:24:03 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:24:03 user nova-compute[74247]:       <target dev="tapf4db2672-72"/>
Oct 16 18:24:03 user nova-compute[74247]:     </interface>
Oct 16 18:24:03 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:24:03 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d/console.log" append="off"/>
Oct 16 18:24:03 user nova-compute[74247]:     </serial>
Oct 16 18:24:03 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:24:03 user nova-compute[74247]:     <video>
Oct 16 18:24:03 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:24:03 user nova-compute[74247]:     </video>
Oct 16 18:24:03 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:24:03 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:24:03 user nova-compute[74247]:     </rng>
Oct 16 18:24:03 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:24:03 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:24:03 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:24:03 user nova-compute[74247]:     </memballoon>
Oct 16 18:24:03 user nova-compute[74247]:   </devices>
Oct 16 18:24:03 user nova-compute[74247]: </domain>
Oct 16 18:24:03 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:23:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-716225271',display_name='tempest-ServersNegativeTestJSON-server-716225271',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-716225271',id=1,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94e9d0485eec462990dd029379397962',ramdisk_id='',reservation_id='r-k2w0anvk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1696683961',owner_user_name='tempest-ServersNegativeTestJSON-1696683961-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:23:56Z,user_data=None,user_id='8c82a90fcbed4a38b4f69a18de607f1f',uuid=b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4db2672-7205-43d7-ac3b-3f6ea5c336c6", "address": "fa:16:3e:5f:52:2e", "network": {"id": "f99cbf0c-7d0c-4ef8-934a-aaac218e9381", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2096188408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94e9d0485eec462990dd029379397962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4db2672-72", "ovs_interfaceid": "f4db2672-7205-43d7-ac3b-3f6ea5c336c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Converting VIF {"id": "f4db2672-7205-43d7-ac3b-3f6ea5c336c6", "address": "fa:16:3e:5f:52:2e", "network": {"id": "f99cbf0c-7d0c-4ef8-934a-aaac218e9381", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2096188408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94e9d0485eec462990dd029379397962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4db2672-72", "ovs_interfaceid": "f4db2672-7205-43d7-ac3b-3f6ea5c336c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:52:2e,bridge_name='br-int',has_traffic_filtering=True,id=f4db2672-7205-43d7-ac3b-3f6ea5c336c6,network=Network(f99cbf0c-7d0c-4ef8-934a-aaac218e9381),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4db2672-72') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG os_vif [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:52:2e,bridge_name='br-int',has_traffic_filtering=True,id=f4db2672-7205-43d7-ac3b-3f6ea5c336c6,network=Network(f99cbf0c-7d0c-4ef8-934a-aaac218e9381),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4db2672-72') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.compute.manager [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Created schema index Interface.name {{(pid=74247) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Created schema index Port.name {{(pid=74247) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Created schema index Bridge.name {{(pid=74247) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [POLLOUT] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.network.neutron [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Updating instance_info_cache with network_info: [{"id": "634511f9-ce96-4fe6-8bfc-51846e4dcb4f", "address": "fa:16:3e:d2:d2:f4", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634511f9-ce", "ovs_interfaceid": "634511f9-ce96-4fe6-8bfc-51846e4dcb4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.compute.manager [req-4be9f70c-c66a-418b-9c5f-c45acb34b921 req-9f24bca9-493d-4130-852b-abfdd7f3055d service nova] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Received event network-changed-69bb0aea-e59a-49fc-8049-c04a3dc8597c {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.compute.manager [req-4be9f70c-c66a-418b-9c5f-c45acb34b921 req-9f24bca9-493d-4130-852b-abfdd7f3055d service nova] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Refreshing instance network info cache due to event network-changed-69bb0aea-e59a-49fc-8049-c04a3dc8597c. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4be9f70c-c66a-418b-9c5f-c45acb34b921 req-9f24bca9-493d-4130-852b-abfdd7f3055d service nova] Acquiring lock "refresh_cache-738eb591-f3dc-4392-b8f2-41530d30ff58" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1a7acc3c-4af0-5f68-bb22-f1aaab43ef29', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:24:03 user nova-compute[74247]: INFO oslo.privsep.daemon [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpohu9i5u0/privsep.sock']
Oct 16 18:24:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:24:03 user nova-compute[74247]: INFO nova.compute.claims [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Claim successful on node user
Oct 16 18:24:03 user sudo[83554]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpohu9i5u0/privsep.sock
Oct 16 18:24:03 user sudo[83554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 16 18:24:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Releasing lock "refresh_cache-e37fbc27-3404-479a-be08-4d590391cf30" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.compute.manager [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Instance network_info: |[{"id": "634511f9-ce96-4fe6-8bfc-51846e4dcb4f", "address": "fa:16:3e:d2:d2:f4", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634511f9-ce", "ovs_interfaceid": "634511f9-ce96-4fe6-8bfc-51846e4dcb4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-2279f165-bfa8-4a39-a28c-c1f67f67873a req-97edf0dc-18a3-45bd-a238-033abe68bcd8 service nova] Acquired lock "refresh_cache-e37fbc27-3404-479a-be08-4d590391cf30" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.network.neutron [req-2279f165-bfa8-4a39-a28c-c1f67f67873a req-97edf0dc-18a3-45bd-a238-033abe68bcd8 service nova] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Refreshing network info cache for port 634511f9-ce96-4fe6-8bfc-51846e4dcb4f {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Start _get_guest_xml network_info=[{"id": "634511f9-ce96-4fe6-8bfc-51846e4dcb4f", "address": "fa:16:3e:d2:d2:f4", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634511f9-ce", "ovs_interfaceid": "634511f9-ce96-4fe6-8bfc-51846e4dcb4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': '83126bb1-29f5-42fe-8620-72ab0797f776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:24:03 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:24:03 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:23:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1467189349',display_name='tempest-ServerActionsTestOtherA-server-1467189349',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1467189349',id=2,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/sQ/2CMkopvPZot1Iryii0p1Iq3sQgAbR+a1zff3LwsTrC97Bkir58aQPXckuRP2Pk52sgcmyihyOLiY8s4svRhqknfDOoanrdDaAunocHU/6uHElK38rY7fNKG4cJVA==',key_name='tempest-keypair-869426560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42bd3eb752f04fd48dfe0623fdf2fe9f',ramdisk_id='',reservation_id='r-plrjjfkw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-291765974',owner_user_name='tempest-ServerActionsTestOtherA-291765974-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:23:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3635a30f06234f0d9a8e0604c25f1208',uuid=e37fbc27-3404-479a-be08-4d590391cf30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "634511f9-ce96-4fe6-8bfc-51846e4dcb4f", "address": "fa:16:3e:d2:d2:f4", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634511f9-ce", "ovs_interfaceid": "634511f9-ce96-4fe6-8bfc-51846e4dcb4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Converting VIF {"id": "634511f9-ce96-4fe6-8bfc-51846e4dcb4f", "address": "fa:16:3e:d2:d2:f4", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634511f9-ce", "ovs_interfaceid": "634511f9-ce96-4fe6-8bfc-51846e4dcb4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:d2:f4,bridge_name='br-int',has_traffic_filtering=True,id=634511f9-ce96-4fe6-8bfc-51846e4dcb4f,network=Network(0a61bae1-2607-4e42-b573-e74ac3edf09a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap634511f9-ce') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.objects.instance [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lazy-loading 'pci_devices' on Instance uuid e37fbc27-3404-479a-be08-4d590391cf30 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: e37fbc27-3404-479a-be08-4d590391cf30] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:24:03 user nova-compute[74247]:   <uuid>e37fbc27-3404-479a-be08-4d590391cf30</uuid>
Oct 16 18:24:03 user nova-compute[74247]:   <name>instance-00000002</name>
Oct 16 18:24:03 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:24:03 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:24:03 user nova-compute[74247]:   <metadata>
Oct 16 18:24:03 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:24:03 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:24:03 user nova-compute[74247]:       <nova:name>tempest-ServerActionsTestOtherA-server-1467189349</nova:name>
Oct 16 18:24:03 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:24:03</nova:creationTime>
Oct 16 18:24:03 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:24:03 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:24:03 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:24:03 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:24:03 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:24:03 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:24:03 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:24:03 user nova-compute[74247]:       <nova:owner>
Oct 16 18:24:03 user nova-compute[74247]:         <nova:user uuid="3635a30f06234f0d9a8e0604c25f1208">tempest-ServerActionsTestOtherA-291765974-project-member</nova:user>
Oct 16 18:24:03 user nova-compute[74247]:         <nova:project uuid="42bd3eb752f04fd48dfe0623fdf2fe9f">tempest-ServerActionsTestOtherA-291765974</nova:project>
Oct 16 18:24:03 user nova-compute[74247]:       </nova:owner>
Oct 16 18:24:03 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:24:03 user nova-compute[74247]:       <nova:ports>
Oct 16 18:24:03 user nova-compute[74247]:         <nova:port uuid="634511f9-ce96-4fe6-8bfc-51846e4dcb4f">
Oct 16 18:24:03 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 16 18:24:03 user nova-compute[74247]:         </nova:port>
Oct 16 18:24:03 user nova-compute[74247]:       </nova:ports>
Oct 16 18:24:03 user nova-compute[74247]:     </nova:instance>
Oct 16 18:24:03 user nova-compute[74247]:   </metadata>
Oct 16 18:24:03 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:24:03 user nova-compute[74247]:     <system>
Oct 16 18:24:03 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:24:03 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:24:03 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:24:03 user nova-compute[74247]:       <entry name="serial">e37fbc27-3404-479a-be08-4d590391cf30</entry>
Oct 16 18:24:03 user nova-compute[74247]:       <entry name="uuid">e37fbc27-3404-479a-be08-4d590391cf30</entry>
Oct 16 18:24:03 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:24:03 user nova-compute[74247]:     </system>
Oct 16 18:24:03 user nova-compute[74247]:   </sysinfo>
Oct 16 18:24:03 user nova-compute[74247]:   <os>
Oct 16 18:24:03 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:24:03 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:24:03 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:24:03 user nova-compute[74247]:   </os>
Oct 16 18:24:03 user nova-compute[74247]:   <features>
Oct 16 18:24:03 user nova-compute[74247]:     <acpi/>
Oct 16 18:24:03 user nova-compute[74247]:     <apic/>
Oct 16 18:24:03 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:24:03 user nova-compute[74247]:   </features>
Oct 16 18:24:03 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:24:03 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:24:03 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:24:03 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:24:03 user nova-compute[74247]:   </clock>
Oct 16 18:24:03 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:24:03 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:24:03 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:24:03 user nova-compute[74247]:   </cpu>
Oct 16 18:24:03 user nova-compute[74247]:   <devices>
Oct 16 18:24:03 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:24:03 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:24:03 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk"/>
Oct 16 18:24:03 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:24:03 user nova-compute[74247]:     </disk>
Oct 16 18:24:03 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:24:03 user nova-compute[74247]:       <mac address="fa:16:3e:d2:d2:f4"/>
Oct 16 18:24:03 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:24:03 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:24:03 user nova-compute[74247]:       <target dev="tap634511f9-ce"/>
Oct 16 18:24:03 user nova-compute[74247]:     </interface>
Oct 16 18:24:03 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:24:03 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/console.log" append="off"/>
Oct 16 18:24:03 user nova-compute[74247]:     </serial>
Oct 16 18:24:03 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:24:03 user nova-compute[74247]:     <video>
Oct 16 18:24:03 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:24:03 user nova-compute[74247]:     </video>
Oct 16 18:24:03 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:24:03 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:24:03 user nova-compute[74247]:     </rng>
Oct 16 18:24:03 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:24:03 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:24:03 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:24:03 user nova-compute[74247]:     </memballoon>
Oct 16 18:24:03 user nova-compute[74247]:   </devices>
Oct 16 18:24:03 user nova-compute[74247]: </domain>
Oct 16 18:24:03 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:23:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1467189349',display_name='tempest-ServerActionsTestOtherA-server-1467189349',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1467189349',id=2,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/sQ/2CMkopvPZot1Iryii0p1Iq3sQgAbR+a1zff3LwsTrC97Bkir58aQPXckuRP2Pk52sgcmyihyOLiY8s4svRhqknfDOoanrdDaAunocHU/6uHElK38rY7fNKG4cJVA==',key_name='tempest-keypair-869426560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42bd3eb752f04fd48dfe0623fdf2fe9f',ramdisk_id='',reservation_id='r-plrjjfkw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-291765974',owner_user_name='tempest-ServerActionsTestOtherA-291765974-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:23:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3635a30f06234f0d9a8e0604c25f1208',uuid=e37fbc27-3404-479a-be08-4d590391cf30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "634511f9-ce96-4fe6-8bfc-51846e4dcb4f", "address": "fa:16:3e:d2:d2:f4", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634511f9-ce", "ovs_interfaceid": "634511f9-ce96-4fe6-8bfc-51846e4dcb4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Converting VIF {"id": "634511f9-ce96-4fe6-8bfc-51846e4dcb4f", "address": "fa:16:3e:d2:d2:f4", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634511f9-ce", "ovs_interfaceid": "634511f9-ce96-4fe6-8bfc-51846e4dcb4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:d2:f4,bridge_name='br-int',has_traffic_filtering=True,id=634511f9-ce96-4fe6-8bfc-51846e4dcb4f,network=Network(0a61bae1-2607-4e42-b573-e74ac3edf09a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap634511f9-ce') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG os_vif [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:d2:f4,bridge_name='br-int',has_traffic_filtering=True,id=634511f9-ce96-4fe6-8bfc-51846e4dcb4f,network=Network(0a61bae1-2607-4e42-b573-e74ac3edf09a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap634511f9-ce') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '30d56b8a-8526-5a27-af29-c5ee1b6df28c', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.network.neutron [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Updating instance_info_cache with network_info: [{"id": "69bb0aea-e59a-49fc-8049-c04a3dc8597c", "address": "fa:16:3e:25:25:81", "network": {"id": "2ee6c29c-3eb2-4ad9-8405-3c088bb6bf95", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-275444579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fdc21ff13d14516bf4b96c7b6fee216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69bb0aea-e5", "ovs_interfaceid": "69bb0aea-e59a-49fc-8049-c04a3dc8597c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Releasing lock "refresh_cache-738eb591-f3dc-4392-b8f2-41530d30ff58" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.compute.manager [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Instance network_info: |[{"id": "69bb0aea-e59a-49fc-8049-c04a3dc8597c", "address": "fa:16:3e:25:25:81", "network": {"id": "2ee6c29c-3eb2-4ad9-8405-3c088bb6bf95", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-275444579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fdc21ff13d14516bf4b96c7b6fee216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69bb0aea-e5", "ovs_interfaceid": "69bb0aea-e59a-49fc-8049-c04a3dc8597c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4be9f70c-c66a-418b-9c5f-c45acb34b921 req-9f24bca9-493d-4130-852b-abfdd7f3055d service nova] Acquired lock "refresh_cache-738eb591-f3dc-4392-b8f2-41530d30ff58" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.network.neutron [req-4be9f70c-c66a-418b-9c5f-c45acb34b921 req-9f24bca9-493d-4130-852b-abfdd7f3055d service nova] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Refreshing network info cache for port 69bb0aea-e59a-49fc-8049-c04a3dc8597c {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Start _get_guest_xml network_info=[{"id": "69bb0aea-e59a-49fc-8049-c04a3dc8597c", "address": "fa:16:3e:25:25:81", "network": {"id": "2ee6c29c-3eb2-4ad9-8405-3c088bb6bf95", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-275444579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fdc21ff13d14516bf4b96c7b6fee216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69bb0aea-e5", "ovs_interfaceid": "69bb0aea-e59a-49fc-8049-c04a3dc8597c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': '83126bb1-29f5-42fe-8620-72ab0797f776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:24:03 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:24:03 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:24:03 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:24:04 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:23:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1043768477',display_name='tempest-DeleteServersTestJSON-server-1043768477',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1043768477',id=3,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8fdc21ff13d14516bf4b96c7b6fee216',ramdisk_id='',reservation_id='r-st5pd0fz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-910315946',owner_user_name='tempest-DeleteServersTestJSON-910315946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:23:59Z,user_data=None,user_id='179ec1d05cf849078826929622dbfc4c',uuid=738eb591-f3dc-4392-b8f2-41530d30ff58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69bb0aea-e59a-49fc-8049-c04a3dc8597c", "address": "fa:16:3e:25:25:81", "network": {"id": "2ee6c29c-3eb2-4ad9-8405-3c088bb6bf95", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-275444579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fdc21ff13d14516bf4b96c7b6fee216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69bb0aea-e5", "ovs_interfaceid": "69bb0aea-e59a-49fc-8049-c04a3dc8597c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:24:04 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Converting VIF {"id": "69bb0aea-e59a-49fc-8049-c04a3dc8597c", "address": "fa:16:3e:25:25:81", "network": {"id": "2ee6c29c-3eb2-4ad9-8405-3c088bb6bf95", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-275444579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fdc21ff13d14516bf4b96c7b6fee216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69bb0aea-e5", "ovs_interfaceid": "69bb0aea-e59a-49fc-8049-c04a3dc8597c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:24:04 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:25:81,bridge_name='br-int',has_traffic_filtering=True,id=69bb0aea-e59a-49fc-8049-c04a3dc8597c,network=Network(2ee6c29c-3eb2-4ad9-8405-3c088bb6bf95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69bb0aea-e5') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:24:04 user nova-compute[74247]: DEBUG nova.objects.instance [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Lazy-loading 'pci_devices' on Instance uuid 738eb591-f3dc-4392-b8f2-41530d30ff58 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:24:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.614s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:04 user nova-compute[74247]: DEBUG nova.compute.manager [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 18:24:04 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:24:04 user nova-compute[74247]:   <uuid>738eb591-f3dc-4392-b8f2-41530d30ff58</uuid>
Oct 16 18:24:04 user nova-compute[74247]:   <name>instance-00000003</name>
Oct 16 18:24:04 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:24:04 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:24:04 user nova-compute[74247]:   <metadata>
Oct 16 18:24:04 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:24:04 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:24:04 user nova-compute[74247]:       <nova:name>tempest-DeleteServersTestJSON-server-1043768477</nova:name>
Oct 16 18:24:04 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:24:03</nova:creationTime>
Oct 16 18:24:04 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:24:04 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:24:04 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:24:04 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:24:04 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:24:04 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:24:04 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:24:04 user nova-compute[74247]:       <nova:owner>
Oct 16 18:24:04 user nova-compute[74247]:         <nova:user uuid="179ec1d05cf849078826929622dbfc4c">tempest-DeleteServersTestJSON-910315946-project-member</nova:user>
Oct 16 18:24:04 user nova-compute[74247]:         <nova:project uuid="8fdc21ff13d14516bf4b96c7b6fee216">tempest-DeleteServersTestJSON-910315946</nova:project>
Oct 16 18:24:04 user nova-compute[74247]:       </nova:owner>
Oct 16 18:24:04 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:24:04 user nova-compute[74247]:       <nova:ports>
Oct 16 18:24:04 user nova-compute[74247]:         <nova:port uuid="69bb0aea-e59a-49fc-8049-c04a3dc8597c">
Oct 16 18:24:04 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 16 18:24:04 user nova-compute[74247]:         </nova:port>
Oct 16 18:24:04 user nova-compute[74247]:       </nova:ports>
Oct 16 18:24:04 user nova-compute[74247]:     </nova:instance>
Oct 16 18:24:04 user nova-compute[74247]:   </metadata>
Oct 16 18:24:04 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:24:04 user nova-compute[74247]:     <system>
Oct 16 18:24:04 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:24:04 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:24:04 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:24:04 user nova-compute[74247]:       <entry name="serial">738eb591-f3dc-4392-b8f2-41530d30ff58</entry>
Oct 16 18:24:04 user nova-compute[74247]:       <entry name="uuid">738eb591-f3dc-4392-b8f2-41530d30ff58</entry>
Oct 16 18:24:04 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:24:04 user nova-compute[74247]:     </system>
Oct 16 18:24:04 user nova-compute[74247]:   </sysinfo>
Oct 16 18:24:04 user nova-compute[74247]:   <os>
Oct 16 18:24:04 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:24:04 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:24:04 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:24:04 user nova-compute[74247]:   </os>
Oct 16 18:24:04 user nova-compute[74247]:   <features>
Oct 16 18:24:04 user nova-compute[74247]:     <acpi/>
Oct 16 18:24:04 user nova-compute[74247]:     <apic/>
Oct 16 18:24:04 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:24:04 user nova-compute[74247]:   </features>
Oct 16 18:24:04 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:24:04 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:24:04 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:24:04 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:24:04 user nova-compute[74247]:   </clock>
Oct 16 18:24:04 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:24:04 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:24:04 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:24:04 user nova-compute[74247]:   </cpu>
Oct 16 18:24:04 user nova-compute[74247]:   <devices>
Oct 16 18:24:04 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:24:04 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:24:04 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/738eb591-f3dc-4392-b8f2-41530d30ff58/disk"/>
Oct 16 18:24:04 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:24:04 user nova-compute[74247]:     </disk>
Oct 16 18:24:04 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:24:04 user nova-compute[74247]:       <mac address="fa:16:3e:25:25:81"/>
Oct 16 18:24:04 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:24:04 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:24:04 user nova-compute[74247]:       <target dev="tap69bb0aea-e5"/>
Oct 16 18:24:04 user nova-compute[74247]:     </interface>
Oct 16 18:24:04 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:24:04 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/738eb591-f3dc-4392-b8f2-41530d30ff58/console.log" append="off"/>
Oct 16 18:24:04 user nova-compute[74247]:     </serial>
Oct 16 18:24:04 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:24:04 user nova-compute[74247]:     <video>
Oct 16 18:24:04 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:24:04 user nova-compute[74247]:     </video>
Oct 16 18:24:04 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:24:04 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:24:04 user nova-compute[74247]:     </rng>
Oct 16 18:24:04 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:24:04 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:24:04 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:24:04 user nova-compute[74247]:     </memballoon>
Oct 16 18:24:04 user nova-compute[74247]:   </devices>
Oct 16 18:24:04 user nova-compute[74247]: </domain>
Oct 16 18:24:04 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:24:04 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:23:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1043768477',display_name='tempest-DeleteServersTestJSON-server-1043768477',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1043768477',id=3,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8fdc21ff13d14516bf4b96c7b6fee216',ramdisk_id='',reservation_id='r-st5pd0fz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-910315946',owner_user_name='tempest-DeleteServersTestJSON-910315946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:23:59Z,user_data=None,user_id='179ec1d05cf849078826929622dbfc4c',uuid=738eb591-f3dc-4392-b8f2-41530d30ff58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69bb0aea-e59a-49fc-8049-c04a3dc8597c", "address": "fa:16:3e:25:25:81", "network": {"id": "2ee6c29c-3eb2-4ad9-8405-3c088bb6bf95", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-275444579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fdc21ff13d14516bf4b96c7b6fee216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69bb0aea-e5", "ovs_interfaceid": "69bb0aea-e59a-49fc-8049-c04a3dc8597c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:24:04 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Converting VIF {"id": "69bb0aea-e59a-49fc-8049-c04a3dc8597c", "address": "fa:16:3e:25:25:81", "network": {"id": "2ee6c29c-3eb2-4ad9-8405-3c088bb6bf95", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-275444579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fdc21ff13d14516bf4b96c7b6fee216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69bb0aea-e5", "ovs_interfaceid": "69bb0aea-e59a-49fc-8049-c04a3dc8597c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:24:04 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:25:81,bridge_name='br-int',has_traffic_filtering=True,id=69bb0aea-e59a-49fc-8049-c04a3dc8597c,network=Network(2ee6c29c-3eb2-4ad9-8405-3c088bb6bf95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69bb0aea-e5') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:24:04 user nova-compute[74247]: DEBUG os_vif [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:25:81,bridge_name='br-int',has_traffic_filtering=True,id=69bb0aea-e59a-49fc-8049-c04a3dc8597c,network=Network(2ee6c29c-3eb2-4ad9-8405-3c088bb6bf95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69bb0aea-e5') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:24:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:24:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:24:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e3df2900-22e7-54bd-bb41-23d1c656a648', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:24:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:24:04 user nova-compute[74247]: DEBUG nova.compute.manager [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 18:24:04 user nova-compute[74247]: DEBUG nova.network.neutron [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 18:24:04 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 18:24:04 user nova-compute[74247]: DEBUG nova.compute.manager [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 18:24:04 user nova-compute[74247]: DEBUG nova.policy [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2b6734bfca1e4bf5b3c75d06eb471220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973c8310858e4e1dafbc2fa926995940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 18:24:04 user nova-compute[74247]: DEBUG nova.compute.manager [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 18:24:04 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:24:04 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Creating image(s)
Oct 16 18:24:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Acquiring lock "/opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lock "/opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lock "/opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.254s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Acquiring lock "37399febbd18f60b85fd0f833558f6a3539ab231" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.219s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk 1073741824 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:04 user nova-compute[74247]: DEBUG nova.network.neutron [req-6fe41a2e-7cf4-44ea-b52e-5f6c7dde3feb req-ae8615bd-af1b-4d78-9d57-4b42149fc896 service nova] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Updated VIF entry in instance network info cache for port f4db2672-7205-43d7-ac3b-3f6ea5c336c6. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:24:04 user nova-compute[74247]: DEBUG nova.network.neutron [req-6fe41a2e-7cf4-44ea-b52e-5f6c7dde3feb req-ae8615bd-af1b-4d78-9d57-4b42149fc896 service nova] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Updating instance_info_cache with network_info: [{"id": "f4db2672-7205-43d7-ac3b-3f6ea5c336c6", "address": "fa:16:3e:5f:52:2e", "network": {"id": "f99cbf0c-7d0c-4ef8-934a-aaac218e9381", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2096188408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94e9d0485eec462990dd029379397962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4db2672-72", "ovs_interfaceid": "f4db2672-7205-43d7-ac3b-3f6ea5c336c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:24:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk 1073741824" returned: 0 in 0.079s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-6fe41a2e-7cf4-44ea-b52e-5f6c7dde3feb req-ae8615bd-af1b-4d78-9d57-4b42149fc896 service nova] Releasing lock "refresh_cache-b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:24:05 user nova-compute[74247]: DEBUG nova.network.neutron [req-4be9f70c-c66a-418b-9c5f-c45acb34b921 req-9f24bca9-493d-4130-852b-abfdd7f3055d service nova] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Updated VIF entry in instance network info cache for port 69bb0aea-e59a-49fc-8049-c04a3dc8597c. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:24:05 user nova-compute[74247]: DEBUG nova.network.neutron [req-4be9f70c-c66a-418b-9c5f-c45acb34b921 req-9f24bca9-493d-4130-852b-abfdd7f3055d service nova] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Updating instance_info_cache with network_info: [{"id": "69bb0aea-e59a-49fc-8049-c04a3dc8597c", "address": "fa:16:3e:25:25:81", "network": {"id": "2ee6c29c-3eb2-4ad9-8405-3c088bb6bf95", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-275444579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fdc21ff13d14516bf4b96c7b6fee216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69bb0aea-e5", "ovs_interfaceid": "69bb0aea-e59a-49fc-8049-c04a3dc8597c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:24:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4be9f70c-c66a-418b-9c5f-c45acb34b921 req-9f24bca9-493d-4130-852b-abfdd7f3055d service nova] Releasing lock "refresh_cache-738eb591-f3dc-4392-b8f2-41530d30ff58" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:24:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.221s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:05 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk. size=1073741824 {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 18:24:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:05 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Cannot resize image /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk to a smaller size. {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 18:24:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 18:24:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Ensure instance console log exists: /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:24:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:05 user sudo[83554]: pam_unix(sudo:session): session closed for user root
Oct 16 18:24:05 user nova-compute[74247]: INFO oslo.privsep.daemon [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Spawned new privsep daemon via rootwrap
Oct 16 18:24:05 user nova-compute[74247]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 16 18:24:05 user nova-compute[74247]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 16 18:24:05 user nova-compute[74247]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Oct 16 18:24:05 user nova-compute[74247]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83575
Oct 16 18:24:05 user nova-compute[74247]: WARNING oslo_privsep.priv_context [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] privsep daemon already running
Oct 16 18:24:05 user nova-compute[74247]: WARNING oslo_privsep.priv_context [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] privsep daemon already running
Oct 16 18:24:05 user nova-compute[74247]: DEBUG nova.network.neutron [req-2279f165-bfa8-4a39-a28c-c1f67f67873a req-97edf0dc-18a3-45bd-a238-033abe68bcd8 service nova] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Updated VIF entry in instance network info cache for port 634511f9-ce96-4fe6-8bfc-51846e4dcb4f. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:24:05 user nova-compute[74247]: DEBUG nova.network.neutron [req-2279f165-bfa8-4a39-a28c-c1f67f67873a req-97edf0dc-18a3-45bd-a238-033abe68bcd8 service nova] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Updating instance_info_cache with network_info: [{"id": "634511f9-ce96-4fe6-8bfc-51846e4dcb4f", "address": "fa:16:3e:d2:d2:f4", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634511f9-ce", "ovs_interfaceid": "634511f9-ce96-4fe6-8bfc-51846e4dcb4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:24:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-2279f165-bfa8-4a39-a28c-c1f67f67873a req-97edf0dc-18a3-45bd-a238-033abe68bcd8 service nova] Releasing lock "refresh_cache-e37fbc27-3404-479a-be08-4d590391cf30" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:24:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69bb0aea-e5, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:24:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap69bb0aea-e5, col_values=(('qos', UUID('2053e99a-25d5-4606-8773-30cdc26f6a35')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:24:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap69bb0aea-e5, col_values=(('external_ids', {'iface-id': '69bb0aea-e59a-49fc-8049-c04a3dc8597c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:25:81', 'vm-uuid': '738eb591-f3dc-4392-b8f2-41530d30ff58'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:24:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:24:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:06 user nova-compute[74247]: INFO os_vif [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:25:81,bridge_name='br-int',has_traffic_filtering=True,id=69bb0aea-e59a-49fc-8049-c04a3dc8597c,network=Network(2ee6c29c-3eb2-4ad9-8405-3c088bb6bf95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69bb0aea-e5')
Oct 16 18:24:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4db2672-72, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:24:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf4db2672-72, col_values=(('qos', UUID('d61c5e63-ab79-4d57-83ee-47ed3065b8e7')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:24:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf4db2672-72, col_values=(('external_ids', {'iface-id': 'f4db2672-7205-43d7-ac3b-3f6ea5c336c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:52:2e', 'vm-uuid': 'b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:24:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:24:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:06 user nova-compute[74247]: INFO os_vif [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:52:2e,bridge_name='br-int',has_traffic_filtering=True,id=f4db2672-7205-43d7-ac3b-3f6ea5c336c6,network=Network(f99cbf0c-7d0c-4ef8-934a-aaac218e9381),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4db2672-72')
Oct 16 18:24:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap634511f9-ce, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:24:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap634511f9-ce, col_values=(('qos', UUID('b5a1f537-9f6e-4b38-b0b0-c25d4f42b1ad')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:24:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap634511f9-ce, col_values=(('external_ids', {'iface-id': '634511f9-ce96-4fe6-8bfc-51846e4dcb4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:d2:f4', 'vm-uuid': 'e37fbc27-3404-479a-be08-4d590391cf30'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:24:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:24:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:06 user nova-compute[74247]: INFO os_vif [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:d2:f4,bridge_name='br-int',has_traffic_filtering=True,id=634511f9-ce96-4fe6-8bfc-51846e4dcb4f,network=Network(0a61bae1-2607-4e42-b573-e74ac3edf09a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap634511f9-ce')
Oct 16 18:24:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:24:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] No VIF found with MAC fa:16:3e:25:25:81, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:24:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:24:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] No VIF found with MAC fa:16:3e:5f:52:2e, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:24:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:24:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] No VIF found with MAC fa:16:3e:d2:d2:f4, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:24:06 user nova-compute[74247]: DEBUG nova.network.neutron [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Successfully created port: 8cb168df-92d2-4ecc-946a-7d9075f75561 {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:24:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:08 user nova-compute[74247]: DEBUG nova.network.neutron [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Successfully updated port: 8cb168df-92d2-4ecc-946a-7d9075f75561 {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:24:08 user nova-compute[74247]: DEBUG nova.compute.manager [req-d40110a5-c881-4fcb-b34c-a2687dd97b59 req-8cee9f6c-6e81-4fa1-809f-ece0991bc940 service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] Received event network-changed-8cb168df-92d2-4ecc-946a-7d9075f75561 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:24:08 user nova-compute[74247]: DEBUG nova.compute.manager [req-d40110a5-c881-4fcb-b34c-a2687dd97b59 req-8cee9f6c-6e81-4fa1-809f-ece0991bc940 service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] Refreshing instance network info cache due to event network-changed-8cb168df-92d2-4ecc-946a-7d9075f75561. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:24:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d40110a5-c881-4fcb-b34c-a2687dd97b59 req-8cee9f6c-6e81-4fa1-809f-ece0991bc940 service nova] Acquiring lock "refresh_cache-a686ee86-272c-47be-8801-9c1500af272f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:24:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d40110a5-c881-4fcb-b34c-a2687dd97b59 req-8cee9f6c-6e81-4fa1-809f-ece0991bc940 service nova] Acquired lock "refresh_cache-a686ee86-272c-47be-8801-9c1500af272f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:24:08 user nova-compute[74247]: DEBUG nova.network.neutron [req-d40110a5-c881-4fcb-b34c-a2687dd97b59 req-8cee9f6c-6e81-4fa1-809f-ece0991bc940 service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] Refreshing network info cache for port 8cb168df-92d2-4ecc-946a-7d9075f75561 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:24:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Acquiring lock "refresh_cache-a686ee86-272c-47be-8801-9c1500af272f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:24:08 user nova-compute[74247]: DEBUG nova.network.neutron [req-d40110a5-c881-4fcb-b34c-a2687dd97b59 req-8cee9f6c-6e81-4fa1-809f-ece0991bc940 service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:24:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:09 user nova-compute[74247]: DEBUG nova.network.neutron [req-d40110a5-c881-4fcb-b34c-a2687dd97b59 req-8cee9f6c-6e81-4fa1-809f-ece0991bc940 service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:24:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d40110a5-c881-4fcb-b34c-a2687dd97b59 req-8cee9f6c-6e81-4fa1-809f-ece0991bc940 service nova] Releasing lock "refresh_cache-a686ee86-272c-47be-8801-9c1500af272f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:24:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Acquired lock "refresh_cache-a686ee86-272c-47be-8801-9c1500af272f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:24:09 user nova-compute[74247]: DEBUG nova.network.neutron [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:24:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:09 user nova-compute[74247]: DEBUG nova.network.neutron [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG nova.network.neutron [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Updating instance_info_cache with network_info: [{"id": "8cb168df-92d2-4ecc-946a-7d9075f75561", "address": "fa:16:3e:9d:bb:be", "network": {"id": "f12e9b98-2724-4b9c-a299-7286c163458c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1410604293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973c8310858e4e1dafbc2fa926995940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb168df-92", "ovs_interfaceid": "8cb168df-92d2-4ecc-946a-7d9075f75561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Releasing lock "refresh_cache-a686ee86-272c-47be-8801-9c1500af272f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG nova.compute.manager [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Instance network_info: |[{"id": "8cb168df-92d2-4ecc-946a-7d9075f75561", "address": "fa:16:3e:9d:bb:be", "network": {"id": "f12e9b98-2724-4b9c-a299-7286c163458c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1410604293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973c8310858e4e1dafbc2fa926995940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb168df-92", "ovs_interfaceid": "8cb168df-92d2-4ecc-946a-7d9075f75561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Start _get_guest_xml network_info=[{"id": "8cb168df-92d2-4ecc-946a-7d9075f75561", "address": "fa:16:3e:9d:bb:be", "network": {"id": "f12e9b98-2724-4b9c-a299-7286c163458c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1410604293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973c8310858e4e1dafbc2fa926995940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb168df-92", "ovs_interfaceid": "8cb168df-92d2-4ecc-946a-7d9075f75561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': '83126bb1-29f5-42fe-8620-72ab0797f776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:24:10 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:24:10 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:24:10 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:24:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-208936177',display_name='tempest-ServerActionsTestOtherB-server-208936177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-208936177',id=4,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIs9LtanBEbN6S6UJgwgQipMcrzgCgmqD+MSXO/I2jlCfUtIcGHYoW9tgqCxpGH6Qd6bb/kDDqj9dBay7WvsSTTn0A8mddCk4+U9BnAHzFohZU35eWuYV7ckMsEqil5fw==',key_name='tempest-keypair-447758938',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='973c8310858e4e1dafbc2fa926995940',ramdisk_id='',reservation_id='r-2wkxxe7p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-650770368',owner_user_name='tempest-ServerActionsTestOtherB-650770368-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:24:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b6734bfca1e4bf5b3c75d06eb471220',uuid=a686ee86-272c-47be-8801-9c1500af272f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8cb168df-92d2-4ecc-946a-7d9075f75561", "address": "fa:16:3e:9d:bb:be", "network": {"id": "f12e9b98-2724-4b9c-a299-7286c163458c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1410604293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973c8310858e4e1dafbc2fa926995940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb168df-92", "ovs_interfaceid": "8cb168df-92d2-4ecc-946a-7d9075f75561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Converting VIF {"id": "8cb168df-92d2-4ecc-946a-7d9075f75561", "address": "fa:16:3e:9d:bb:be", "network": {"id": "f12e9b98-2724-4b9c-a299-7286c163458c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1410604293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973c8310858e4e1dafbc2fa926995940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb168df-92", "ovs_interfaceid": "8cb168df-92d2-4ecc-946a-7d9075f75561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:bb:be,bridge_name='br-int',has_traffic_filtering=True,id=8cb168df-92d2-4ecc-946a-7d9075f75561,network=Network(f12e9b98-2724-4b9c-a299-7286c163458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb168df-92') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG nova.objects.instance [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lazy-loading 'pci_devices' on Instance uuid a686ee86-272c-47be-8801-9c1500af272f {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:24:10 user nova-compute[74247]:   <uuid>a686ee86-272c-47be-8801-9c1500af272f</uuid>
Oct 16 18:24:10 user nova-compute[74247]:   <name>instance-00000004</name>
Oct 16 18:24:10 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:24:10 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:24:10 user nova-compute[74247]:   <metadata>
Oct 16 18:24:10 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:24:10 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:24:10 user nova-compute[74247]:       <nova:name>tempest-ServerActionsTestOtherB-server-208936177</nova:name>
Oct 16 18:24:10 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:24:10</nova:creationTime>
Oct 16 18:24:10 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:24:10 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:24:10 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:24:10 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:24:10 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:24:10 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:24:10 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:24:10 user nova-compute[74247]:       <nova:owner>
Oct 16 18:24:10 user nova-compute[74247]:         <nova:user uuid="2b6734bfca1e4bf5b3c75d06eb471220">tempest-ServerActionsTestOtherB-650770368-project-member</nova:user>
Oct 16 18:24:10 user nova-compute[74247]:         <nova:project uuid="973c8310858e4e1dafbc2fa926995940">tempest-ServerActionsTestOtherB-650770368</nova:project>
Oct 16 18:24:10 user nova-compute[74247]:       </nova:owner>
Oct 16 18:24:10 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:24:10 user nova-compute[74247]:       <nova:ports>
Oct 16 18:24:10 user nova-compute[74247]:         <nova:port uuid="8cb168df-92d2-4ecc-946a-7d9075f75561">
Oct 16 18:24:10 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 16 18:24:10 user nova-compute[74247]:         </nova:port>
Oct 16 18:24:10 user nova-compute[74247]:       </nova:ports>
Oct 16 18:24:10 user nova-compute[74247]:     </nova:instance>
Oct 16 18:24:10 user nova-compute[74247]:   </metadata>
Oct 16 18:24:10 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:24:10 user nova-compute[74247]:     <system>
Oct 16 18:24:10 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:24:10 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:24:10 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:24:10 user nova-compute[74247]:       <entry name="serial">a686ee86-272c-47be-8801-9c1500af272f</entry>
Oct 16 18:24:10 user nova-compute[74247]:       <entry name="uuid">a686ee86-272c-47be-8801-9c1500af272f</entry>
Oct 16 18:24:10 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:24:10 user nova-compute[74247]:     </system>
Oct 16 18:24:10 user nova-compute[74247]:   </sysinfo>
Oct 16 18:24:10 user nova-compute[74247]:   <os>
Oct 16 18:24:10 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:24:10 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:24:10 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:24:10 user nova-compute[74247]:   </os>
Oct 16 18:24:10 user nova-compute[74247]:   <features>
Oct 16 18:24:10 user nova-compute[74247]:     <acpi/>
Oct 16 18:24:10 user nova-compute[74247]:     <apic/>
Oct 16 18:24:10 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:24:10 user nova-compute[74247]:   </features>
Oct 16 18:24:10 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:24:10 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:24:10 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:24:10 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:24:10 user nova-compute[74247]:   </clock>
Oct 16 18:24:10 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:24:10 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:24:10 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:24:10 user nova-compute[74247]:   </cpu>
Oct 16 18:24:10 user nova-compute[74247]:   <devices>
Oct 16 18:24:10 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:24:10 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:24:10 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk"/>
Oct 16 18:24:10 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:24:10 user nova-compute[74247]:     </disk>
Oct 16 18:24:10 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:24:10 user nova-compute[74247]:       <mac address="fa:16:3e:9d:bb:be"/>
Oct 16 18:24:10 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:24:10 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:24:10 user nova-compute[74247]:       <target dev="tap8cb168df-92"/>
Oct 16 18:24:10 user nova-compute[74247]:     </interface>
Oct 16 18:24:10 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:24:10 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/console.log" append="off"/>
Oct 16 18:24:10 user nova-compute[74247]:     </serial>
Oct 16 18:24:10 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:24:10 user nova-compute[74247]:     <video>
Oct 16 18:24:10 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:24:10 user nova-compute[74247]:     </video>
Oct 16 18:24:10 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:24:10 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:24:10 user nova-compute[74247]:     </rng>
Oct 16 18:24:10 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:24:10 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:24:10 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:24:10 user nova-compute[74247]:     </memballoon>
Oct 16 18:24:10 user nova-compute[74247]:   </devices>
Oct 16 18:24:10 user nova-compute[74247]: </domain>
Oct 16 18:24:10 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:24:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-208936177',display_name='tempest-ServerActionsTestOtherB-server-208936177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-208936177',id=4,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIs9LtanBEbN6S6UJgwgQipMcrzgCgmqD+MSXO/I2jlCfUtIcGHYoW9tgqCxpGH6Qd6bb/kDDqj9dBay7WvsSTTn0A8mddCk4+U9BnAHzFohZU35eWuYV7ckMsEqil5fw==',key_name='tempest-keypair-447758938',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='973c8310858e4e1dafbc2fa926995940',ramdisk_id='',reservation_id='r-2wkxxe7p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-650770368',owner_user_name='tempest-ServerActionsTestOtherB-650770368-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:24:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b6734bfca1e4bf5b3c75d06eb471220',uuid=a686ee86-272c-47be-8801-9c1500af272f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8cb168df-92d2-4ecc-946a-7d9075f75561", "address": "fa:16:3e:9d:bb:be", "network": {"id": "f12e9b98-2724-4b9c-a299-7286c163458c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1410604293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973c8310858e4e1dafbc2fa926995940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb168df-92", "ovs_interfaceid": "8cb168df-92d2-4ecc-946a-7d9075f75561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Converting VIF {"id": "8cb168df-92d2-4ecc-946a-7d9075f75561", "address": "fa:16:3e:9d:bb:be", "network": {"id": "f12e9b98-2724-4b9c-a299-7286c163458c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1410604293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973c8310858e4e1dafbc2fa926995940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb168df-92", "ovs_interfaceid": "8cb168df-92d2-4ecc-946a-7d9075f75561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:bb:be,bridge_name='br-int',has_traffic_filtering=True,id=8cb168df-92d2-4ecc-946a-7d9075f75561,network=Network(f12e9b98-2724-4b9c-a299-7286c163458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb168df-92') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG os_vif [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:bb:be,bridge_name='br-int',has_traffic_filtering=True,id=8cb168df-92d2-4ecc-946a-7d9075f75561,network=Network(f12e9b98-2724-4b9c-a299-7286c163458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb168df-92') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '22752197-763b-5756-87e8-d7d5bf2f7f5c', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8cb168df-92, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8cb168df-92, col_values=(('qos', UUID('515cc43f-3743-441a-b945-db47ed68a6c5')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8cb168df-92, col_values=(('external_ids', {'iface-id': '8cb168df-92d2-4ecc-946a-7d9075f75561', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:bb:be', 'vm-uuid': 'a686ee86-272c-47be-8801-9c1500af272f'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:10 user nova-compute[74247]: INFO os_vif [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:bb:be,bridge_name='br-int',has_traffic_filtering=True,id=8cb168df-92d2-4ecc-946a-7d9075f75561,network=Network(f12e9b98-2724-4b9c-a299-7286c163458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb168df-92')
Oct 16 18:24:10 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:24:10 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] No VIF found with MAC fa:16:3e:9d:bb:be, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:24:12 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:12 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:12 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:13 user nova-compute[74247]: DEBUG nova.compute.manager [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:24:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:24:13 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Instance spawned successfully.
Oct 16 18:24:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 18:24:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:13 user nova-compute[74247]: DEBUG nova.compute.manager [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:24:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:24:13 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Instance spawned successfully.
Oct 16 18:24:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 18:24:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:13 user nova-compute[74247]: INFO nova.compute.manager [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Took 14.78 seconds to spawn the instance on the hypervisor.
Oct 16 18:24:13 user nova-compute[74247]: DEBUG nova.compute.manager [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:24:14 user nova-compute[74247]: INFO nova.compute.manager [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Took 17.45 seconds to spawn the instance on the hypervisor.
Oct 16 18:24:14 user nova-compute[74247]: DEBUG nova.compute.manager [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:24:14 user nova-compute[74247]: DEBUG nova.compute.manager [req-090d7b5e-468b-4303-8170-169b93007d56 req-7cdd8cbc-208f-4d7b-9540-90cae73f2038 service nova] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Received event network-vif-plugged-69bb0aea-e59a-49fc-8049-c04a3dc8597c {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:24:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-090d7b5e-468b-4303-8170-169b93007d56 req-7cdd8cbc-208f-4d7b-9540-90cae73f2038 service nova] Acquiring lock "738eb591-f3dc-4392-b8f2-41530d30ff58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-090d7b5e-468b-4303-8170-169b93007d56 req-7cdd8cbc-208f-4d7b-9540-90cae73f2038 service nova] Lock "738eb591-f3dc-4392-b8f2-41530d30ff58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-090d7b5e-468b-4303-8170-169b93007d56 req-7cdd8cbc-208f-4d7b-9540-90cae73f2038 service nova] Lock "738eb591-f3dc-4392-b8f2-41530d30ff58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:14 user nova-compute[74247]: DEBUG nova.compute.manager [req-090d7b5e-468b-4303-8170-169b93007d56 req-7cdd8cbc-208f-4d7b-9540-90cae73f2038 service nova] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] No waiting events found dispatching network-vif-plugged-69bb0aea-e59a-49fc-8049-c04a3dc8597c {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:24:14 user nova-compute[74247]: WARNING nova.compute.manager [req-090d7b5e-468b-4303-8170-169b93007d56 req-7cdd8cbc-208f-4d7b-9540-90cae73f2038 service nova] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Received unexpected event network-vif-plugged-69bb0aea-e59a-49fc-8049-c04a3dc8597c for instance with vm_state building and task_state spawning.
Oct 16 18:24:14 user nova-compute[74247]: INFO nova.compute.manager [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Took 15.90 seconds to build instance.
Oct 16 18:24:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ce76eef6-af76-468f-a6e1-d93c0e221169 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Lock "738eb591-f3dc-4392-b8f2-41530d30ff58" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.095s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:14 user nova-compute[74247]: INFO nova.compute.manager [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Took 18.83 seconds to build instance.
Oct 16 18:24:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-b3a60398-5615-461b-88dd-1d79e03d48e9 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Lock "b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.110s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:14 user nova-compute[74247]: DEBUG nova.compute.manager [req-96ac3524-4107-4822-a7bf-3cb213cfc059 req-62a39444-c05a-42f2-811a-288153fc63a4 service nova] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Received event network-vif-plugged-f4db2672-7205-43d7-ac3b-3f6ea5c336c6 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:24:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-96ac3524-4107-4822-a7bf-3cb213cfc059 req-62a39444-c05a-42f2-811a-288153fc63a4 service nova] Acquiring lock "b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-96ac3524-4107-4822-a7bf-3cb213cfc059 req-62a39444-c05a-42f2-811a-288153fc63a4 service nova] Lock "b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-96ac3524-4107-4822-a7bf-3cb213cfc059 req-62a39444-c05a-42f2-811a-288153fc63a4 service nova] Lock "b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:14 user nova-compute[74247]: DEBUG nova.compute.manager [req-96ac3524-4107-4822-a7bf-3cb213cfc059 req-62a39444-c05a-42f2-811a-288153fc63a4 service nova] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] No waiting events found dispatching network-vif-plugged-f4db2672-7205-43d7-ac3b-3f6ea5c336c6 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:24:14 user nova-compute[74247]: WARNING nova.compute.manager [req-96ac3524-4107-4822-a7bf-3cb213cfc059 req-62a39444-c05a-42f2-811a-288153fc63a4 service nova] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Received unexpected event network-vif-plugged-f4db2672-7205-43d7-ac3b-3f6ea5c336c6 for instance with vm_state active and task_state None.
Oct 16 18:24:14 user nova-compute[74247]: DEBUG nova.compute.manager [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:24:14 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:24:14 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Instance spawned successfully.
Oct 16 18:24:14 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 18:24:14 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:14 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:14 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:14 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:14 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:14 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:14 user nova-compute[74247]: INFO nova.compute.manager [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Took 17.43 seconds to spawn the instance on the hypervisor.
Oct 16 18:24:14 user nova-compute[74247]: DEBUG nova.compute.manager [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:24:14 user nova-compute[74247]: INFO nova.compute.manager [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Took 18.71 seconds to build instance.
Oct 16 18:24:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-447efe3c-5000-4102-911f-4718a7b66250 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "e37fbc27-3404-479a-be08-4d590391cf30" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.889s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Acquiring lock "4daa6370-2cdf-4668-b66b-e10196377c9c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lock "4daa6370-2cdf-4668-b66b-e10196377c9c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:15 user nova-compute[74247]: DEBUG nova.compute.manager [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 18:24:15 user nova-compute[74247]: DEBUG nova.compute.manager [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:24:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:24:15 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: a686ee86-272c-47be-8801-9c1500af272f] Instance spawned successfully.
Oct 16 18:24:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 18:24:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:15 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:24:15 user nova-compute[74247]: INFO nova.compute.claims [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Claim successful on node user
Oct 16 18:24:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:15 user nova-compute[74247]: INFO nova.compute.manager [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Took 11.38 seconds to spawn the instance on the hypervisor.
Oct 16 18:24:15 user nova-compute[74247]: DEBUG nova.compute.manager [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:24:16 user nova-compute[74247]: INFO nova.compute.manager [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Took 12.60 seconds to build instance.
Oct 16 18:24:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1a9b3cab-43c9-4ecb-a43e-e7902965b542 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lock "a686ee86-272c-47be-8801-9c1500af272f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.859s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:16 user nova-compute[74247]: DEBUG nova.compute.manager [req-a5a1d561-0389-49fb-b346-c6886b46dc3f req-5197c16f-9ea3-42ab-8160-48234da31ce8 service nova] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Received event network-vif-plugged-69bb0aea-e59a-49fc-8049-c04a3dc8597c {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:24:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a5a1d561-0389-49fb-b346-c6886b46dc3f req-5197c16f-9ea3-42ab-8160-48234da31ce8 service nova] Acquiring lock "738eb591-f3dc-4392-b8f2-41530d30ff58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a5a1d561-0389-49fb-b346-c6886b46dc3f req-5197c16f-9ea3-42ab-8160-48234da31ce8 service nova] Lock "738eb591-f3dc-4392-b8f2-41530d30ff58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a5a1d561-0389-49fb-b346-c6886b46dc3f req-5197c16f-9ea3-42ab-8160-48234da31ce8 service nova] Lock "738eb591-f3dc-4392-b8f2-41530d30ff58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:16 user nova-compute[74247]: DEBUG nova.compute.manager [req-a5a1d561-0389-49fb-b346-c6886b46dc3f req-5197c16f-9ea3-42ab-8160-48234da31ce8 service nova] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] No waiting events found dispatching network-vif-plugged-69bb0aea-e59a-49fc-8049-c04a3dc8597c {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:24:16 user nova-compute[74247]: WARNING nova.compute.manager [req-a5a1d561-0389-49fb-b346-c6886b46dc3f req-5197c16f-9ea3-42ab-8160-48234da31ce8 service nova] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Received unexpected event network-vif-plugged-69bb0aea-e59a-49fc-8049-c04a3dc8597c for instance with vm_state active and task_state None.
Oct 16 18:24:16 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:24:16 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:24:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.770s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:16 user nova-compute[74247]: DEBUG nova.compute.manager [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 18:24:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:16 user nova-compute[74247]: DEBUG nova.compute.manager [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 18:24:16 user nova-compute[74247]: DEBUG nova.network.neutron [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 18:24:16 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 18:24:16 user nova-compute[74247]: DEBUG nova.compute.manager [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 18:24:16 user nova-compute[74247]: DEBUG nova.compute.manager [req-f04131f5-f903-4f59-8c91-300f167172f0 req-4639e85e-86a1-42e8-b917-110e975577ac service nova] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Received event network-vif-plugged-f4db2672-7205-43d7-ac3b-3f6ea5c336c6 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:24:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f04131f5-f903-4f59-8c91-300f167172f0 req-4639e85e-86a1-42e8-b917-110e975577ac service nova] Acquiring lock "b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f04131f5-f903-4f59-8c91-300f167172f0 req-4639e85e-86a1-42e8-b917-110e975577ac service nova] Lock "b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f04131f5-f903-4f59-8c91-300f167172f0 req-4639e85e-86a1-42e8-b917-110e975577ac service nova] Lock "b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:16 user nova-compute[74247]: DEBUG nova.compute.manager [req-f04131f5-f903-4f59-8c91-300f167172f0 req-4639e85e-86a1-42e8-b917-110e975577ac service nova] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] No waiting events found dispatching network-vif-plugged-f4db2672-7205-43d7-ac3b-3f6ea5c336c6 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:24:16 user nova-compute[74247]: WARNING nova.compute.manager [req-f04131f5-f903-4f59-8c91-300f167172f0 req-4639e85e-86a1-42e8-b917-110e975577ac service nova] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Received unexpected event network-vif-plugged-f4db2672-7205-43d7-ac3b-3f6ea5c336c6 for instance with vm_state active and task_state None.
Oct 16 18:24:16 user nova-compute[74247]: DEBUG nova.compute.manager [req-f04131f5-f903-4f59-8c91-300f167172f0 req-4639e85e-86a1-42e8-b917-110e975577ac service nova] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Received event network-vif-plugged-634511f9-ce96-4fe6-8bfc-51846e4dcb4f {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:24:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f04131f5-f903-4f59-8c91-300f167172f0 req-4639e85e-86a1-42e8-b917-110e975577ac service nova] Acquiring lock "e37fbc27-3404-479a-be08-4d590391cf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f04131f5-f903-4f59-8c91-300f167172f0 req-4639e85e-86a1-42e8-b917-110e975577ac service nova] Lock "e37fbc27-3404-479a-be08-4d590391cf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f04131f5-f903-4f59-8c91-300f167172f0 req-4639e85e-86a1-42e8-b917-110e975577ac service nova] Lock "e37fbc27-3404-479a-be08-4d590391cf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:16 user nova-compute[74247]: DEBUG nova.compute.manager [req-f04131f5-f903-4f59-8c91-300f167172f0 req-4639e85e-86a1-42e8-b917-110e975577ac service nova] [instance: e37fbc27-3404-479a-be08-4d590391cf30] No waiting events found dispatching network-vif-plugged-634511f9-ce96-4fe6-8bfc-51846e4dcb4f {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:24:16 user nova-compute[74247]: WARNING nova.compute.manager [req-f04131f5-f903-4f59-8c91-300f167172f0 req-4639e85e-86a1-42e8-b917-110e975577ac service nova] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Received unexpected event network-vif-plugged-634511f9-ce96-4fe6-8bfc-51846e4dcb4f for instance with vm_state active and task_state None.
Oct 16 18:24:16 user nova-compute[74247]: DEBUG nova.compute.manager [req-f04131f5-f903-4f59-8c91-300f167172f0 req-4639e85e-86a1-42e8-b917-110e975577ac service nova] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Received event network-vif-plugged-634511f9-ce96-4fe6-8bfc-51846e4dcb4f {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:24:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f04131f5-f903-4f59-8c91-300f167172f0 req-4639e85e-86a1-42e8-b917-110e975577ac service nova] Acquiring lock "e37fbc27-3404-479a-be08-4d590391cf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f04131f5-f903-4f59-8c91-300f167172f0 req-4639e85e-86a1-42e8-b917-110e975577ac service nova] Lock "e37fbc27-3404-479a-be08-4d590391cf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f04131f5-f903-4f59-8c91-300f167172f0 req-4639e85e-86a1-42e8-b917-110e975577ac service nova] Lock "e37fbc27-3404-479a-be08-4d590391cf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:16 user nova-compute[74247]: DEBUG nova.compute.manager [req-f04131f5-f903-4f59-8c91-300f167172f0 req-4639e85e-86a1-42e8-b917-110e975577ac service nova] [instance: e37fbc27-3404-479a-be08-4d590391cf30] No waiting events found dispatching network-vif-plugged-634511f9-ce96-4fe6-8bfc-51846e4dcb4f {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:24:16 user nova-compute[74247]: WARNING nova.compute.manager [req-f04131f5-f903-4f59-8c91-300f167172f0 req-4639e85e-86a1-42e8-b917-110e975577ac service nova] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Received unexpected event network-vif-plugged-634511f9-ce96-4fe6-8bfc-51846e4dcb4f for instance with vm_state active and task_state None.
Oct 16 18:24:16 user nova-compute[74247]: DEBUG nova.compute.manager [req-f04131f5-f903-4f59-8c91-300f167172f0 req-4639e85e-86a1-42e8-b917-110e975577ac service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] Received event network-vif-plugged-8cb168df-92d2-4ecc-946a-7d9075f75561 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:24:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f04131f5-f903-4f59-8c91-300f167172f0 req-4639e85e-86a1-42e8-b917-110e975577ac service nova] Acquiring lock "a686ee86-272c-47be-8801-9c1500af272f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f04131f5-f903-4f59-8c91-300f167172f0 req-4639e85e-86a1-42e8-b917-110e975577ac service nova] Lock "a686ee86-272c-47be-8801-9c1500af272f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f04131f5-f903-4f59-8c91-300f167172f0 req-4639e85e-86a1-42e8-b917-110e975577ac service nova] Lock "a686ee86-272c-47be-8801-9c1500af272f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:16 user nova-compute[74247]: DEBUG nova.compute.manager [req-f04131f5-f903-4f59-8c91-300f167172f0 req-4639e85e-86a1-42e8-b917-110e975577ac service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] No waiting events found dispatching network-vif-plugged-8cb168df-92d2-4ecc-946a-7d9075f75561 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:24:16 user nova-compute[74247]: WARNING nova.compute.manager [req-f04131f5-f903-4f59-8c91-300f167172f0 req-4639e85e-86a1-42e8-b917-110e975577ac service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] Received unexpected event network-vif-plugged-8cb168df-92d2-4ecc-946a-7d9075f75561 for instance with vm_state active and task_state None.
Oct 16 18:24:16 user nova-compute[74247]: DEBUG nova.compute.manager [req-f04131f5-f903-4f59-8c91-300f167172f0 req-4639e85e-86a1-42e8-b917-110e975577ac service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] Received event network-vif-plugged-8cb168df-92d2-4ecc-946a-7d9075f75561 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:24:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f04131f5-f903-4f59-8c91-300f167172f0 req-4639e85e-86a1-42e8-b917-110e975577ac service nova] Acquiring lock "a686ee86-272c-47be-8801-9c1500af272f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f04131f5-f903-4f59-8c91-300f167172f0 req-4639e85e-86a1-42e8-b917-110e975577ac service nova] Lock "a686ee86-272c-47be-8801-9c1500af272f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f04131f5-f903-4f59-8c91-300f167172f0 req-4639e85e-86a1-42e8-b917-110e975577ac service nova] Lock "a686ee86-272c-47be-8801-9c1500af272f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:16 user nova-compute[74247]: DEBUG nova.compute.manager [req-f04131f5-f903-4f59-8c91-300f167172f0 req-4639e85e-86a1-42e8-b917-110e975577ac service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] No waiting events found dispatching network-vif-plugged-8cb168df-92d2-4ecc-946a-7d9075f75561 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:24:16 user nova-compute[74247]: WARNING nova.compute.manager [req-f04131f5-f903-4f59-8c91-300f167172f0 req-4639e85e-86a1-42e8-b917-110e975577ac service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] Received unexpected event network-vif-plugged-8cb168df-92d2-4ecc-946a-7d9075f75561 for instance with vm_state active and task_state None.
Oct 16 18:24:16 user nova-compute[74247]: DEBUG nova.policy [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc992e02d7424d11b144101559cbc8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42df518506b24ac5bedd9d75b15fa9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 18:24:16 user nova-compute[74247]: DEBUG nova.compute.manager [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 18:24:16 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:24:16 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Creating image(s)
Oct 16 18:24:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Acquiring lock "/opt/stack/data/nova/instances/4daa6370-2cdf-4668-b66b-e10196377c9c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lock "/opt/stack/data/nova/instances/4daa6370-2cdf-4668-b66b-e10196377c9c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lock "/opt/stack/data/nova/instances/4daa6370-2cdf-4668-b66b-e10196377c9c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.255s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Acquiring lock "37399febbd18f60b85fd0f833558f6a3539ab231" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.336s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/4daa6370-2cdf-4668-b66b-e10196377c9c/disk 1073741824 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/4daa6370-2cdf-4668-b66b-e10196377c9c/disk 1073741824" returned: 0 in 0.094s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.446s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:17 user nova-compute[74247]: DEBUG nova.network.neutron [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Successfully created port: 4d30f22d-4337-41a7-965d-f9c172049b00 {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:24:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.350s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:17 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4daa6370-2cdf-4668-b66b-e10196377c9c/disk. size=1073741824 {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 18:24:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4daa6370-2cdf-4668-b66b-e10196377c9c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4daa6370-2cdf-4668-b66b-e10196377c9c/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:18 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Cannot resize image /opt/stack/data/nova/instances/4daa6370-2cdf-4668-b66b-e10196377c9c/disk to a smaller size. {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 18:24:18 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 18:24:18 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Ensure instance console log exists: /opt/stack/data/nova/instances/4daa6370-2cdf-4668-b66b-e10196377c9c/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:24:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:18 user nova-compute[74247]: DEBUG nova.network.neutron [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Successfully updated port: 4d30f22d-4337-41a7-965d-f9c172049b00 {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Acquiring lock "refresh_cache-4daa6370-2cdf-4668-b66b-e10196377c9c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Acquired lock "refresh_cache-4daa6370-2cdf-4668-b66b-e10196377c9c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG nova.network.neutron [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG nova.compute.manager [req-c3bb8f7e-e9e4-4300-ae70-6497fbe37a7a req-2e1aaa97-79fa-498f-9ad4-04fbf02aeafe service nova] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Received event network-changed-4d30f22d-4337-41a7-965d-f9c172049b00 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG nova.compute.manager [req-c3bb8f7e-e9e4-4300-ae70-6497fbe37a7a req-2e1aaa97-79fa-498f-9ad4-04fbf02aeafe service nova] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Refreshing instance network info cache due to event network-changed-4d30f22d-4337-41a7-965d-f9c172049b00. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c3bb8f7e-e9e4-4300-ae70-6497fbe37a7a req-2e1aaa97-79fa-498f-9ad4-04fbf02aeafe service nova] Acquiring lock "refresh_cache-4daa6370-2cdf-4668-b66b-e10196377c9c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG nova.network.neutron [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG nova.network.neutron [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Updating instance_info_cache with network_info: [{"id": "4d30f22d-4337-41a7-965d-f9c172049b00", "address": "fa:16:3e:5c:05:1d", "network": {"id": "8451dc81-ded8-462e-a394-f5cd774f684b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1470365086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42df518506b24ac5bedd9d75b15fa9b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d30f22d-43", "ovs_interfaceid": "4d30f22d-4337-41a7-965d-f9c172049b00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Releasing lock "refresh_cache-4daa6370-2cdf-4668-b66b-e10196377c9c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG nova.compute.manager [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Instance network_info: |[{"id": "4d30f22d-4337-41a7-965d-f9c172049b00", "address": "fa:16:3e:5c:05:1d", "network": {"id": "8451dc81-ded8-462e-a394-f5cd774f684b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1470365086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42df518506b24ac5bedd9d75b15fa9b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d30f22d-43", "ovs_interfaceid": "4d30f22d-4337-41a7-965d-f9c172049b00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c3bb8f7e-e9e4-4300-ae70-6497fbe37a7a req-2e1aaa97-79fa-498f-9ad4-04fbf02aeafe service nova] Acquired lock "refresh_cache-4daa6370-2cdf-4668-b66b-e10196377c9c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG nova.network.neutron [req-c3bb8f7e-e9e4-4300-ae70-6497fbe37a7a req-2e1aaa97-79fa-498f-9ad4-04fbf02aeafe service nova] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Refreshing network info cache for port 4d30f22d-4337-41a7-965d-f9c172049b00 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Start _get_guest_xml network_info=[{"id": "4d30f22d-4337-41a7-965d-f9c172049b00", "address": "fa:16:3e:5c:05:1d", "network": {"id": "8451dc81-ded8-462e-a394-f5cd774f684b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1470365086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42df518506b24ac5bedd9d75b15fa9b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d30f22d-43", "ovs_interfaceid": "4d30f22d-4337-41a7-965d-f9c172049b00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': '83126bb1-29f5-42fe-8620-72ab0797f776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:24:19 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:24:19 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:24:19 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:24:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-528949113',display_name='tempest-VolumesAdminNegativeTest-server-528949113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-528949113',id=5,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnWj0kTccSUuG+Cod4Y8YciINAbiWWLzLSpl9VvH4EWQajwqUGJNtystAW7W9SNQlfXx+5kVtmecquwGCWqZ3WtKSe65ztNfV8zzS2HR27pPWFgZ/8Z1HFKpUZWuxrdwQ==',key_name='tempest-keypair-1517866332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42df518506b24ac5bedd9d75b15fa9b7',ramdisk_id='',reservation_id='r-90ke86el',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1972822081',owner_user_name='tempest-VolumesAdminNegativeTest-1972822081-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:24:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc992e02d7424d11b144101559cbc8ef',uuid=4daa6370-2cdf-4668-b66b-e10196377c9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d30f22d-4337-41a7-965d-f9c172049b00", "address": "fa:16:3e:5c:05:1d", "network": {"id": "8451dc81-ded8-462e-a394-f5cd774f684b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1470365086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42df518506b24ac5bedd9d75b15fa9b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d30f22d-43", "ovs_interfaceid": "4d30f22d-4337-41a7-965d-f9c172049b00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Converting VIF {"id": "4d30f22d-4337-41a7-965d-f9c172049b00", "address": "fa:16:3e:5c:05:1d", "network": {"id": "8451dc81-ded8-462e-a394-f5cd774f684b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1470365086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42df518506b24ac5bedd9d75b15fa9b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d30f22d-43", "ovs_interfaceid": "4d30f22d-4337-41a7-965d-f9c172049b00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:05:1d,bridge_name='br-int',has_traffic_filtering=True,id=4d30f22d-4337-41a7-965d-f9c172049b00,network=Network(8451dc81-ded8-462e-a394-f5cd774f684b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d30f22d-43') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG nova.objects.instance [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lazy-loading 'pci_devices' on Instance uuid 4daa6370-2cdf-4668-b66b-e10196377c9c {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:24:19 user nova-compute[74247]:   <uuid>4daa6370-2cdf-4668-b66b-e10196377c9c</uuid>
Oct 16 18:24:19 user nova-compute[74247]:   <name>instance-00000005</name>
Oct 16 18:24:19 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:24:19 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:24:19 user nova-compute[74247]:   <metadata>
Oct 16 18:24:19 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:24:19 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:24:19 user nova-compute[74247]:       <nova:name>tempest-VolumesAdminNegativeTest-server-528949113</nova:name>
Oct 16 18:24:19 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:24:19</nova:creationTime>
Oct 16 18:24:19 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:24:19 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:24:19 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:24:19 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:24:19 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:24:19 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:24:19 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:24:19 user nova-compute[74247]:       <nova:owner>
Oct 16 18:24:19 user nova-compute[74247]:         <nova:user uuid="fc992e02d7424d11b144101559cbc8ef">tempest-VolumesAdminNegativeTest-1972822081-project-member</nova:user>
Oct 16 18:24:19 user nova-compute[74247]:         <nova:project uuid="42df518506b24ac5bedd9d75b15fa9b7">tempest-VolumesAdminNegativeTest-1972822081</nova:project>
Oct 16 18:24:19 user nova-compute[74247]:       </nova:owner>
Oct 16 18:24:19 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:24:19 user nova-compute[74247]:       <nova:ports>
Oct 16 18:24:19 user nova-compute[74247]:         <nova:port uuid="4d30f22d-4337-41a7-965d-f9c172049b00">
Oct 16 18:24:19 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 16 18:24:19 user nova-compute[74247]:         </nova:port>
Oct 16 18:24:19 user nova-compute[74247]:       </nova:ports>
Oct 16 18:24:19 user nova-compute[74247]:     </nova:instance>
Oct 16 18:24:19 user nova-compute[74247]:   </metadata>
Oct 16 18:24:19 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:24:19 user nova-compute[74247]:     <system>
Oct 16 18:24:19 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:24:19 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:24:19 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:24:19 user nova-compute[74247]:       <entry name="serial">4daa6370-2cdf-4668-b66b-e10196377c9c</entry>
Oct 16 18:24:19 user nova-compute[74247]:       <entry name="uuid">4daa6370-2cdf-4668-b66b-e10196377c9c</entry>
Oct 16 18:24:19 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:24:19 user nova-compute[74247]:     </system>
Oct 16 18:24:19 user nova-compute[74247]:   </sysinfo>
Oct 16 18:24:19 user nova-compute[74247]:   <os>
Oct 16 18:24:19 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:24:19 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:24:19 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:24:19 user nova-compute[74247]:   </os>
Oct 16 18:24:19 user nova-compute[74247]:   <features>
Oct 16 18:24:19 user nova-compute[74247]:     <acpi/>
Oct 16 18:24:19 user nova-compute[74247]:     <apic/>
Oct 16 18:24:19 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:24:19 user nova-compute[74247]:   </features>
Oct 16 18:24:19 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:24:19 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:24:19 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:24:19 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:24:19 user nova-compute[74247]:   </clock>
Oct 16 18:24:19 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:24:19 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:24:19 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:24:19 user nova-compute[74247]:   </cpu>
Oct 16 18:24:19 user nova-compute[74247]:   <devices>
Oct 16 18:24:19 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:24:19 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:24:19 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/4daa6370-2cdf-4668-b66b-e10196377c9c/disk"/>
Oct 16 18:24:19 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:24:19 user nova-compute[74247]:     </disk>
Oct 16 18:24:19 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:24:19 user nova-compute[74247]:       <mac address="fa:16:3e:5c:05:1d"/>
Oct 16 18:24:19 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:24:19 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:24:19 user nova-compute[74247]:       <target dev="tap4d30f22d-43"/>
Oct 16 18:24:19 user nova-compute[74247]:     </interface>
Oct 16 18:24:19 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:24:19 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/4daa6370-2cdf-4668-b66b-e10196377c9c/console.log" append="off"/>
Oct 16 18:24:19 user nova-compute[74247]:     </serial>
Oct 16 18:24:19 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:24:19 user nova-compute[74247]:     <video>
Oct 16 18:24:19 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:24:19 user nova-compute[74247]:     </video>
Oct 16 18:24:19 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:24:19 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:24:19 user nova-compute[74247]:     </rng>
Oct 16 18:24:19 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:24:19 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:24:19 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:24:19 user nova-compute[74247]:     </memballoon>
Oct 16 18:24:19 user nova-compute[74247]:   </devices>
Oct 16 18:24:19 user nova-compute[74247]: </domain>
Oct 16 18:24:19 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:24:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-528949113',display_name='tempest-VolumesAdminNegativeTest-server-528949113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-528949113',id=5,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnWj0kTccSUuG+Cod4Y8YciINAbiWWLzLSpl9VvH4EWQajwqUGJNtystAW7W9SNQlfXx+5kVtmecquwGCWqZ3WtKSe65ztNfV8zzS2HR27pPWFgZ/8Z1HFKpUZWuxrdwQ==',key_name='tempest-keypair-1517866332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42df518506b24ac5bedd9d75b15fa9b7',ramdisk_id='',reservation_id='r-90ke86el',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1972822081',owner_user_name='tempest-VolumesAdminNegativeTest-1972822081-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:24:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc992e02d7424d11b144101559cbc8ef',uuid=4daa6370-2cdf-4668-b66b-e10196377c9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d30f22d-4337-41a7-965d-f9c172049b00", "address": "fa:16:3e:5c:05:1d", "network": {"id": "8451dc81-ded8-462e-a394-f5cd774f684b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1470365086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42df518506b24ac5bedd9d75b15fa9b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d30f22d-43", "ovs_interfaceid": "4d30f22d-4337-41a7-965d-f9c172049b00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Converting VIF {"id": "4d30f22d-4337-41a7-965d-f9c172049b00", "address": "fa:16:3e:5c:05:1d", "network": {"id": "8451dc81-ded8-462e-a394-f5cd774f684b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1470365086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42df518506b24ac5bedd9d75b15fa9b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d30f22d-43", "ovs_interfaceid": "4d30f22d-4337-41a7-965d-f9c172049b00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:05:1d,bridge_name='br-int',has_traffic_filtering=True,id=4d30f22d-4337-41a7-965d-f9c172049b00,network=Network(8451dc81-ded8-462e-a394-f5cd774f684b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d30f22d-43') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG os_vif [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:05:1d,bridge_name='br-int',has_traffic_filtering=True,id=4d30f22d-4337-41a7-965d-f9c172049b00,network=Network(8451dc81-ded8-462e-a394-f5cd774f684b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d30f22d-43') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd3b22298-4e32-5595-ad3c-2987179ad9be', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d30f22d-43, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4d30f22d-43, col_values=(('qos', UUID('d70751d1-1d39-4c47-9b4a-bc049a19ca88')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4d30f22d-43, col_values=(('external_ids', {'iface-id': '4d30f22d-4337-41a7-965d-f9c172049b00', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:05:1d', 'vm-uuid': '4daa6370-2cdf-4668-b66b-e10196377c9c'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:19 user nova-compute[74247]: INFO os_vif [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:05:1d,bridge_name='br-int',has_traffic_filtering=True,id=4d30f22d-4337-41a7-965d-f9c172049b00,network=Network(8451dc81-ded8-462e-a394-f5cd774f684b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d30f22d-43')
Oct 16 18:24:19 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:24:19 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] No VIF found with MAC fa:16:3e:5c:05:1d, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:24:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:20 user nova-compute[74247]: DEBUG nova.network.neutron [req-c3bb8f7e-e9e4-4300-ae70-6497fbe37a7a req-2e1aaa97-79fa-498f-9ad4-04fbf02aeafe service nova] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Updated VIF entry in instance network info cache for port 4d30f22d-4337-41a7-965d-f9c172049b00. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:24:20 user nova-compute[74247]: DEBUG nova.network.neutron [req-c3bb8f7e-e9e4-4300-ae70-6497fbe37a7a req-2e1aaa97-79fa-498f-9ad4-04fbf02aeafe service nova] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Updating instance_info_cache with network_info: [{"id": "4d30f22d-4337-41a7-965d-f9c172049b00", "address": "fa:16:3e:5c:05:1d", "network": {"id": "8451dc81-ded8-462e-a394-f5cd774f684b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1470365086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42df518506b24ac5bedd9d75b15fa9b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d30f22d-43", "ovs_interfaceid": "4d30f22d-4337-41a7-965d-f9c172049b00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:24:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c3bb8f7e-e9e4-4300-ae70-6497fbe37a7a req-2e1aaa97-79fa-498f-9ad4-04fbf02aeafe service nova] Releasing lock "refresh_cache-4daa6370-2cdf-4668-b66b-e10196377c9c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:24:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:22 user nova-compute[74247]: DEBUG nova.compute.manager [req-2cd80b92-395b-442d-b4f5-224018af9de4 req-5ba15384-c507-4ec0-b2d8-093aa1b4028f service nova] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Received event network-vif-plugged-4d30f22d-4337-41a7-965d-f9c172049b00 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:24:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-2cd80b92-395b-442d-b4f5-224018af9de4 req-5ba15384-c507-4ec0-b2d8-093aa1b4028f service nova] Acquiring lock "4daa6370-2cdf-4668-b66b-e10196377c9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-2cd80b92-395b-442d-b4f5-224018af9de4 req-5ba15384-c507-4ec0-b2d8-093aa1b4028f service nova] Lock "4daa6370-2cdf-4668-b66b-e10196377c9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-2cd80b92-395b-442d-b4f5-224018af9de4 req-5ba15384-c507-4ec0-b2d8-093aa1b4028f service nova] Lock "4daa6370-2cdf-4668-b66b-e10196377c9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:22 user nova-compute[74247]: DEBUG nova.compute.manager [req-2cd80b92-395b-442d-b4f5-224018af9de4 req-5ba15384-c507-4ec0-b2d8-093aa1b4028f service nova] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] No waiting events found dispatching network-vif-plugged-4d30f22d-4337-41a7-965d-f9c172049b00 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:24:22 user nova-compute[74247]: WARNING nova.compute.manager [req-2cd80b92-395b-442d-b4f5-224018af9de4 req-5ba15384-c507-4ec0-b2d8-093aa1b4028f service nova] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Received unexpected event network-vif-plugged-4d30f22d-4337-41a7-965d-f9c172049b00 for instance with vm_state building and task_state spawning.
Oct 16 18:24:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:24 user nova-compute[74247]: DEBUG nova.compute.manager [req-f8cff772-865b-4158-9e2c-72b56f008add req-d46302df-a6f2-4bb1-bcd9-252f1651a9a2 service nova] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Received event network-vif-plugged-4d30f22d-4337-41a7-965d-f9c172049b00 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:24:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f8cff772-865b-4158-9e2c-72b56f008add req-d46302df-a6f2-4bb1-bcd9-252f1651a9a2 service nova] Acquiring lock "4daa6370-2cdf-4668-b66b-e10196377c9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f8cff772-865b-4158-9e2c-72b56f008add req-d46302df-a6f2-4bb1-bcd9-252f1651a9a2 service nova] Lock "4daa6370-2cdf-4668-b66b-e10196377c9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f8cff772-865b-4158-9e2c-72b56f008add req-d46302df-a6f2-4bb1-bcd9-252f1651a9a2 service nova] Lock "4daa6370-2cdf-4668-b66b-e10196377c9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:24 user nova-compute[74247]: DEBUG nova.compute.manager [req-f8cff772-865b-4158-9e2c-72b56f008add req-d46302df-a6f2-4bb1-bcd9-252f1651a9a2 service nova] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] No waiting events found dispatching network-vif-plugged-4d30f22d-4337-41a7-965d-f9c172049b00 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:24:24 user nova-compute[74247]: WARNING nova.compute.manager [req-f8cff772-865b-4158-9e2c-72b56f008add req-d46302df-a6f2-4bb1-bcd9-252f1651a9a2 service nova] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Received unexpected event network-vif-plugged-4d30f22d-4337-41a7-965d-f9c172049b00 for instance with vm_state building and task_state spawning.
Oct 16 18:24:24 user nova-compute[74247]: DEBUG nova.compute.manager [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:24:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:24:24 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Instance spawned successfully.
Oct 16 18:24:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 18:24:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:24 user nova-compute[74247]: INFO nova.compute.manager [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Took 7.73 seconds to spawn the instance on the hypervisor.
Oct 16 18:24:24 user nova-compute[74247]: DEBUG nova.compute.manager [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:24:24 user nova-compute[74247]: INFO nova.compute.manager [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Took 9.22 seconds to build instance.
Oct 16 18:24:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8eb4a916-8b0c-482c-9de7-3d5e31e0e227 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lock "4daa6370-2cdf-4668-b66b-e10196377c9c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.447s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:29 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:30 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Acquiring lock "c048698e-de64-4124-8d72-57fb819bb80e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:30 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Lock "c048698e-de64-4124-8d72-57fb819bb80e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:30 user nova-compute[74247]: DEBUG nova.compute.manager [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 18:24:30 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:30 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:30 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:24:30 user nova-compute[74247]: INFO nova.compute.claims [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Claim successful on node user
Oct 16 18:24:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:30 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:24:30 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:24:30 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.557s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:30 user nova-compute[74247]: DEBUG nova.compute.manager [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 18:24:31 user nova-compute[74247]: DEBUG nova.compute.manager [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 18:24:31 user nova-compute[74247]: DEBUG nova.network.neutron [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 18:24:31 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 18:24:31 user nova-compute[74247]: DEBUG nova.compute.manager [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 18:24:31 user nova-compute[74247]: DEBUG nova.policy [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b2000726f45b45feb6c3c5cedcbd40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab4b3ccbd914164a2d5b38c7b89777b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 18:24:31 user nova-compute[74247]: DEBUG nova.compute.manager [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 18:24:31 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:24:31 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Creating image(s)
Oct 16 18:24:31 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Acquiring lock "/opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:31 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Lock "/opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:31 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Lock "/opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.243s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:31 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Acquiring lock "37399febbd18f60b85fd0f833558f6a3539ab231" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:31 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.347s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/disk 1073741824 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:32 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/disk 1073741824" returned: 0 in 0.077s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:32 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.435s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:32 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:32 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.250s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:32 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/disk. size=1073741824 {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 18:24:32 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:32 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:32 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Cannot resize image /opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/disk to a smaller size. {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 18:24:32 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 18:24:32 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Ensure instance console log exists: /opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:24:32 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:32 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:32 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:32 user nova-compute[74247]: DEBUG nova.network.neutron [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Successfully created port: 59256fa7-ebbd-4cde-80c4-012340d7aea0 {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:24:33 user nova-compute[74247]: DEBUG nova.network.neutron [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Successfully updated port: 59256fa7-ebbd-4cde-80c4-012340d7aea0 {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:24:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Acquiring lock "refresh_cache-c048698e-de64-4124-8d72-57fb819bb80e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:24:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Acquired lock "refresh_cache-c048698e-de64-4124-8d72-57fb819bb80e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:24:33 user nova-compute[74247]: DEBUG nova.network.neutron [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:24:33 user nova-compute[74247]: DEBUG nova.compute.manager [req-82badbba-6efd-4abd-a67b-1e5745f58814 req-0aa0b258-6f04-4d0d-bbbd-275d33e64295 service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Received event network-changed-59256fa7-ebbd-4cde-80c4-012340d7aea0 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:24:33 user nova-compute[74247]: DEBUG nova.compute.manager [req-82badbba-6efd-4abd-a67b-1e5745f58814 req-0aa0b258-6f04-4d0d-bbbd-275d33e64295 service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Refreshing instance network info cache due to event network-changed-59256fa7-ebbd-4cde-80c4-012340d7aea0. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:24:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-82badbba-6efd-4abd-a67b-1e5745f58814 req-0aa0b258-6f04-4d0d-bbbd-275d33e64295 service nova] Acquiring lock "refresh_cache-c048698e-de64-4124-8d72-57fb819bb80e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:24:33 user nova-compute[74247]: DEBUG nova.network.neutron [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:24:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Acquiring lock "ff1e2d26-57c5-4aa1-b66f-3ead29571b7e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Lock "ff1e2d26-57c5-4aa1-b66f-3ead29571b7e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:33 user nova-compute[74247]: DEBUG nova.compute.manager [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 18:24:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:33 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:24:33 user nova-compute[74247]: INFO nova.compute.claims [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Claim successful on node user
Oct 16 18:24:33 user nova-compute[74247]: DEBUG nova.network.neutron [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Updating instance_info_cache with network_info: [{"id": "59256fa7-ebbd-4cde-80c4-012340d7aea0", "address": "fa:16:3e:ff:27:0b", "network": {"id": "f35ee734-1070-4c5a-84f5-c76501c1b6cb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1676802825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ab4b3ccbd914164a2d5b38c7b89777b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59256fa7-eb", "ovs_interfaceid": "59256fa7-ebbd-4cde-80c4-012340d7aea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Releasing lock "refresh_cache-c048698e-de64-4124-8d72-57fb819bb80e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG nova.compute.manager [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Instance network_info: |[{"id": "59256fa7-ebbd-4cde-80c4-012340d7aea0", "address": "fa:16:3e:ff:27:0b", "network": {"id": "f35ee734-1070-4c5a-84f5-c76501c1b6cb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1676802825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ab4b3ccbd914164a2d5b38c7b89777b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59256fa7-eb", "ovs_interfaceid": "59256fa7-ebbd-4cde-80c4-012340d7aea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-82badbba-6efd-4abd-a67b-1e5745f58814 req-0aa0b258-6f04-4d0d-bbbd-275d33e64295 service nova] Acquired lock "refresh_cache-c048698e-de64-4124-8d72-57fb819bb80e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG nova.network.neutron [req-82badbba-6efd-4abd-a67b-1e5745f58814 req-0aa0b258-6f04-4d0d-bbbd-275d33e64295 service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Refreshing network info cache for port 59256fa7-ebbd-4cde-80c4-012340d7aea0 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Start _get_guest_xml network_info=[{"id": "59256fa7-ebbd-4cde-80c4-012340d7aea0", "address": "fa:16:3e:ff:27:0b", "network": {"id": "f35ee734-1070-4c5a-84f5-c76501c1b6cb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1676802825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ab4b3ccbd914164a2d5b38c7b89777b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59256fa7-eb", "ovs_interfaceid": "59256fa7-ebbd-4cde-80c4-012340d7aea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': '83126bb1-29f5-42fe-8620-72ab0797f776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:24:34 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:24:34 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:24:34 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T18:24:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1708908380',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1708908380',id=6,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4t5/HxarVjAIcPE9zeByR72HYnWO4eclBUfo863abS/M64e1Oj/mYiR12Cs6HtPrtMLyPaTm6rvsRa3pNGaznOooPgv/HGuQCekMNKw81O1jY6NY8zkFrvxeZV5v6ZKw==',key_name='tempest-keypair-1905579868',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ab4b3ccbd914164a2d5b38c7b89777b',ramdisk_id='',reservation_id='r-jcqqfx36',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1522926684',owner_user_name='tempest-TaggedAttachmentsTest-1522926684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:24:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2000726f45b45feb6c3c5cedcbd40e2',uuid=c048698e-de64-4124-8d72-57fb819bb80e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59256fa7-ebbd-4cde-80c4-012340d7aea0", "address": "fa:16:3e:ff:27:0b", "network": {"id": "f35ee734-1070-4c5a-84f5-c76501c1b6cb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1676802825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ab4b3ccbd914164a2d5b38c7b89777b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59256fa7-eb", "ovs_interfaceid": "59256fa7-ebbd-4cde-80c4-012340d7aea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Converting VIF {"id": "59256fa7-ebbd-4cde-80c4-012340d7aea0", "address": "fa:16:3e:ff:27:0b", "network": {"id": "f35ee734-1070-4c5a-84f5-c76501c1b6cb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1676802825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ab4b3ccbd914164a2d5b38c7b89777b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59256fa7-eb", "ovs_interfaceid": "59256fa7-ebbd-4cde-80c4-012340d7aea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:27:0b,bridge_name='br-int',has_traffic_filtering=True,id=59256fa7-ebbd-4cde-80c4-012340d7aea0,network=Network(f35ee734-1070-4c5a-84f5-c76501c1b6cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59256fa7-eb') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG nova.objects.instance [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Lazy-loading 'pci_devices' on Instance uuid c048698e-de64-4124-8d72-57fb819bb80e {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:24:34 user nova-compute[74247]:   <uuid>c048698e-de64-4124-8d72-57fb819bb80e</uuid>
Oct 16 18:24:34 user nova-compute[74247]:   <name>instance-00000006</name>
Oct 16 18:24:34 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:24:34 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:24:34 user nova-compute[74247]:   <metadata>
Oct 16 18:24:34 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:24:34 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:24:34 user nova-compute[74247]:       <nova:name>tempest-device-tagging-server-1708908380</nova:name>
Oct 16 18:24:34 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:24:34</nova:creationTime>
Oct 16 18:24:34 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:24:34 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:24:34 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:24:34 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:24:34 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:24:34 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:24:34 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:24:34 user nova-compute[74247]:       <nova:owner>
Oct 16 18:24:34 user nova-compute[74247]:         <nova:user uuid="b2000726f45b45feb6c3c5cedcbd40e2">tempest-TaggedAttachmentsTest-1522926684-project-member</nova:user>
Oct 16 18:24:34 user nova-compute[74247]:         <nova:project uuid="4ab4b3ccbd914164a2d5b38c7b89777b">tempest-TaggedAttachmentsTest-1522926684</nova:project>
Oct 16 18:24:34 user nova-compute[74247]:       </nova:owner>
Oct 16 18:24:34 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:24:34 user nova-compute[74247]:       <nova:ports>
Oct 16 18:24:34 user nova-compute[74247]:         <nova:port uuid="59256fa7-ebbd-4cde-80c4-012340d7aea0">
Oct 16 18:24:34 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 16 18:24:34 user nova-compute[74247]:         </nova:port>
Oct 16 18:24:34 user nova-compute[74247]:       </nova:ports>
Oct 16 18:24:34 user nova-compute[74247]:     </nova:instance>
Oct 16 18:24:34 user nova-compute[74247]:   </metadata>
Oct 16 18:24:34 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:24:34 user nova-compute[74247]:     <system>
Oct 16 18:24:34 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:24:34 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:24:34 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:24:34 user nova-compute[74247]:       <entry name="serial">c048698e-de64-4124-8d72-57fb819bb80e</entry>
Oct 16 18:24:34 user nova-compute[74247]:       <entry name="uuid">c048698e-de64-4124-8d72-57fb819bb80e</entry>
Oct 16 18:24:34 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:24:34 user nova-compute[74247]:     </system>
Oct 16 18:24:34 user nova-compute[74247]:   </sysinfo>
Oct 16 18:24:34 user nova-compute[74247]:   <os>
Oct 16 18:24:34 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:24:34 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:24:34 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:24:34 user nova-compute[74247]:   </os>
Oct 16 18:24:34 user nova-compute[74247]:   <features>
Oct 16 18:24:34 user nova-compute[74247]:     <acpi/>
Oct 16 18:24:34 user nova-compute[74247]:     <apic/>
Oct 16 18:24:34 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:24:34 user nova-compute[74247]:   </features>
Oct 16 18:24:34 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:24:34 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:24:34 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:24:34 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:24:34 user nova-compute[74247]:   </clock>
Oct 16 18:24:34 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:24:34 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:24:34 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:24:34 user nova-compute[74247]:   </cpu>
Oct 16 18:24:34 user nova-compute[74247]:   <devices>
Oct 16 18:24:34 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:24:34 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:24:34 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/disk"/>
Oct 16 18:24:34 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:24:34 user nova-compute[74247]:     </disk>
Oct 16 18:24:34 user nova-compute[74247]:     <disk type="file" device="cdrom">
Oct 16 18:24:34 user nova-compute[74247]:       <driver name="qemu" type="raw" cache="none"/>
Oct 16 18:24:34 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/disk.config"/>
Oct 16 18:24:34 user nova-compute[74247]:       <target dev="hda" bus="ide"/>
Oct 16 18:24:34 user nova-compute[74247]:     </disk>
Oct 16 18:24:34 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:24:34 user nova-compute[74247]:       <mac address="fa:16:3e:ff:27:0b"/>
Oct 16 18:24:34 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:24:34 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:24:34 user nova-compute[74247]:       <target dev="tap59256fa7-eb"/>
Oct 16 18:24:34 user nova-compute[74247]:     </interface>
Oct 16 18:24:34 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:24:34 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/console.log" append="off"/>
Oct 16 18:24:34 user nova-compute[74247]:     </serial>
Oct 16 18:24:34 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:24:34 user nova-compute[74247]:     <video>
Oct 16 18:24:34 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:24:34 user nova-compute[74247]:     </video>
Oct 16 18:24:34 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:24:34 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:24:34 user nova-compute[74247]:     </rng>
Oct 16 18:24:34 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:24:34 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:24:34 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:24:34 user nova-compute[74247]:     </memballoon>
Oct 16 18:24:34 user nova-compute[74247]:   </devices>
Oct 16 18:24:34 user nova-compute[74247]: </domain>
Oct 16 18:24:34 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T18:24:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1708908380',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1708908380',id=6,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4t5/HxarVjAIcPE9zeByR72HYnWO4eclBUfo863abS/M64e1Oj/mYiR12Cs6HtPrtMLyPaTm6rvsRa3pNGaznOooPgv/HGuQCekMNKw81O1jY6NY8zkFrvxeZV5v6ZKw==',key_name='tempest-keypair-1905579868',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ab4b3ccbd914164a2d5b38c7b89777b',ramdisk_id='',reservation_id='r-jcqqfx36',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1522926684',owner_user_name='tempest-TaggedAttachmentsTest-1522926684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:24:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2000726f45b45feb6c3c5cedcbd40e2',uuid=c048698e-de64-4124-8d72-57fb819bb80e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59256fa7-ebbd-4cde-80c4-012340d7aea0", "address": "fa:16:3e:ff:27:0b", "network": {"id": "f35ee734-1070-4c5a-84f5-c76501c1b6cb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1676802825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ab4b3ccbd914164a2d5b38c7b89777b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59256fa7-eb", "ovs_interfaceid": "59256fa7-ebbd-4cde-80c4-012340d7aea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Converting VIF {"id": "59256fa7-ebbd-4cde-80c4-012340d7aea0", "address": "fa:16:3e:ff:27:0b", "network": {"id": "f35ee734-1070-4c5a-84f5-c76501c1b6cb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1676802825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ab4b3ccbd914164a2d5b38c7b89777b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59256fa7-eb", "ovs_interfaceid": "59256fa7-ebbd-4cde-80c4-012340d7aea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:27:0b,bridge_name='br-int',has_traffic_filtering=True,id=59256fa7-ebbd-4cde-80c4-012340d7aea0,network=Network(f35ee734-1070-4c5a-84f5-c76501c1b6cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59256fa7-eb') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG os_vif [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:27:0b,bridge_name='br-int',has_traffic_filtering=True,id=59256fa7-ebbd-4cde-80c4-012340d7aea0,network=Network(f35ee734-1070-4c5a-84f5-c76501c1b6cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59256fa7-eb') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2be86a6e-5b62-58bb-beb4-30b410b57390', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap59256fa7-eb, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap59256fa7-eb, col_values=(('qos', UUID('ac37b938-d626-448a-b4c5-4cbe5a2c9c02')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap59256fa7-eb, col_values=(('external_ids', {'iface-id': '59256fa7-ebbd-4cde-80c4-012340d7aea0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:27:0b', 'vm-uuid': 'c048698e-de64-4124-8d72-57fb819bb80e'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:24:34 user nova-compute[74247]: INFO os_vif [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:27:0b,bridge_name='br-int',has_traffic_filtering=True,id=59256fa7-ebbd-4cde-80c4-012340d7aea0,network=Network(f35ee734-1070-4c5a-84f5-c76501c1b6cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59256fa7-eb')
Oct 16 18:24:34 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] No BDM found with device name hda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] No VIF found with MAC fa:16:3e:ff:27:0b, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:24:34 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Using config drive
Oct 16 18:24:34 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.535s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG nova.compute.manager [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG nova.network.neutron [req-82badbba-6efd-4abd-a67b-1e5745f58814 req-0aa0b258-6f04-4d0d-bbbd-275d33e64295 service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Updated VIF entry in instance network info cache for port 59256fa7-ebbd-4cde-80c4-012340d7aea0. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG nova.network.neutron [req-82badbba-6efd-4abd-a67b-1e5745f58814 req-0aa0b258-6f04-4d0d-bbbd-275d33e64295 service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Updating instance_info_cache with network_info: [{"id": "59256fa7-ebbd-4cde-80c4-012340d7aea0", "address": "fa:16:3e:ff:27:0b", "network": {"id": "f35ee734-1070-4c5a-84f5-c76501c1b6cb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1676802825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ab4b3ccbd914164a2d5b38c7b89777b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59256fa7-eb", "ovs_interfaceid": "59256fa7-ebbd-4cde-80c4-012340d7aea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-82badbba-6efd-4abd-a67b-1e5745f58814 req-0aa0b258-6f04-4d0d-bbbd-275d33e64295 service nova] Releasing lock "refresh_cache-c048698e-de64-4124-8d72-57fb819bb80e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG nova.compute.manager [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG nova.network.neutron [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 18:24:34 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 18:24:34 user nova-compute[74247]: DEBUG nova.compute.manager [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG nova.policy [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6ea1c72d4f8d497bb45168ec0bf1ccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd68f315ff3434d955243adda597196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG nova.compute.manager [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:24:34 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Creating image(s)
Oct 16 18:24:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Acquiring lock "/opt/stack/data/nova/instances/ff1e2d26-57c5-4aa1-b66f-3ead29571b7e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Lock "/opt/stack/data/nova/instances/ff1e2d26-57c5-4aa1-b66f-3ead29571b7e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Lock "/opt/stack/data/nova/instances/ff1e2d26-57c5-4aa1-b66f-3ead29571b7e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:34 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Creating config drive at /opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/disk.config
Oct 16 18:24:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp1d9fdmg9 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.179s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Acquiring lock "37399febbd18f60b85fd0f833558f6a3539ab231" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp1d9fdmg9" returned: 0 in 0.082s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.183s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/ff1e2d26-57c5-4aa1-b66f-3ead29571b7e/disk 1073741824 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/ff1e2d26-57c5-4aa1-b66f-3ead29571b7e/disk 1073741824" returned: 0 in 0.061s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:35 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:35 user nova-compute[74247]: DEBUG nova.network.neutron [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Successfully created port: 9f035e65-b642-4b32-a5b2-1e82808c6ccc {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:24:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.226s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:35 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ff1e2d26-57c5-4aa1-b66f-3ead29571b7e/disk. size=1073741824 {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 18:24:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1e2d26-57c5-4aa1-b66f-3ead29571b7e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1e2d26-57c5-4aa1-b66f-3ead29571b7e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:35 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Cannot resize image /opt/stack/data/nova/instances/ff1e2d26-57c5-4aa1-b66f-3ead29571b7e/disk to a smaller size. {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 18:24:35 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 18:24:35 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Ensure instance console log exists: /opt/stack/data/nova/instances/ff1e2d26-57c5-4aa1-b66f-3ead29571b7e/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:24:35 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:35 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:35 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG nova.network.neutron [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Successfully updated port: 9f035e65-b642-4b32-a5b2-1e82808c6ccc {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Acquiring lock "refresh_cache-ff1e2d26-57c5-4aa1-b66f-3ead29571b7e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Acquired lock "refresh_cache-ff1e2d26-57c5-4aa1-b66f-3ead29571b7e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG nova.network.neutron [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG nova.compute.manager [req-1c3f2166-ea0b-4295-9cb4-8af4f5eb3759 req-c71f4988-e694-423e-a218-27b22301b5a8 service nova] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Received event network-changed-9f035e65-b642-4b32-a5b2-1e82808c6ccc {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG nova.compute.manager [req-1c3f2166-ea0b-4295-9cb4-8af4f5eb3759 req-c71f4988-e694-423e-a218-27b22301b5a8 service nova] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Refreshing instance network info cache due to event network-changed-9f035e65-b642-4b32-a5b2-1e82808c6ccc. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1c3f2166-ea0b-4295-9cb4-8af4f5eb3759 req-c71f4988-e694-423e-a218-27b22301b5a8 service nova] Acquiring lock "refresh_cache-ff1e2d26-57c5-4aa1-b66f-3ead29571b7e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG nova.network.neutron [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG nova.network.neutron [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Updating instance_info_cache with network_info: [{"id": "9f035e65-b642-4b32-a5b2-1e82808c6ccc", "address": "fa:16:3e:0b:8b:d0", "network": {"id": "d463c254-d68d-4ea5-9642-08d9a1418f04", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1349151729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcd68f315ff3434d955243adda597196", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f035e65-b6", "ovs_interfaceid": "9f035e65-b642-4b32-a5b2-1e82808c6ccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Releasing lock "refresh_cache-ff1e2d26-57c5-4aa1-b66f-3ead29571b7e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG nova.compute.manager [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Instance network_info: |[{"id": "9f035e65-b642-4b32-a5b2-1e82808c6ccc", "address": "fa:16:3e:0b:8b:d0", "network": {"id": "d463c254-d68d-4ea5-9642-08d9a1418f04", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1349151729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcd68f315ff3434d955243adda597196", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f035e65-b6", "ovs_interfaceid": "9f035e65-b642-4b32-a5b2-1e82808c6ccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1c3f2166-ea0b-4295-9cb4-8af4f5eb3759 req-c71f4988-e694-423e-a218-27b22301b5a8 service nova] Acquired lock "refresh_cache-ff1e2d26-57c5-4aa1-b66f-3ead29571b7e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG nova.network.neutron [req-1c3f2166-ea0b-4295-9cb4-8af4f5eb3759 req-c71f4988-e694-423e-a218-27b22301b5a8 service nova] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Refreshing network info cache for port 9f035e65-b642-4b32-a5b2-1e82808c6ccc {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Start _get_guest_xml network_info=[{"id": "9f035e65-b642-4b32-a5b2-1e82808c6ccc", "address": "fa:16:3e:0b:8b:d0", "network": {"id": "d463c254-d68d-4ea5-9642-08d9a1418f04", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1349151729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcd68f315ff3434d955243adda597196", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f035e65-b6", "ovs_interfaceid": "9f035e65-b642-4b32-a5b2-1e82808c6ccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': '83126bb1-29f5-42fe-8620-72ab0797f776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Acquiring lock "c868ea1c-0c1c-4470-b125-0a7a76d96c4d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Lock "c868ea1c-0c1c-4470-b125-0a7a76d96c4d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG nova.compute.manager [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 18:24:36 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:24:36 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:24:36 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:24:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-20291116',display_name='tempest-TestVolumeSwap-server-20291116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-20291116',id=7,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnPo7kClnk+yEISweFZgTpAOjOm8pokMKzu0W5qmpZCLG0UG6R3LGOuEF2hPW1jcNilAE4mhz1w/YeA+MRgKDrB0RuniasiJpWmaDhUDL0063pA9501qBitEDnXoWhAfw==',key_name='tempest-keypair-858685379',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcd68f315ff3434d955243adda597196',ramdisk_id='',reservation_id='r-o2wvki97',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-322864409',owner_user_name='tempest-TestVolumeSwap-322864409-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:24:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ea1c72d4f8d497bb45168ec0bf1ccd9',uuid=ff1e2d26-57c5-4aa1-b66f-3ead29571b7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f035e65-b642-4b32-a5b2-1e82808c6ccc", "address": "fa:16:3e:0b:8b:d0", "network": {"id": "d463c254-d68d-4ea5-9642-08d9a1418f04", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1349151729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcd68f315ff3434d955243adda597196", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f035e65-b6", "ovs_interfaceid": "9f035e65-b642-4b32-a5b2-1e82808c6ccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Converting VIF {"id": "9f035e65-b642-4b32-a5b2-1e82808c6ccc", "address": "fa:16:3e:0b:8b:d0", "network": {"id": "d463c254-d68d-4ea5-9642-08d9a1418f04", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1349151729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcd68f315ff3434d955243adda597196", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f035e65-b6", "ovs_interfaceid": "9f035e65-b642-4b32-a5b2-1e82808c6ccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:8b:d0,bridge_name='br-int',has_traffic_filtering=True,id=9f035e65-b642-4b32-a5b2-1e82808c6ccc,network=Network(d463c254-d68d-4ea5-9642-08d9a1418f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f035e65-b6') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG nova.objects.instance [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Lazy-loading 'pci_devices' on Instance uuid ff1e2d26-57c5-4aa1-b66f-3ead29571b7e {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:24:36 user nova-compute[74247]:   <uuid>ff1e2d26-57c5-4aa1-b66f-3ead29571b7e</uuid>
Oct 16 18:24:36 user nova-compute[74247]:   <name>instance-00000007</name>
Oct 16 18:24:36 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:24:36 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:24:36 user nova-compute[74247]:   <metadata>
Oct 16 18:24:36 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:24:36 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:24:36 user nova-compute[74247]:       <nova:name>tempest-TestVolumeSwap-server-20291116</nova:name>
Oct 16 18:24:36 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:24:36</nova:creationTime>
Oct 16 18:24:36 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:24:36 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:24:36 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:24:36 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:24:36 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:24:36 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:24:36 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:24:36 user nova-compute[74247]:       <nova:owner>
Oct 16 18:24:36 user nova-compute[74247]:         <nova:user uuid="6ea1c72d4f8d497bb45168ec0bf1ccd9">tempest-TestVolumeSwap-322864409-project-member</nova:user>
Oct 16 18:24:36 user nova-compute[74247]:         <nova:project uuid="fcd68f315ff3434d955243adda597196">tempest-TestVolumeSwap-322864409</nova:project>
Oct 16 18:24:36 user nova-compute[74247]:       </nova:owner>
Oct 16 18:24:36 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:24:36 user nova-compute[74247]:       <nova:ports>
Oct 16 18:24:36 user nova-compute[74247]:         <nova:port uuid="9f035e65-b642-4b32-a5b2-1e82808c6ccc">
Oct 16 18:24:36 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 16 18:24:36 user nova-compute[74247]:         </nova:port>
Oct 16 18:24:36 user nova-compute[74247]:       </nova:ports>
Oct 16 18:24:36 user nova-compute[74247]:     </nova:instance>
Oct 16 18:24:36 user nova-compute[74247]:   </metadata>
Oct 16 18:24:36 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:24:36 user nova-compute[74247]:     <system>
Oct 16 18:24:36 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:24:36 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:24:36 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:24:36 user nova-compute[74247]:       <entry name="serial">ff1e2d26-57c5-4aa1-b66f-3ead29571b7e</entry>
Oct 16 18:24:36 user nova-compute[74247]:       <entry name="uuid">ff1e2d26-57c5-4aa1-b66f-3ead29571b7e</entry>
Oct 16 18:24:36 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:24:36 user nova-compute[74247]:     </system>
Oct 16 18:24:36 user nova-compute[74247]:   </sysinfo>
Oct 16 18:24:36 user nova-compute[74247]:   <os>
Oct 16 18:24:36 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:24:36 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:24:36 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:24:36 user nova-compute[74247]:   </os>
Oct 16 18:24:36 user nova-compute[74247]:   <features>
Oct 16 18:24:36 user nova-compute[74247]:     <acpi/>
Oct 16 18:24:36 user nova-compute[74247]:     <apic/>
Oct 16 18:24:36 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:24:36 user nova-compute[74247]:   </features>
Oct 16 18:24:36 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:24:36 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:24:36 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:24:36 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:24:36 user nova-compute[74247]:   </clock>
Oct 16 18:24:36 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:24:36 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:24:36 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:24:36 user nova-compute[74247]:   </cpu>
Oct 16 18:24:36 user nova-compute[74247]:   <devices>
Oct 16 18:24:36 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:24:36 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:24:36 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/ff1e2d26-57c5-4aa1-b66f-3ead29571b7e/disk"/>
Oct 16 18:24:36 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:24:36 user nova-compute[74247]:     </disk>
Oct 16 18:24:36 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:24:36 user nova-compute[74247]:       <mac address="fa:16:3e:0b:8b:d0"/>
Oct 16 18:24:36 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:24:36 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:24:36 user nova-compute[74247]:       <target dev="tap9f035e65-b6"/>
Oct 16 18:24:36 user nova-compute[74247]:     </interface>
Oct 16 18:24:36 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:24:36 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/ff1e2d26-57c5-4aa1-b66f-3ead29571b7e/console.log" append="off"/>
Oct 16 18:24:36 user nova-compute[74247]:     </serial>
Oct 16 18:24:36 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:24:36 user nova-compute[74247]:     <video>
Oct 16 18:24:36 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:24:36 user nova-compute[74247]:     </video>
Oct 16 18:24:36 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:24:36 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:24:36 user nova-compute[74247]:     </rng>
Oct 16 18:24:36 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:24:36 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:24:36 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:24:36 user nova-compute[74247]:     </memballoon>
Oct 16 18:24:36 user nova-compute[74247]:   </devices>
Oct 16 18:24:36 user nova-compute[74247]: </domain>
Oct 16 18:24:36 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:24:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-20291116',display_name='tempest-TestVolumeSwap-server-20291116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-20291116',id=7,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnPo7kClnk+yEISweFZgTpAOjOm8pokMKzu0W5qmpZCLG0UG6R3LGOuEF2hPW1jcNilAE4mhz1w/YeA+MRgKDrB0RuniasiJpWmaDhUDL0063pA9501qBitEDnXoWhAfw==',key_name='tempest-keypair-858685379',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcd68f315ff3434d955243adda597196',ramdisk_id='',reservation_id='r-o2wvki97',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-322864409',owner_user_name='tempest-TestVolumeSwap-322864409-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:24:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ea1c72d4f8d497bb45168ec0bf1ccd9',uuid=ff1e2d26-57c5-4aa1-b66f-3ead29571b7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f035e65-b642-4b32-a5b2-1e82808c6ccc", "address": "fa:16:3e:0b:8b:d0", "network": {"id": "d463c254-d68d-4ea5-9642-08d9a1418f04", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1349151729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcd68f315ff3434d955243adda597196", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f035e65-b6", "ovs_interfaceid": "9f035e65-b642-4b32-a5b2-1e82808c6ccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Converting VIF {"id": "9f035e65-b642-4b32-a5b2-1e82808c6ccc", "address": "fa:16:3e:0b:8b:d0", "network": {"id": "d463c254-d68d-4ea5-9642-08d9a1418f04", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1349151729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcd68f315ff3434d955243adda597196", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f035e65-b6", "ovs_interfaceid": "9f035e65-b642-4b32-a5b2-1e82808c6ccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:8b:d0,bridge_name='br-int',has_traffic_filtering=True,id=9f035e65-b642-4b32-a5b2-1e82808c6ccc,network=Network(d463c254-d68d-4ea5-9642-08d9a1418f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f035e65-b6') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG os_vif [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:8b:d0,bridge_name='br-int',has_traffic_filtering=True,id=9f035e65-b642-4b32-a5b2-1e82808c6ccc,network=Network(d463c254-d68d-4ea5-9642-08d9a1418f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f035e65-b6') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '978b3b59-a599-5fe9-9750-1777f9e77ed0', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f035e65-b6, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9f035e65-b6, col_values=(('qos', UUID('f095e35c-bfaa-49c8-ae85-6242ab01e075')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:24:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9f035e65-b6, col_values=(('external_ids', {'iface-id': '9f035e65-b642-4b32-a5b2-1e82808c6ccc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:8b:d0', 'vm-uuid': 'ff1e2d26-57c5-4aa1-b66f-3ead29571b7e'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:24:37 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:24:37 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:37 user nova-compute[74247]: INFO os_vif [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:8b:d0,bridge_name='br-int',has_traffic_filtering=True,id=9f035e65-b642-4b32-a5b2-1e82808c6ccc,network=Network(d463c254-d68d-4ea5-9642-08d9a1418f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f035e65-b6')
Oct 16 18:24:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:37 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:24:37 user nova-compute[74247]: INFO nova.compute.claims [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Claim successful on node user
Oct 16 18:24:37 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:24:37 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] No VIF found with MAC fa:16:3e:0b:8b:d0, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:24:37 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:37 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:37 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:37 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:37 user nova-compute[74247]: DEBUG nova.network.neutron [req-1c3f2166-ea0b-4295-9cb4-8af4f5eb3759 req-c71f4988-e694-423e-a218-27b22301b5a8 service nova] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Updated VIF entry in instance network info cache for port 9f035e65-b642-4b32-a5b2-1e82808c6ccc. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:24:37 user nova-compute[74247]: DEBUG nova.network.neutron [req-1c3f2166-ea0b-4295-9cb4-8af4f5eb3759 req-c71f4988-e694-423e-a218-27b22301b5a8 service nova] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Updating instance_info_cache with network_info: [{"id": "9f035e65-b642-4b32-a5b2-1e82808c6ccc", "address": "fa:16:3e:0b:8b:d0", "network": {"id": "d463c254-d68d-4ea5-9642-08d9a1418f04", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1349151729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcd68f315ff3434d955243adda597196", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f035e65-b6", "ovs_interfaceid": "9f035e65-b642-4b32-a5b2-1e82808c6ccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:24:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1c3f2166-ea0b-4295-9cb4-8af4f5eb3759 req-c71f4988-e694-423e-a218-27b22301b5a8 service nova] Releasing lock "refresh_cache-ff1e2d26-57c5-4aa1-b66f-3ead29571b7e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:24:37 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:24:37 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:24:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.626s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:37 user nova-compute[74247]: DEBUG nova.compute.manager [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 18:24:37 user nova-compute[74247]: DEBUG nova.compute.manager [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 18:24:37 user nova-compute[74247]: DEBUG nova.network.neutron [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 18:24:37 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 18:24:37 user nova-compute[74247]: DEBUG nova.compute.manager [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 18:24:37 user nova-compute[74247]: DEBUG nova.policy [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ec0452050fd47499d535837954fcf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bf1a9c1d4b408195d15bccd73e818b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 18:24:37 user nova-compute[74247]: DEBUG nova.compute.manager [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 18:24:37 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:24:37 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Creating image(s)
Oct 16 18:24:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Acquiring lock "/opt/stack/data/nova/instances/c868ea1c-0c1c-4470-b125-0a7a76d96c4d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Lock "/opt/stack/data/nova/instances/c868ea1c-0c1c-4470-b125-0a7a76d96c4d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Lock "/opt/stack/data/nova/instances/c868ea1c-0c1c-4470-b125-0a7a76d96c4d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.206s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Acquiring lock "37399febbd18f60b85fd0f833558f6a3539ab231" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:38 user nova-compute[74247]: DEBUG nova.compute.manager [req-cf7d744c-a706-44af-87a0-72c8f7447045 req-ea6048ff-6981-497f-adb5-0032082fee1c service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Received event network-vif-plugged-59256fa7-ebbd-4cde-80c4-012340d7aea0 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:24:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-cf7d744c-a706-44af-87a0-72c8f7447045 req-ea6048ff-6981-497f-adb5-0032082fee1c service nova] Acquiring lock "c048698e-de64-4124-8d72-57fb819bb80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-cf7d744c-a706-44af-87a0-72c8f7447045 req-ea6048ff-6981-497f-adb5-0032082fee1c service nova] Lock "c048698e-de64-4124-8d72-57fb819bb80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-cf7d744c-a706-44af-87a0-72c8f7447045 req-ea6048ff-6981-497f-adb5-0032082fee1c service nova] Lock "c048698e-de64-4124-8d72-57fb819bb80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:38 user nova-compute[74247]: DEBUG nova.compute.manager [req-cf7d744c-a706-44af-87a0-72c8f7447045 req-ea6048ff-6981-497f-adb5-0032082fee1c service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] No waiting events found dispatching network-vif-plugged-59256fa7-ebbd-4cde-80c4-012340d7aea0 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:24:38 user nova-compute[74247]: WARNING nova.compute.manager [req-cf7d744c-a706-44af-87a0-72c8f7447045 req-ea6048ff-6981-497f-adb5-0032082fee1c service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Received unexpected event network-vif-plugged-59256fa7-ebbd-4cde-80c4-012340d7aea0 for instance with vm_state building and task_state spawning.
Oct 16 18:24:38 user nova-compute[74247]: DEBUG nova.compute.manager [req-cf7d744c-a706-44af-87a0-72c8f7447045 req-ea6048ff-6981-497f-adb5-0032082fee1c service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Received event network-vif-plugged-59256fa7-ebbd-4cde-80c4-012340d7aea0 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:24:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-cf7d744c-a706-44af-87a0-72c8f7447045 req-ea6048ff-6981-497f-adb5-0032082fee1c service nova] Acquiring lock "c048698e-de64-4124-8d72-57fb819bb80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-cf7d744c-a706-44af-87a0-72c8f7447045 req-ea6048ff-6981-497f-adb5-0032082fee1c service nova] Lock "c048698e-de64-4124-8d72-57fb819bb80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-cf7d744c-a706-44af-87a0-72c8f7447045 req-ea6048ff-6981-497f-adb5-0032082fee1c service nova] Lock "c048698e-de64-4124-8d72-57fb819bb80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:38 user nova-compute[74247]: DEBUG nova.compute.manager [req-cf7d744c-a706-44af-87a0-72c8f7447045 req-ea6048ff-6981-497f-adb5-0032082fee1c service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] No waiting events found dispatching network-vif-plugged-59256fa7-ebbd-4cde-80c4-012340d7aea0 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:24:38 user nova-compute[74247]: WARNING nova.compute.manager [req-cf7d744c-a706-44af-87a0-72c8f7447045 req-ea6048ff-6981-497f-adb5-0032082fee1c service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Received unexpected event network-vif-plugged-59256fa7-ebbd-4cde-80c4-012340d7aea0 for instance with vm_state building and task_state spawning.
Oct 16 18:24:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.228s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/c868ea1c-0c1c-4470-b125-0a7a76d96c4d/disk 1073741824 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/c868ea1c-0c1c-4470-b125-0a7a76d96c4d/disk 1073741824" returned: 0 in 0.067s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:38 user nova-compute[74247]: DEBUG nova.network.neutron [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Successfully created port: e9ecd4e6-2676-47b4-baf8-d8f68156007d {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:24:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.254s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:38 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c868ea1c-0c1c-4470-b125-0a7a76d96c4d/disk. size=1073741824 {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 18:24:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c868ea1c-0c1c-4470-b125-0a7a76d96c4d/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c868ea1c-0c1c-4470-b125-0a7a76d96c4d/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:38 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Cannot resize image /opt/stack/data/nova/instances/c868ea1c-0c1c-4470-b125-0a7a76d96c4d/disk to a smaller size. {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 18:24:38 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 18:24:38 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Ensure instance console log exists: /opt/stack/data/nova/instances/c868ea1c-0c1c-4470-b125-0a7a76d96c4d/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:24:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:38 user nova-compute[74247]: DEBUG nova.compute.manager [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:24:38 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:24:38 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Instance spawned successfully.
Oct 16 18:24:38 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:39 user nova-compute[74247]: INFO nova.compute.manager [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Took 7.82 seconds to spawn the instance on the hypervisor.
Oct 16 18:24:39 user nova-compute[74247]: DEBUG nova.compute.manager [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG nova.network.neutron [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Successfully updated port: e9ecd4e6-2676-47b4-baf8-d8f68156007d {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:24:39 user nova-compute[74247]: INFO nova.compute.manager [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Took 8.93 seconds to build instance.
Oct 16 18:24:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Acquiring lock "refresh_cache-c868ea1c-0c1c-4470-b125-0a7a76d96c4d" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Acquired lock "refresh_cache-c868ea1c-0c1c-4470-b125-0a7a76d96c4d" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG nova.network.neutron [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-69ab1df4-bb84-4b6f-9578-2898a403c6e8 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Lock "c048698e-de64-4124-8d72-57fb819bb80e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.065s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG nova.network.neutron [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG nova.network.neutron [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Updating instance_info_cache with network_info: [{"id": "e9ecd4e6-2676-47b4-baf8-d8f68156007d", "address": "fa:16:3e:91:15:33", "network": {"id": "00543722-2a00-4d5d-b9d4-8ee2814fa989", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1795227661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47bf1a9c1d4b408195d15bccd73e818b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ecd4e6-26", "ovs_interfaceid": "e9ecd4e6-2676-47b4-baf8-d8f68156007d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Releasing lock "refresh_cache-c868ea1c-0c1c-4470-b125-0a7a76d96c4d" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG nova.compute.manager [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Instance network_info: |[{"id": "e9ecd4e6-2676-47b4-baf8-d8f68156007d", "address": "fa:16:3e:91:15:33", "network": {"id": "00543722-2a00-4d5d-b9d4-8ee2814fa989", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1795227661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47bf1a9c1d4b408195d15bccd73e818b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ecd4e6-26", "ovs_interfaceid": "e9ecd4e6-2676-47b4-baf8-d8f68156007d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Start _get_guest_xml network_info=[{"id": "e9ecd4e6-2676-47b4-baf8-d8f68156007d", "address": "fa:16:3e:91:15:33", "network": {"id": "00543722-2a00-4d5d-b9d4-8ee2814fa989", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1795227661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47bf1a9c1d4b408195d15bccd73e818b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ecd4e6-26", "ovs_interfaceid": "e9ecd4e6-2676-47b4-baf8-d8f68156007d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': '83126bb1-29f5-42fe-8620-72ab0797f776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:24:39 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:24:39 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:24:39 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:24:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1900535874',display_name='tempest-VolumesAssistedSnapshotsTest-server-1900535874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1900535874',id=8,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZm5g5FswEClxZq2Tyo+5T/i2LrNoPZUIVcUfPwtLLTVFAkDd4sSvgvlAnR0pPH8ucb5fZDO40ybjQ0Mz3U/3nWIEiVTIbxgz035R8r98527gcnLaOf/vbKEM+0sTwBxw==',key_name='tempest-keypair-308070645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47bf1a9c1d4b408195d15bccd73e818b',ramdisk_id='',reservation_id='r-30idq7eq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-229729736',owner_user_name='tempest-VolumesAssistedSnapshotsTest-229729736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:24:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ec0452050fd47499d535837954fcf8e',uuid=c868ea1c-0c1c-4470-b125-0a7a76d96c4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9ecd4e6-2676-47b4-baf8-d8f68156007d", "address": "fa:16:3e:91:15:33", "network": {"id": "00543722-2a00-4d5d-b9d4-8ee2814fa989", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1795227661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47bf1a9c1d4b408195d15bccd73e818b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ecd4e6-26", "ovs_interfaceid": "e9ecd4e6-2676-47b4-baf8-d8f68156007d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Converting VIF {"id": "e9ecd4e6-2676-47b4-baf8-d8f68156007d", "address": "fa:16:3e:91:15:33", "network": {"id": "00543722-2a00-4d5d-b9d4-8ee2814fa989", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1795227661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47bf1a9c1d4b408195d15bccd73e818b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ecd4e6-26", "ovs_interfaceid": "e9ecd4e6-2676-47b4-baf8-d8f68156007d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:15:33,bridge_name='br-int',has_traffic_filtering=True,id=e9ecd4e6-2676-47b4-baf8-d8f68156007d,network=Network(00543722-2a00-4d5d-b9d4-8ee2814fa989),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9ecd4e6-26') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG nova.objects.instance [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Lazy-loading 'pci_devices' on Instance uuid c868ea1c-0c1c-4470-b125-0a7a76d96c4d {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:24:39 user nova-compute[74247]:   <uuid>c868ea1c-0c1c-4470-b125-0a7a76d96c4d</uuid>
Oct 16 18:24:39 user nova-compute[74247]:   <name>instance-00000008</name>
Oct 16 18:24:39 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:24:39 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:24:39 user nova-compute[74247]:   <metadata>
Oct 16 18:24:39 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:24:39 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:24:39 user nova-compute[74247]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1900535874</nova:name>
Oct 16 18:24:39 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:24:39</nova:creationTime>
Oct 16 18:24:39 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:24:39 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:24:39 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:24:39 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:24:39 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:24:39 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:24:39 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:24:39 user nova-compute[74247]:       <nova:owner>
Oct 16 18:24:39 user nova-compute[74247]:         <nova:user uuid="0ec0452050fd47499d535837954fcf8e">tempest-VolumesAssistedSnapshotsTest-229729736-project-member</nova:user>
Oct 16 18:24:39 user nova-compute[74247]:         <nova:project uuid="47bf1a9c1d4b408195d15bccd73e818b">tempest-VolumesAssistedSnapshotsTest-229729736</nova:project>
Oct 16 18:24:39 user nova-compute[74247]:       </nova:owner>
Oct 16 18:24:39 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:24:39 user nova-compute[74247]:       <nova:ports>
Oct 16 18:24:39 user nova-compute[74247]:         <nova:port uuid="e9ecd4e6-2676-47b4-baf8-d8f68156007d">
Oct 16 18:24:39 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 16 18:24:39 user nova-compute[74247]:         </nova:port>
Oct 16 18:24:39 user nova-compute[74247]:       </nova:ports>
Oct 16 18:24:39 user nova-compute[74247]:     </nova:instance>
Oct 16 18:24:39 user nova-compute[74247]:   </metadata>
Oct 16 18:24:39 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:24:39 user nova-compute[74247]:     <system>
Oct 16 18:24:39 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:24:39 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:24:39 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:24:39 user nova-compute[74247]:       <entry name="serial">c868ea1c-0c1c-4470-b125-0a7a76d96c4d</entry>
Oct 16 18:24:39 user nova-compute[74247]:       <entry name="uuid">c868ea1c-0c1c-4470-b125-0a7a76d96c4d</entry>
Oct 16 18:24:39 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:24:39 user nova-compute[74247]:     </system>
Oct 16 18:24:39 user nova-compute[74247]:   </sysinfo>
Oct 16 18:24:39 user nova-compute[74247]:   <os>
Oct 16 18:24:39 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:24:39 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:24:39 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:24:39 user nova-compute[74247]:   </os>
Oct 16 18:24:39 user nova-compute[74247]:   <features>
Oct 16 18:24:39 user nova-compute[74247]:     <acpi/>
Oct 16 18:24:39 user nova-compute[74247]:     <apic/>
Oct 16 18:24:39 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:24:39 user nova-compute[74247]:   </features>
Oct 16 18:24:39 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:24:39 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:24:39 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:24:39 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:24:39 user nova-compute[74247]:   </clock>
Oct 16 18:24:39 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:24:39 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:24:39 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:24:39 user nova-compute[74247]:   </cpu>
Oct 16 18:24:39 user nova-compute[74247]:   <devices>
Oct 16 18:24:39 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:24:39 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:24:39 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/c868ea1c-0c1c-4470-b125-0a7a76d96c4d/disk"/>
Oct 16 18:24:39 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:24:39 user nova-compute[74247]:     </disk>
Oct 16 18:24:39 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:24:39 user nova-compute[74247]:       <mac address="fa:16:3e:91:15:33"/>
Oct 16 18:24:39 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:24:39 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:24:39 user nova-compute[74247]:       <target dev="tape9ecd4e6-26"/>
Oct 16 18:24:39 user nova-compute[74247]:     </interface>
Oct 16 18:24:39 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:24:39 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/c868ea1c-0c1c-4470-b125-0a7a76d96c4d/console.log" append="off"/>
Oct 16 18:24:39 user nova-compute[74247]:     </serial>
Oct 16 18:24:39 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:24:39 user nova-compute[74247]:     <video>
Oct 16 18:24:39 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:24:39 user nova-compute[74247]:     </video>
Oct 16 18:24:39 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:24:39 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:24:39 user nova-compute[74247]:     </rng>
Oct 16 18:24:39 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:24:39 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:24:39 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:24:39 user nova-compute[74247]:     </memballoon>
Oct 16 18:24:39 user nova-compute[74247]:   </devices>
Oct 16 18:24:39 user nova-compute[74247]: </domain>
Oct 16 18:24:39 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:24:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1900535874',display_name='tempest-VolumesAssistedSnapshotsTest-server-1900535874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1900535874',id=8,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZm5g5FswEClxZq2Tyo+5T/i2LrNoPZUIVcUfPwtLLTVFAkDd4sSvgvlAnR0pPH8ucb5fZDO40ybjQ0Mz3U/3nWIEiVTIbxgz035R8r98527gcnLaOf/vbKEM+0sTwBxw==',key_name='tempest-keypair-308070645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47bf1a9c1d4b408195d15bccd73e818b',ramdisk_id='',reservation_id='r-30idq7eq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-229729736',owner_user_name='tempest-VolumesAssistedSnapshotsTest-229729736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:24:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ec0452050fd47499d535837954fcf8e',uuid=c868ea1c-0c1c-4470-b125-0a7a76d96c4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9ecd4e6-2676-47b4-baf8-d8f68156007d", "address": "fa:16:3e:91:15:33", "network": {"id": "00543722-2a00-4d5d-b9d4-8ee2814fa989", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1795227661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47bf1a9c1d4b408195d15bccd73e818b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ecd4e6-26", "ovs_interfaceid": "e9ecd4e6-2676-47b4-baf8-d8f68156007d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Converting VIF {"id": "e9ecd4e6-2676-47b4-baf8-d8f68156007d", "address": "fa:16:3e:91:15:33", "network": {"id": "00543722-2a00-4d5d-b9d4-8ee2814fa989", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1795227661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47bf1a9c1d4b408195d15bccd73e818b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ecd4e6-26", "ovs_interfaceid": "e9ecd4e6-2676-47b4-baf8-d8f68156007d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:15:33,bridge_name='br-int',has_traffic_filtering=True,id=e9ecd4e6-2676-47b4-baf8-d8f68156007d,network=Network(00543722-2a00-4d5d-b9d4-8ee2814fa989),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9ecd4e6-26') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG os_vif [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:15:33,bridge_name='br-int',has_traffic_filtering=True,id=e9ecd4e6-2676-47b4-baf8-d8f68156007d,network=Network(00543722-2a00-4d5d-b9d4-8ee2814fa989),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9ecd4e6-26') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '068e2312-1a92-55db-af79-b3e9babf7a66', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9ecd4e6-26, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape9ecd4e6-26, col_values=(('qos', UUID('f3231b65-5ace-414a-9192-183809224977')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape9ecd4e6-26, col_values=(('external_ids', {'iface-id': 'e9ecd4e6-2676-47b4-baf8-d8f68156007d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:15:33', 'vm-uuid': 'c868ea1c-0c1c-4470-b125-0a7a76d96c4d'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:39 user nova-compute[74247]: INFO os_vif [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:15:33,bridge_name='br-int',has_traffic_filtering=True,id=e9ecd4e6-2676-47b4-baf8-d8f68156007d,network=Network(00543722-2a00-4d5d-b9d4-8ee2814fa989),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9ecd4e6-26')
Oct 16 18:24:39 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:24:39 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] No VIF found with MAC fa:16:3e:91:15:33, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:24:40 user nova-compute[74247]: DEBUG nova.compute.manager [req-8ced365f-18de-42b5-a3ac-18628dffa939 req-f4b3cfe5-8b81-4366-b783-5fcc7f34d023 service nova] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Received event network-changed-e9ecd4e6-2676-47b4-baf8-d8f68156007d {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:24:40 user nova-compute[74247]: DEBUG nova.compute.manager [req-8ced365f-18de-42b5-a3ac-18628dffa939 req-f4b3cfe5-8b81-4366-b783-5fcc7f34d023 service nova] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Refreshing instance network info cache due to event network-changed-e9ecd4e6-2676-47b4-baf8-d8f68156007d. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:24:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-8ced365f-18de-42b5-a3ac-18628dffa939 req-f4b3cfe5-8b81-4366-b783-5fcc7f34d023 service nova] Acquiring lock "refresh_cache-c868ea1c-0c1c-4470-b125-0a7a76d96c4d" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:24:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-8ced365f-18de-42b5-a3ac-18628dffa939 req-f4b3cfe5-8b81-4366-b783-5fcc7f34d023 service nova] Acquired lock "refresh_cache-c868ea1c-0c1c-4470-b125-0a7a76d96c4d" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:24:40 user nova-compute[74247]: DEBUG nova.network.neutron [req-8ced365f-18de-42b5-a3ac-18628dffa939 req-f4b3cfe5-8b81-4366-b783-5fcc7f34d023 service nova] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Refreshing network info cache for port e9ecd4e6-2676-47b4-baf8-d8f68156007d {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:24:40 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:40 user nova-compute[74247]: DEBUG nova.network.neutron [req-8ced365f-18de-42b5-a3ac-18628dffa939 req-f4b3cfe5-8b81-4366-b783-5fcc7f34d023 service nova] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Updated VIF entry in instance network info cache for port e9ecd4e6-2676-47b4-baf8-d8f68156007d. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:24:40 user nova-compute[74247]: DEBUG nova.network.neutron [req-8ced365f-18de-42b5-a3ac-18628dffa939 req-f4b3cfe5-8b81-4366-b783-5fcc7f34d023 service nova] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Updating instance_info_cache with network_info: [{"id": "e9ecd4e6-2676-47b4-baf8-d8f68156007d", "address": "fa:16:3e:91:15:33", "network": {"id": "00543722-2a00-4d5d-b9d4-8ee2814fa989", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1795227661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47bf1a9c1d4b408195d15bccd73e818b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ecd4e6-26", "ovs_interfaceid": "e9ecd4e6-2676-47b4-baf8-d8f68156007d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:24:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-8ced365f-18de-42b5-a3ac-18628dffa939 req-f4b3cfe5-8b81-4366-b783-5fcc7f34d023 service nova] Releasing lock "refresh_cache-c868ea1c-0c1c-4470-b125-0a7a76d96c4d" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:24:41 user nova-compute[74247]: DEBUG nova.compute.manager [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:24:41 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:24:41 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Instance spawned successfully.
Oct 16 18:24:41 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 18:24:41 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:41 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:41 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:41 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:41 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:41 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:41 user nova-compute[74247]: INFO nova.compute.manager [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Took 6.54 seconds to spawn the instance on the hypervisor.
Oct 16 18:24:41 user nova-compute[74247]: DEBUG nova.compute.manager [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:24:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:41 user nova-compute[74247]: INFO nova.compute.manager [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Took 7.65 seconds to build instance.
Oct 16 18:24:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e2691a63-d381-4a33-b8e5-288a1073e69c tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Lock "ff1e2d26-57c5-4aa1-b66f-3ead29571b7e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.805s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:41 user nova-compute[74247]: DEBUG nova.compute.manager [req-c9ca9549-4849-414c-8092-943e75e9e9ef req-ff02cc43-afd7-45cf-806f-ca466074110f service nova] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Received event network-vif-plugged-e9ecd4e6-2676-47b4-baf8-d8f68156007d {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:24:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c9ca9549-4849-414c-8092-943e75e9e9ef req-ff02cc43-afd7-45cf-806f-ca466074110f service nova] Acquiring lock "c868ea1c-0c1c-4470-b125-0a7a76d96c4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c9ca9549-4849-414c-8092-943e75e9e9ef req-ff02cc43-afd7-45cf-806f-ca466074110f service nova] Lock "c868ea1c-0c1c-4470-b125-0a7a76d96c4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c9ca9549-4849-414c-8092-943e75e9e9ef req-ff02cc43-afd7-45cf-806f-ca466074110f service nova] Lock "c868ea1c-0c1c-4470-b125-0a7a76d96c4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:41 user nova-compute[74247]: DEBUG nova.compute.manager [req-c9ca9549-4849-414c-8092-943e75e9e9ef req-ff02cc43-afd7-45cf-806f-ca466074110f service nova] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] No waiting events found dispatching network-vif-plugged-e9ecd4e6-2676-47b4-baf8-d8f68156007d {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:24:41 user nova-compute[74247]: WARNING nova.compute.manager [req-c9ca9549-4849-414c-8092-943e75e9e9ef req-ff02cc43-afd7-45cf-806f-ca466074110f service nova] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Received unexpected event network-vif-plugged-e9ecd4e6-2676-47b4-baf8-d8f68156007d for instance with vm_state building and task_state spawning.
Oct 16 18:24:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:43 user nova-compute[74247]: DEBUG nova.compute.manager [req-ad099d88-e5ec-4f9b-96f6-652b9153ba06 req-5f759133-8a50-4ca5-8d33-81ad8551153b service nova] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Received event network-vif-plugged-e9ecd4e6-2676-47b4-baf8-d8f68156007d {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:24:43 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-ad099d88-e5ec-4f9b-96f6-652b9153ba06 req-5f759133-8a50-4ca5-8d33-81ad8551153b service nova] Acquiring lock "c868ea1c-0c1c-4470-b125-0a7a76d96c4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:43 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-ad099d88-e5ec-4f9b-96f6-652b9153ba06 req-5f759133-8a50-4ca5-8d33-81ad8551153b service nova] Lock "c868ea1c-0c1c-4470-b125-0a7a76d96c4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:43 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-ad099d88-e5ec-4f9b-96f6-652b9153ba06 req-5f759133-8a50-4ca5-8d33-81ad8551153b service nova] Lock "c868ea1c-0c1c-4470-b125-0a7a76d96c4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:43 user nova-compute[74247]: DEBUG nova.compute.manager [req-ad099d88-e5ec-4f9b-96f6-652b9153ba06 req-5f759133-8a50-4ca5-8d33-81ad8551153b service nova] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] No waiting events found dispatching network-vif-plugged-e9ecd4e6-2676-47b4-baf8-d8f68156007d {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:24:43 user nova-compute[74247]: WARNING nova.compute.manager [req-ad099d88-e5ec-4f9b-96f6-652b9153ba06 req-5f759133-8a50-4ca5-8d33-81ad8551153b service nova] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Received unexpected event network-vif-plugged-e9ecd4e6-2676-47b4-baf8-d8f68156007d for instance with vm_state building and task_state spawning.
Oct 16 18:24:43 user nova-compute[74247]: DEBUG nova.compute.manager [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:24:43 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:24:44 user nova-compute[74247]: DEBUG nova.compute.manager [req-3eaf044a-4d03-478f-b6f2-b4a903759afe req-311c910a-34c1-4c24-8b27-e1f23f9b19c0 service nova] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Received event network-vif-plugged-9f035e65-b642-4b32-a5b2-1e82808c6ccc {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:24:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3eaf044a-4d03-478f-b6f2-b4a903759afe req-311c910a-34c1-4c24-8b27-e1f23f9b19c0 service nova] Acquiring lock "ff1e2d26-57c5-4aa1-b66f-3ead29571b7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3eaf044a-4d03-478f-b6f2-b4a903759afe req-311c910a-34c1-4c24-8b27-e1f23f9b19c0 service nova] Lock "ff1e2d26-57c5-4aa1-b66f-3ead29571b7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3eaf044a-4d03-478f-b6f2-b4a903759afe req-311c910a-34c1-4c24-8b27-e1f23f9b19c0 service nova] Lock "ff1e2d26-57c5-4aa1-b66f-3ead29571b7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:44 user nova-compute[74247]: DEBUG nova.compute.manager [req-3eaf044a-4d03-478f-b6f2-b4a903759afe req-311c910a-34c1-4c24-8b27-e1f23f9b19c0 service nova] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] No waiting events found dispatching network-vif-plugged-9f035e65-b642-4b32-a5b2-1e82808c6ccc {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:24:44 user nova-compute[74247]: WARNING nova.compute.manager [req-3eaf044a-4d03-478f-b6f2-b4a903759afe req-311c910a-34c1-4c24-8b27-e1f23f9b19c0 service nova] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Received unexpected event network-vif-plugged-9f035e65-b642-4b32-a5b2-1e82808c6ccc for instance with vm_state active and task_state None.
Oct 16 18:24:44 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Instance spawned successfully.
Oct 16 18:24:44 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 18:24:44 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:44 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:44 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:44 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:44 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:44 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:24:44 user nova-compute[74247]: INFO nova.compute.manager [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Took 6.28 seconds to spawn the instance on the hypervisor.
Oct 16 18:24:44 user nova-compute[74247]: DEBUG nova.compute.manager [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:24:44 user nova-compute[74247]: INFO nova.compute.manager [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Took 7.39 seconds to build instance.
Oct 16 18:24:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-16298cab-0166-4b3e-b007-6c7043d97bf3 tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Lock "c868ea1c-0c1c-4470-b125-0a7a76d96c4d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.543s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:44 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:45 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:24:45 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Cleaning up deleted instances {{(pid=74247) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 16 18:24:45 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] There are 0 instances to clean {{(pid=74247) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 16 18:24:45 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:24:45 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Cleaning up deleted instances with incomplete migration  {{(pid=74247) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 16 18:24:45 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:24:46 user nova-compute[74247]: DEBUG nova.compute.manager [req-4bab6059-492a-4d67-b873-2088d644f961 req-5bef8c83-bb10-49b9-9c82-b6273b665ebd service nova] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Received event network-vif-plugged-9f035e65-b642-4b32-a5b2-1e82808c6ccc {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:24:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4bab6059-492a-4d67-b873-2088d644f961 req-5bef8c83-bb10-49b9-9c82-b6273b665ebd service nova] Acquiring lock "ff1e2d26-57c5-4aa1-b66f-3ead29571b7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4bab6059-492a-4d67-b873-2088d644f961 req-5bef8c83-bb10-49b9-9c82-b6273b665ebd service nova] Lock "ff1e2d26-57c5-4aa1-b66f-3ead29571b7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4bab6059-492a-4d67-b873-2088d644f961 req-5bef8c83-bb10-49b9-9c82-b6273b665ebd service nova] Lock "ff1e2d26-57c5-4aa1-b66f-3ead29571b7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:46 user nova-compute[74247]: DEBUG nova.compute.manager [req-4bab6059-492a-4d67-b873-2088d644f961 req-5bef8c83-bb10-49b9-9c82-b6273b665ebd service nova] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] No waiting events found dispatching network-vif-plugged-9f035e65-b642-4b32-a5b2-1e82808c6ccc {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:24:46 user nova-compute[74247]: WARNING nova.compute.manager [req-4bab6059-492a-4d67-b873-2088d644f961 req-5bef8c83-bb10-49b9-9c82-b6273b665ebd service nova] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Received unexpected event network-vif-plugged-9f035e65-b642-4b32-a5b2-1e82808c6ccc for instance with vm_state active and task_state None.
Oct 16 18:24:46 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:24:47 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:24:48 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:24:48 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 18:24:48 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Rebuilding the list of instances to heal {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 18:24:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "refresh_cache-b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:24:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquired lock "refresh_cache-b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:24:48 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Forcefully refreshing network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 18:24:48 user nova-compute[74247]: DEBUG nova.objects.instance [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lazy-loading 'info_cache' on Instance uuid b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:24:49 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Updating instance_info_cache with network_info: [{"id": "f4db2672-7205-43d7-ac3b-3f6ea5c336c6", "address": "fa:16:3e:5f:52:2e", "network": {"id": "f99cbf0c-7d0c-4ef8-934a-aaac218e9381", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2096188408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94e9d0485eec462990dd029379397962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4db2672-72", "ovs_interfaceid": "f4db2672-7205-43d7-ac3b-3f6ea5c336c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:24:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Releasing lock "refresh_cache-b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:24:49 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Updated the network info_cache for instance {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 18:24:49 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:24:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:50 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:24:50 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:24:50 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:24:50 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 18:24:50 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:24:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:50 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 18:24:50 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c868ea1c-0c1c-4470-b125-0a7a76d96c4d/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c868ea1c-0c1c-4470-b125-0a7a76d96c4d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c868ea1c-0c1c-4470-b125-0a7a76d96c4d/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c868ea1c-0c1c-4470-b125-0a7a76d96c4d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/738eb591-f3dc-4392-b8f2-41530d30ff58/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/738eb591-f3dc-4392-b8f2-41530d30ff58/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/738eb591-f3dc-4392-b8f2-41530d30ff58/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/738eb591-f3dc-4392-b8f2-41530d30ff58/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1e2d26-57c5-4aa1-b66f-3ead29571b7e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1e2d26-57c5-4aa1-b66f-3ead29571b7e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1e2d26-57c5-4aa1-b66f-3ead29571b7e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1e2d26-57c5-4aa1-b66f-3ead29571b7e/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4daa6370-2cdf-4668-b66b-e10196377c9c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4daa6370-2cdf-4668-b66b-e10196377c9c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4daa6370-2cdf-4668-b66b-e10196377c9c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4daa6370-2cdf-4668-b66b-e10196377c9c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:24:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:24:54 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:24:54 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:24:54 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=7554MB free_disk=25.512775421142578GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 18:24:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:24:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:24:54 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:54 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:24:54 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance e37fbc27-3404-479a-be08-4d590391cf30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:24:54 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 738eb591-f3dc-4392-b8f2-41530d30ff58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:24:54 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance a686ee86-272c-47be-8801-9c1500af272f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:24:54 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 4daa6370-2cdf-4668-b66b-e10196377c9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:24:54 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance c048698e-de64-4124-8d72-57fb819bb80e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:24:54 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance ff1e2d26-57c5-4aa1-b66f-3ead29571b7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:24:54 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance c868ea1c-0c1c-4470-b125-0a7a76d96c4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:24:54 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 18:24:54 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 18:24:54 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Refreshing inventories for resource provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 16 18:24:54 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Updating ProviderTree inventory for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 16 18:24:54 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Updating inventory in ProviderTree for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 16 18:24:54 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Refreshing aggregate associations for resource provider 7b8a7b7b-c686-4162-903b-700fbc4d7273, aggregates: None {{(pid=74247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 16 18:24:55 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Refreshing trait associations for resource provider 7b8a7b7b-c686-4162-903b-700fbc4d7273, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=74247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 16 18:24:55 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:24:55 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:24:55 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 18:24:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.951s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:24:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:24:58 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:24:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:25:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:25:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:25:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:25:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:25:10 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:25:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Acquiring lock "73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:25:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Lock "73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:25:14 user nova-compute[74247]: DEBUG nova.compute.manager [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 18:25:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:25:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:25:14 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:25:14 user nova-compute[74247]: INFO nova.compute.claims [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Claim successful on node user
Oct 16 18:25:14 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:25:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:25:14 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:25:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.503s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:25:14 user nova-compute[74247]: DEBUG nova.compute.manager [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 18:25:15 user nova-compute[74247]: DEBUG nova.compute.manager [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 18:25:15 user nova-compute[74247]: DEBUG nova.network.neutron [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 18:25:15 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 18:25:15 user nova-compute[74247]: DEBUG nova.compute.manager [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 18:25:15 user nova-compute[74247]: DEBUG nova.policy [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '493de9166585427c8714c5ba06c2ceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670a27f9af4f4b32a86386d343a0694b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 18:25:15 user nova-compute[74247]: INFO nova.virt.block_device [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Booting with volume 3ab08fda-c4e7-456c-8003-24c8bfb6c688 at /dev/vda
Oct 16 18:25:15 user nova-compute[74247]: DEBUG os_brick.utils [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:25:15 user nova-compute[74247]: INFO oslo.privsep.daemon [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp1rhnwdyi/privsep.sock']
Oct 16 18:25:15 user sudo[85123]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp1rhnwdyi/privsep.sock
Oct 16 18:25:15 user sudo[85123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 16 18:25:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:25:15 user nova-compute[74247]: DEBUG nova.network.neutron [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Successfully created port: 2f140983-b9a6-4fdd-a301-a9b42927c561 {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:25:16 user nova-compute[74247]: DEBUG nova.network.neutron [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Successfully updated port: 2f140983-b9a6-4fdd-a301-a9b42927c561 {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:25:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Acquiring lock "refresh_cache-73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:25:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Acquired lock "refresh_cache-73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:25:16 user nova-compute[74247]: DEBUG nova.network.neutron [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:25:16 user nova-compute[74247]: DEBUG nova.compute.manager [req-770eb296-d7a6-4789-8e69-4b6bb897a4a6 req-11d5fd07-ede4-4644-9419-9e02cbbaac56 service nova] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Received event network-changed-2f140983-b9a6-4fdd-a301-a9b42927c561 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:25:16 user nova-compute[74247]: DEBUG nova.compute.manager [req-770eb296-d7a6-4789-8e69-4b6bb897a4a6 req-11d5fd07-ede4-4644-9419-9e02cbbaac56 service nova] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Refreshing instance network info cache due to event network-changed-2f140983-b9a6-4fdd-a301-a9b42927c561. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:25:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-770eb296-d7a6-4789-8e69-4b6bb897a4a6 req-11d5fd07-ede4-4644-9419-9e02cbbaac56 service nova] Acquiring lock "refresh_cache-73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:25:16 user nova-compute[74247]: DEBUG nova.network.neutron [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:25:16 user sudo[85123]: pam_unix(sudo:session): session closed for user root
Oct 16 18:25:16 user nova-compute[74247]: INFO oslo.privsep.daemon [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Spawned new privsep daemon via rootwrap
Oct 16 18:25:16 user nova-compute[74247]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 16 18:25:16 user nova-compute[74247]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 16 18:25:16 user nova-compute[74247]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Oct 16 18:25:16 user nova-compute[74247]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85128
Oct 16 18:25:16 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cef5df-2873-4a45-8d05-3dcab1abb94c]: (2,) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:25:16 user nova-compute[74247]: DEBUG nova.network.neutron [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Updating instance_info_cache with network_info: [{"id": "2f140983-b9a6-4fdd-a301-a9b42927c561", "address": "fa:16:3e:a8:1a:a3", "network": {"id": "64ae2feb-5041-4479-a5a1-02e5ff636224", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-402083057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "670a27f9af4f4b32a86386d343a0694b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f140983-b9", "ovs_interfaceid": "2f140983-b9a6-4fdd-a301-a9b42927c561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:25:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Releasing lock "refresh_cache-73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:25:16 user nova-compute[74247]: DEBUG nova.compute.manager [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Instance network_info: |[{"id": "2f140983-b9a6-4fdd-a301-a9b42927c561", "address": "fa:16:3e:a8:1a:a3", "network": {"id": "64ae2feb-5041-4479-a5a1-02e5ff636224", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-402083057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "670a27f9af4f4b32a86386d343a0694b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f140983-b9", "ovs_interfaceid": "2f140983-b9a6-4fdd-a301-a9b42927c561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 18:25:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-770eb296-d7a6-4789-8e69-4b6bb897a4a6 req-11d5fd07-ede4-4644-9419-9e02cbbaac56 service nova] Acquired lock "refresh_cache-73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:25:16 user nova-compute[74247]: DEBUG nova.network.neutron [req-770eb296-d7a6-4789-8e69-4b6bb897a4a6 req-11d5fd07-ede4-4644-9419-9e02cbbaac56 service nova] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Refreshing network info cache for port 2f140983-b9a6-4fdd-a301-a9b42927c561 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:25:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:25:16 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d36d17-e6e8-4ad7-b692-61342ed432cb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:25:16 user nova-compute[74247]: WARNING os_brick.initiator.connectors.nvmeof [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Oct 16 18:25:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:25:16 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[415edb6c-8eab-477d-8def-1748d7b22c7f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:25:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:25:16 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49779be-f823-4398-afd8-b79f09e27094]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:25:16 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f23a56-bc31-4b7c-aec5-3115cbc45346]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:25:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:25:16 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 18:25:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:25:17 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 18:25:17 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c042c611-3a02-4855-9b27-6b55a4d1861f]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:25:17 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 18:25:17 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 18:25:17 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 18:25:17 user nova-compute[74247]: DEBUG os_brick.utils [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] <== get_connector_properties: return (1805ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:25:17 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Updating existing volume attachment record: 3db6247f-c543-4efe-8b0f-a55c2171b617 {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 18:25:17 user nova-compute[74247]: DEBUG nova.network.neutron [req-770eb296-d7a6-4789-8e69-4b6bb897a4a6 req-11d5fd07-ede4-4644-9419-9e02cbbaac56 service nova] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Updated VIF entry in instance network info cache for port 2f140983-b9a6-4fdd-a301-a9b42927c561. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:25:17 user nova-compute[74247]: DEBUG nova.network.neutron [req-770eb296-d7a6-4789-8e69-4b6bb897a4a6 req-11d5fd07-ede4-4644-9419-9e02cbbaac56 service nova] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Updating instance_info_cache with network_info: [{"id": "2f140983-b9a6-4fdd-a301-a9b42927c561", "address": "fa:16:3e:a8:1a:a3", "network": {"id": "64ae2feb-5041-4479-a5a1-02e5ff636224", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-402083057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "670a27f9af4f4b32a86386d343a0694b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f140983-b9", "ovs_interfaceid": "2f140983-b9a6-4fdd-a301-a9b42927c561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:25:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-770eb296-d7a6-4789-8e69-4b6bb897a4a6 req-11d5fd07-ede4-4644-9419-9e02cbbaac56 service nova] Releasing lock "refresh_cache-73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:25:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:25:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:25:29 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:25:33 user nova-compute[74247]: DEBUG nova.compute.manager [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 18:25:33 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:25:33 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Creating image(s)
Oct 16 18:25:33 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Did not create local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 18:25:33 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Ensure instance console log exists: /opt/stack/data/nova/instances/73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:25:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:25:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:25:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:25:33 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Start _get_guest_xml network_info=[{"id": "2f140983-b9a6-4fdd-a301-a9b42927c561", "address": "fa:16:3e:a8:1a:a3", "network": {"id": "64ae2feb-5041-4479-a5a1-02e5ff636224", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-402083057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "670a27f9af4f4b32a86386d343a0694b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f140983-b9", "ovs_interfaceid": "2f140983-b9a6-4fdd-a301-a9b42927c561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fsdpBahK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b', 'attached_at': '', 'detached_at': '', 'volume_id': '3ab08fda-c4e7-456c-8003-24c8bfb6c688', 'serial': '3ab08fda-c4e7-456c-8003-24c8bfb6c688'}, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '3db6247f-c543-4efe-8b0f-a55c2171b617', 'guest_format': None, 'volume_type': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:25:33 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:25:33 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:25:33 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:25:33 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:25:33 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:25:33 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:25:33 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:25:33 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:25:33 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:25:33 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:25:33 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:25:33 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:25:33 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:25:33 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:25:33 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:25:33 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:25:33 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:25:33 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:25:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:25:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:25:33 user nova-compute[74247]: DEBUG os_brick.initiator.connector [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Factory for ISCSI on None {{(pid=74247) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Oct 16 18:25:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.004s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:25:33 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:25:33 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fsdpBahK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:25:33 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:25:33 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:25:33 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:25:33 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:25:33 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:25:33 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:25:33 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:25:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:25:33 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c71f0ed-1993-4971-9ef8-d8a7f8f2c641]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:25:33 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 18:25:33 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:25:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:25:33 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3e8a66-54bb-4cfd-b8e3-f97f749bae31]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:25:33 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688] added
Oct 16 18:25:33 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:25:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:25:34 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5275da20-1279-40cc-a28e-6add94333d54]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:25:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:25:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:25:34 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc1fdba-8147-4b36-baef-65dcad1fc78c]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:25:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:25:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fsdpBahK {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fsdpBahK" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:25:34 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8462a773-579e-42db-b3a5-acfc51bcb685]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:25:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fsdpBahK'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:25:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:25:34 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab6e58e-aff4-49cc-a41a-98301962c0cd]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:25:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:25:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:25:34 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[669ab3f0-dbe9-4ec6-a7b0-443d5a0132c9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:25:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 16 18:25:34 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:25:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 16 18:25:34 user nova-compute[74247]:  {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:25:34 user nova-compute[74247]: WARNING os_brick.initiator.connectors.iscsi [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 16 18:25:34 user nova-compute[74247]: 
Oct 16 18:25:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:25:34 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a600e0be-5d3c-41f5-905c-dc9e0b264f25]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:25:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688, portal: 172.16.0.220,3260]
Oct 16 18:25:34 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688, portal: 172.16.0.220,3260] successful.
Oct 16 18:25:34 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:25:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:25:34 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[29016534-5e6d-43ac-8c16-9bebba5590db]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:25:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:25:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:25:34 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6130c570-4e22-4cbb-b36c-2b9e6da8ad7f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:25:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)
Oct 16 18:25:34 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:25:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)
Oct 16 18:25:34 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:25:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:25:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:25:34 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:25:34 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:25:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:25:34 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ddab0e-34e9-40db-9dc4-511a8fb29c21]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:25:34 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:25:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fsdpBahK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:25:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:25:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:25:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23835623533313633', 'path': '/dev/sdb'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:25:35 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835623533313633', 'path': '/dev/sdb'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:25:35 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:25:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-413859192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-413859192',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEogCyeuhbzTI40G7oRGcfQg1ZDIdQQs+E8Zqfgq6jVx7RJjmhFUF8Of7DSwnrttqR/RrY35HAlR9+flGO4UILfkJp/XvsGQTltIdbBTBZgqMx2HchODLVDJxQEAyvBXA==',key_name='tempest-keypair-1699437087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='670a27f9af4f4b32a86386d343a0694b',ramdisk_id='',reservation_id='r-5j8o190g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1771639004',owner_user_name='tempest-ServerActionsV293TestJSON-1771639004-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:25:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='493de9166585427c8714c5ba06c2ceec',uuid=73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f140983-b9a6-4fdd-a301-a9b42927c561", "address": "fa:16:3e:a8:1a:a3", "network": {"id": "64ae2feb-5041-4479-a5a1-02e5ff636224", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-402083057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "670a27f9af4f4b32a86386d343a0694b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f140983-b9", "ovs_interfaceid": "2f140983-b9a6-4fdd-a301-a9b42927c561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:25:35 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Converting VIF {"id": "2f140983-b9a6-4fdd-a301-a9b42927c561", "address": "fa:16:3e:a8:1a:a3", "network": {"id": "64ae2feb-5041-4479-a5a1-02e5ff636224", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-402083057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "670a27f9af4f4b32a86386d343a0694b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f140983-b9", "ovs_interfaceid": "2f140983-b9a6-4fdd-a301-a9b42927c561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:25:35 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:1a:a3,bridge_name='br-int',has_traffic_filtering=True,id=2f140983-b9a6-4fdd-a301-a9b42927c561,network=Network(64ae2feb-5041-4479-a5a1-02e5ff636224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f140983-b9') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:25:35 user nova-compute[74247]: DEBUG nova.objects.instance [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Lazy-loading 'pci_devices' on Instance uuid 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:25:35 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:25:35 user nova-compute[74247]:   <uuid>73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b</uuid>
Oct 16 18:25:35 user nova-compute[74247]:   <name>instance-00000009</name>
Oct 16 18:25:35 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:25:35 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:25:35 user nova-compute[74247]:   <metadata>
Oct 16 18:25:35 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:25:35 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:25:35 user nova-compute[74247]:       <nova:name>tempest-ServerActionsV293TestJSON-server-413859192</nova:name>
Oct 16 18:25:35 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:25:33</nova:creationTime>
Oct 16 18:25:35 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:25:35 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:25:35 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:25:35 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:25:35 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:25:35 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:25:35 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:25:35 user nova-compute[74247]:       <nova:owner>
Oct 16 18:25:35 user nova-compute[74247]:         <nova:user uuid="493de9166585427c8714c5ba06c2ceec">tempest-ServerActionsV293TestJSON-1771639004-project-member</nova:user>
Oct 16 18:25:35 user nova-compute[74247]:         <nova:project uuid="670a27f9af4f4b32a86386d343a0694b">tempest-ServerActionsV293TestJSON-1771639004</nova:project>
Oct 16 18:25:35 user nova-compute[74247]:       </nova:owner>
Oct 16 18:25:35 user nova-compute[74247]:       <nova:ports>
Oct 16 18:25:35 user nova-compute[74247]:         <nova:port uuid="2f140983-b9a6-4fdd-a301-a9b42927c561">
Oct 16 18:25:35 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 16 18:25:35 user nova-compute[74247]:         </nova:port>
Oct 16 18:25:35 user nova-compute[74247]:       </nova:ports>
Oct 16 18:25:35 user nova-compute[74247]:     </nova:instance>
Oct 16 18:25:35 user nova-compute[74247]:   </metadata>
Oct 16 18:25:35 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:25:35 user nova-compute[74247]:     <system>
Oct 16 18:25:35 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:25:35 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:25:35 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:25:35 user nova-compute[74247]:       <entry name="serial">73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b</entry>
Oct 16 18:25:35 user nova-compute[74247]:       <entry name="uuid">73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b</entry>
Oct 16 18:25:35 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:25:35 user nova-compute[74247]:     </system>
Oct 16 18:25:35 user nova-compute[74247]:   </sysinfo>
Oct 16 18:25:35 user nova-compute[74247]:   <os>
Oct 16 18:25:35 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:25:35 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:25:35 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:25:35 user nova-compute[74247]:   </os>
Oct 16 18:25:35 user nova-compute[74247]:   <features>
Oct 16 18:25:35 user nova-compute[74247]:     <acpi/>
Oct 16 18:25:35 user nova-compute[74247]:     <apic/>
Oct 16 18:25:35 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:25:35 user nova-compute[74247]:   </features>
Oct 16 18:25:35 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:25:35 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:25:35 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:25:35 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:25:35 user nova-compute[74247]:   </clock>
Oct 16 18:25:35 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:25:35 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:25:35 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:25:35 user nova-compute[74247]:   </cpu>
Oct 16 18:25:35 user nova-compute[74247]:   <devices>
Oct 16 18:25:35 user nova-compute[74247]:     <disk type="block" device="disk">
Oct 16 18:25:35 user nova-compute[74247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:25:35 user nova-compute[74247]:       <source dev="/dev/sdb"/>
Oct 16 18:25:35 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:25:35 user nova-compute[74247]:       <serial>3ab08fda-c4e7-456c-8003-24c8bfb6c688</serial>
Oct 16 18:25:35 user nova-compute[74247]:     </disk>
Oct 16 18:25:35 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:25:35 user nova-compute[74247]:       <mac address="fa:16:3e:a8:1a:a3"/>
Oct 16 18:25:35 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:25:35 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:25:35 user nova-compute[74247]:       <target dev="tap2f140983-b9"/>
Oct 16 18:25:35 user nova-compute[74247]:     </interface>
Oct 16 18:25:35 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:25:35 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b/console.log" append="off"/>
Oct 16 18:25:35 user nova-compute[74247]:     </serial>
Oct 16 18:25:35 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:25:35 user nova-compute[74247]:     <video>
Oct 16 18:25:35 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:25:35 user nova-compute[74247]:     </video>
Oct 16 18:25:35 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:25:35 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:25:35 user nova-compute[74247]:     </rng>
Oct 16 18:25:35 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:25:35 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:25:35 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:25:35 user nova-compute[74247]:     </memballoon>
Oct 16 18:25:35 user nova-compute[74247]:   </devices>
Oct 16 18:25:35 user nova-compute[74247]: </domain>
Oct 16 18:25:35 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:25:35 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:25:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-413859192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-413859192',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEogCyeuhbzTI40G7oRGcfQg1ZDIdQQs+E8Zqfgq6jVx7RJjmhFUF8Of7DSwnrttqR/RrY35HAlR9+flGO4UILfkJp/XvsGQTltIdbBTBZgqMx2HchODLVDJxQEAyvBXA==',key_name='tempest-keypair-1699437087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='670a27f9af4f4b32a86386d343a0694b',ramdisk_id='',reservation_id='r-5j8o190g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1771639004',owner_user_name='tempest-ServerActionsV293TestJSON-1771639004-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:25:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='493de9166585427c8714c5ba06c2ceec',uuid=73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f140983-b9a6-4fdd-a301-a9b42927c561", "address": "fa:16:3e:a8:1a:a3", "network": {"id": "64ae2feb-5041-4479-a5a1-02e5ff636224", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-402083057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "670a27f9af4f4b32a86386d343a0694b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f140983-b9", "ovs_interfaceid": "2f140983-b9a6-4fdd-a301-a9b42927c561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:25:35 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Converting VIF {"id": "2f140983-b9a6-4fdd-a301-a9b42927c561", "address": "fa:16:3e:a8:1a:a3", "network": {"id": "64ae2feb-5041-4479-a5a1-02e5ff636224", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-402083057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "670a27f9af4f4b32a86386d343a0694b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f140983-b9", "ovs_interfaceid": "2f140983-b9a6-4fdd-a301-a9b42927c561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:25:35 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:1a:a3,bridge_name='br-int',has_traffic_filtering=True,id=2f140983-b9a6-4fdd-a301-a9b42927c561,network=Network(64ae2feb-5041-4479-a5a1-02e5ff636224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f140983-b9') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:25:35 user nova-compute[74247]: DEBUG os_vif [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:1a:a3,bridge_name='br-int',has_traffic_filtering=True,id=2f140983-b9a6-4fdd-a301-a9b42927c561,network=Network(64ae2feb-5041-4479-a5a1-02e5ff636224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f140983-b9') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:25:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:25:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:25:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:25:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:25:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2c7a9523-431b-5399-a2a5-9c4e77d72d5b', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:25:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:25:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:25:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:25:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f140983-b9, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:25:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2f140983-b9, col_values=(('qos', UUID('46532f3d-2e8a-4028-9166-382588807c75')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:25:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2f140983-b9, col_values=(('external_ids', {'iface-id': '2f140983-b9a6-4fdd-a301-a9b42927c561', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:1a:a3', 'vm-uuid': '73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:25:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:25:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:25:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:25:35 user nova-compute[74247]: INFO os_vif [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:1a:a3,bridge_name='br-int',has_traffic_filtering=True,id=2f140983-b9a6-4fdd-a301-a9b42927c561,network=Network(64ae2feb-5041-4479-a5a1-02e5ff636224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f140983-b9')
Oct 16 18:25:35 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:25:35 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] No VIF found with MAC fa:16:3e:a8:1a:a3, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:25:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:25:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:25:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:25:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:25:36 user nova-compute[74247]: DEBUG nova.compute.manager [req-9b389c67-c8a2-439a-b86e-46df7eafc9c3 req-bceec57f-4a95-4d87-9bf4-4da78814fbe9 service nova] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Received event network-vif-plugged-2f140983-b9a6-4fdd-a301-a9b42927c561 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:25:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9b389c67-c8a2-439a-b86e-46df7eafc9c3 req-bceec57f-4a95-4d87-9bf4-4da78814fbe9 service nova] Acquiring lock "73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:25:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9b389c67-c8a2-439a-b86e-46df7eafc9c3 req-bceec57f-4a95-4d87-9bf4-4da78814fbe9 service nova] Lock "73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:25:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9b389c67-c8a2-439a-b86e-46df7eafc9c3 req-bceec57f-4a95-4d87-9bf4-4da78814fbe9 service nova] Lock "73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:25:36 user nova-compute[74247]: DEBUG nova.compute.manager [req-9b389c67-c8a2-439a-b86e-46df7eafc9c3 req-bceec57f-4a95-4d87-9bf4-4da78814fbe9 service nova] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] No waiting events found dispatching network-vif-plugged-2f140983-b9a6-4fdd-a301-a9b42927c561 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:25:36 user nova-compute[74247]: WARNING nova.compute.manager [req-9b389c67-c8a2-439a-b86e-46df7eafc9c3 req-bceec57f-4a95-4d87-9bf4-4da78814fbe9 service nova] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Received unexpected event network-vif-plugged-2f140983-b9a6-4fdd-a301-a9b42927c561 for instance with vm_state building and task_state spawning.
Oct 16 18:25:37 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:25:37 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:25:37 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:25:38 user nova-compute[74247]: DEBUG nova.compute.manager [req-10f0b4e9-bf99-4837-b8cb-41a08ac3b888 req-e7fae6b5-af95-4b8e-820f-8736f6e071cb service nova] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Received event network-vif-plugged-2f140983-b9a6-4fdd-a301-a9b42927c561 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:25:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-10f0b4e9-bf99-4837-b8cb-41a08ac3b888 req-e7fae6b5-af95-4b8e-820f-8736f6e071cb service nova] Acquiring lock "73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:25:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-10f0b4e9-bf99-4837-b8cb-41a08ac3b888 req-e7fae6b5-af95-4b8e-820f-8736f6e071cb service nova] Lock "73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:25:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-10f0b4e9-bf99-4837-b8cb-41a08ac3b888 req-e7fae6b5-af95-4b8e-820f-8736f6e071cb service nova] Lock "73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:25:38 user nova-compute[74247]: DEBUG nova.compute.manager [req-10f0b4e9-bf99-4837-b8cb-41a08ac3b888 req-e7fae6b5-af95-4b8e-820f-8736f6e071cb service nova] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] No waiting events found dispatching network-vif-plugged-2f140983-b9a6-4fdd-a301-a9b42927c561 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:25:38 user nova-compute[74247]: WARNING nova.compute.manager [req-10f0b4e9-bf99-4837-b8cb-41a08ac3b888 req-e7fae6b5-af95-4b8e-820f-8736f6e071cb service nova] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Received unexpected event network-vif-plugged-2f140983-b9a6-4fdd-a301-a9b42927c561 for instance with vm_state building and task_state spawning.
Oct 16 18:25:38 user nova-compute[74247]: DEBUG nova.compute.manager [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:25:38 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:25:38 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Instance spawned successfully.
Oct 16 18:25:38 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 18:25:39 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:25:39 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:25:39 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:25:39 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:25:39 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:25:39 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:25:39 user nova-compute[74247]: INFO nova.compute.manager [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Took 5.23 seconds to spawn the instance on the hypervisor.
Oct 16 18:25:39 user nova-compute[74247]: DEBUG nova.compute.manager [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:25:39 user nova-compute[74247]: INFO nova.compute.manager [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Took 24.80 seconds to build instance.
Oct 16 18:25:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3bc5d5f3-3652-47be-be0e-e671e7152b9d tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Lock "73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.921s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:25:40 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:25:40 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:25:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:25:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Acquiring lock "67a48117-6273-46b7-a14b-5cc2e27847c7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:25:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Lock "67a48117-6273-46b7-a14b-5cc2e27847c7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:25:46 user nova-compute[74247]: DEBUG nova.compute.manager [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 18:25:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:25:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:25:46 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:25:46 user nova-compute[74247]: INFO nova.compute.claims [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Claim successful on node user
Oct 16 18:25:46 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:25:46 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:25:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Acquiring lock "2a7c7eac-216c-4920-ba10-09a06ce90670" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:25:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Lock "2a7c7eac-216c-4920-ba10-09a06ce90670" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:25:46 user nova-compute[74247]: DEBUG nova.compute.manager [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 18:25:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.526s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:25:46 user nova-compute[74247]: DEBUG nova.compute.manager [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 18:25:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:25:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:25:46 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:25:46 user nova-compute[74247]: INFO nova.compute.claims [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Claim successful on node user
Oct 16 18:25:46 user nova-compute[74247]: DEBUG nova.compute.manager [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 18:25:46 user nova-compute[74247]: DEBUG nova.network.neutron [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 18:25:46 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 18:25:47 user nova-compute[74247]: DEBUG nova.compute.manager [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 18:25:47 user nova-compute[74247]: DEBUG nova.policy [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c82a90fcbed4a38b4f69a18de607f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e9d0485eec462990dd029379397962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 18:25:47 user nova-compute[74247]: DEBUG nova.compute.manager [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 18:25:47 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:25:47 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Creating image(s)
Oct 16 18:25:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Acquiring lock "/opt/stack/data/nova/instances/67a48117-6273-46b7-a14b-5cc2e27847c7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:25:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Lock "/opt/stack/data/nova/instances/67a48117-6273-46b7-a14b-5cc2e27847c7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:25:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Lock "/opt/stack/data/nova/instances/67a48117-6273-46b7-a14b-5cc2e27847c7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:25:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:47 user nova-compute[74247]: DEBUG nova.compute.manager [req-483e7ffa-2825-4d0a-b832-1755690b84e9 req-c15488e5-a515-4b3e-800b-fcc8ea1636d2 service nova] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Received event network-changed-634511f9-ce96-4fe6-8bfc-51846e4dcb4f {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:25:47 user nova-compute[74247]: DEBUG nova.compute.manager [req-483e7ffa-2825-4d0a-b832-1755690b84e9 req-c15488e5-a515-4b3e-800b-fcc8ea1636d2 service nova] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Refreshing instance network info cache due to event network-changed-634511f9-ce96-4fe6-8bfc-51846e4dcb4f. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:25:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-483e7ffa-2825-4d0a-b832-1755690b84e9 req-c15488e5-a515-4b3e-800b-fcc8ea1636d2 service nova] Acquiring lock "refresh_cache-e37fbc27-3404-479a-be08-4d590391cf30" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:25:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-483e7ffa-2825-4d0a-b832-1755690b84e9 req-c15488e5-a515-4b3e-800b-fcc8ea1636d2 service nova] Acquired lock "refresh_cache-e37fbc27-3404-479a-be08-4d590391cf30" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:25:47 user nova-compute[74247]: DEBUG nova.network.neutron [req-483e7ffa-2825-4d0a-b832-1755690b84e9 req-c15488e5-a515-4b3e-800b-fcc8ea1636d2 service nova] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Refreshing network info cache for port 634511f9-ce96-4fe6-8bfc-51846e4dcb4f {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:25:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.195s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:25:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Acquiring lock "37399febbd18f60b85fd0f833558f6a3539ab231" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:25:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:25:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:47 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:25:47 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:25:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.659s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:25:47 user nova-compute[74247]: DEBUG nova.compute.manager [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 18:25:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.223s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:25:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/67a48117-6273-46b7-a14b-5cc2e27847c7/disk 1073741824 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/67a48117-6273-46b7-a14b-5cc2e27847c7/disk 1073741824" returned: 0 in 0.086s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:25:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.319s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:25:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:47 user nova-compute[74247]: DEBUG nova.compute.manager [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 18:25:47 user nova-compute[74247]: DEBUG nova.network.neutron [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 18:25:47 user nova-compute[74247]: DEBUG nova.network.neutron [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Successfully created port: 01255990-d759-4061-9b3e-967def280d73 {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:25:47 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 18:25:47 user nova-compute[74247]: DEBUG nova.compute.manager [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 18:25:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.218s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:25:47 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Checking if we can resize image /opt/stack/data/nova/instances/67a48117-6273-46b7-a14b-5cc2e27847c7/disk. size=1073741824 {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 18:25:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67a48117-6273-46b7-a14b-5cc2e27847c7/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:47 user nova-compute[74247]: INFO nova.virt.block_device [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Booting with volume fb4857db-f30c-4dc5-9bab-a55a8e551f70 at /dev/vda
Oct 16 18:25:48 user nova-compute[74247]: DEBUG nova.network.neutron [req-483e7ffa-2825-4d0a-b832-1755690b84e9 req-c15488e5-a515-4b3e-800b-fcc8ea1636d2 service nova] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Updated VIF entry in instance network info cache for port 634511f9-ce96-4fe6-8bfc-51846e4dcb4f. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG nova.network.neutron [req-483e7ffa-2825-4d0a-b832-1755690b84e9 req-c15488e5-a515-4b3e-800b-fcc8ea1636d2 service nova] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Updating instance_info_cache with network_info: [{"id": "634511f9-ce96-4fe6-8bfc-51846e4dcb4f", "address": "fa:16:3e:d2:d2:f4", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634511f9-ce", "ovs_interfaceid": "634511f9-ce96-4fe6-8bfc-51846e4dcb4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG nova.policy [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6157f67de9cf484c9d609fdae827b409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d12d8898a467cabcfe75d9a7993e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-483e7ffa-2825-4d0a-b832-1755690b84e9 req-c15488e5-a515-4b3e-800b-fcc8ea1636d2 service nova] Releasing lock "refresh_cache-e37fbc27-3404-479a-be08-4d590391cf30" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG os_brick.utils [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4ff69d-13b1-4bae-b00e-5d1404002df7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e088a8-335a-46eb-afa4-1aee1c66e387]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67a48117-6273-46b7-a14b-5cc2e27847c7/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Cannot resize image /opt/stack/data/nova/instances/67a48117-6273-46b7-a14b-5cc2e27847c7/disk to a smaller size. {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Ensure instance console log exists: /opt/stack/data/nova/instances/67a48117-6273-46b7-a14b-5cc2e27847c7/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8705a46-ba61-4603-b725-865538833a0f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04d455d-6690-437d-bc9f-1f4682002e43]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:25:48 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 18:25:48 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ea813e-c707-451c-b43c-83fbf522fadd]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG os_brick.utils [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Updating existing volume attachment record: 504d5fac-0bb8-44ee-a81d-dc865994fc11 {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG nova.network.neutron [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Successfully updated port: 01255990-d759-4061-9b3e-967def280d73 {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Acquiring lock "refresh_cache-67a48117-6273-46b7-a14b-5cc2e27847c7" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Acquired lock "refresh_cache-67a48117-6273-46b7-a14b-5cc2e27847c7" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG nova.network.neutron [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG nova.compute.manager [req-348f665d-4566-4521-9925-a1dcee501ca8 req-49116d03-6b89-4371-8fa7-d976a1896c0f service nova] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Received event network-changed-01255990-d759-4061-9b3e-967def280d73 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG nova.compute.manager [req-348f665d-4566-4521-9925-a1dcee501ca8 req-49116d03-6b89-4371-8fa7-d976a1896c0f service nova] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Refreshing instance network info cache due to event network-changed-01255990-d759-4061-9b3e-967def280d73. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-348f665d-4566-4521-9925-a1dcee501ca8 req-49116d03-6b89-4371-8fa7-d976a1896c0f service nova] Acquiring lock "refresh_cache-67a48117-6273-46b7-a14b-5cc2e27847c7" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG nova.network.neutron [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "refresh_cache-e37fbc27-3404-479a-be08-4d590391cf30" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquired lock "refresh_cache-e37fbc27-3404-479a-be08-4d590391cf30" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Forcefully refreshing network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG nova.network.neutron [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Updating instance_info_cache with network_info: [{"id": "01255990-d759-4061-9b3e-967def280d73", "address": "fa:16:3e:5b:48:b4", "network": {"id": "f99cbf0c-7d0c-4ef8-934a-aaac218e9381", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2096188408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94e9d0485eec462990dd029379397962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01255990-d7", "ovs_interfaceid": "01255990-d759-4061-9b3e-967def280d73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Releasing lock "refresh_cache-67a48117-6273-46b7-a14b-5cc2e27847c7" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG nova.compute.manager [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Instance network_info: |[{"id": "01255990-d759-4061-9b3e-967def280d73", "address": "fa:16:3e:5b:48:b4", "network": {"id": "f99cbf0c-7d0c-4ef8-934a-aaac218e9381", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2096188408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94e9d0485eec462990dd029379397962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01255990-d7", "ovs_interfaceid": "01255990-d759-4061-9b3e-967def280d73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-348f665d-4566-4521-9925-a1dcee501ca8 req-49116d03-6b89-4371-8fa7-d976a1896c0f service nova] Acquired lock "refresh_cache-67a48117-6273-46b7-a14b-5cc2e27847c7" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG nova.network.neutron [req-348f665d-4566-4521-9925-a1dcee501ca8 req-49116d03-6b89-4371-8fa7-d976a1896c0f service nova] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Refreshing network info cache for port 01255990-d759-4061-9b3e-967def280d73 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Start _get_guest_xml network_info=[{"id": "01255990-d759-4061-9b3e-967def280d73", "address": "fa:16:3e:5b:48:b4", "network": {"id": "f99cbf0c-7d0c-4ef8-934a-aaac218e9381", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2096188408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94e9d0485eec462990dd029379397962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01255990-d7", "ovs_interfaceid": "01255990-d759-4061-9b3e-967def280d73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': '83126bb1-29f5-42fe-8620-72ab0797f776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG nova.network.neutron [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Successfully created port: 1b75991c-526f-4cbc-a6f1-6a54d998d217 {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:25:48 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:25:48 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:25:48 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:25:48 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:25:49 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:25:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-322704963',display_name='tempest-ServersNegativeTestJSON-server-322704963',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-322704963',id=10,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94e9d0485eec462990dd029379397962',ramdisk_id='',reservation_id='r-sfpwxr0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1696683961',owner_user_name='tempest-ServersNegativeTestJSON-1696683961-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:25:47Z,user_data=None,user_id='8c82a90fcbed4a38b4f69a18de607f1f',uuid=67a48117-6273-46b7-a14b-5cc2e27847c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01255990-d759-4061-9b3e-967def280d73", "address": "fa:16:3e:5b:48:b4", "network": {"id": "f99cbf0c-7d0c-4ef8-934a-aaac218e9381", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2096188408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94e9d0485eec462990dd029379397962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01255990-d7", "ovs_interfaceid": "01255990-d759-4061-9b3e-967def280d73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:25:49 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Converting VIF {"id": "01255990-d759-4061-9b3e-967def280d73", "address": "fa:16:3e:5b:48:b4", "network": {"id": "f99cbf0c-7d0c-4ef8-934a-aaac218e9381", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2096188408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94e9d0485eec462990dd029379397962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01255990-d7", "ovs_interfaceid": "01255990-d759-4061-9b3e-967def280d73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:25:49 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:48:b4,bridge_name='br-int',has_traffic_filtering=True,id=01255990-d759-4061-9b3e-967def280d73,network=Network(f99cbf0c-7d0c-4ef8-934a-aaac218e9381),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01255990-d7') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:25:49 user nova-compute[74247]: DEBUG nova.objects.instance [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Lazy-loading 'pci_devices' on Instance uuid 67a48117-6273-46b7-a14b-5cc2e27847c7 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:25:49 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:25:49 user nova-compute[74247]:   <uuid>67a48117-6273-46b7-a14b-5cc2e27847c7</uuid>
Oct 16 18:25:49 user nova-compute[74247]:   <name>instance-0000000a</name>
Oct 16 18:25:49 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:25:49 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:25:49 user nova-compute[74247]:   <metadata>
Oct 16 18:25:49 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:25:49 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:25:49 user nova-compute[74247]:       <nova:name>tempest-ServersNegativeTestJSON-server-322704963</nova:name>
Oct 16 18:25:49 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:25:48</nova:creationTime>
Oct 16 18:25:49 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:25:49 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:25:49 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:25:49 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:25:49 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:25:49 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:25:49 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:25:49 user nova-compute[74247]:       <nova:owner>
Oct 16 18:25:49 user nova-compute[74247]:         <nova:user uuid="8c82a90fcbed4a38b4f69a18de607f1f">tempest-ServersNegativeTestJSON-1696683961-project-member</nova:user>
Oct 16 18:25:49 user nova-compute[74247]:         <nova:project uuid="94e9d0485eec462990dd029379397962">tempest-ServersNegativeTestJSON-1696683961</nova:project>
Oct 16 18:25:49 user nova-compute[74247]:       </nova:owner>
Oct 16 18:25:49 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:25:49 user nova-compute[74247]:       <nova:ports>
Oct 16 18:25:49 user nova-compute[74247]:         <nova:port uuid="01255990-d759-4061-9b3e-967def280d73">
Oct 16 18:25:49 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 16 18:25:49 user nova-compute[74247]:         </nova:port>
Oct 16 18:25:49 user nova-compute[74247]:       </nova:ports>
Oct 16 18:25:49 user nova-compute[74247]:     </nova:instance>
Oct 16 18:25:49 user nova-compute[74247]:   </metadata>
Oct 16 18:25:49 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:25:49 user nova-compute[74247]:     <system>
Oct 16 18:25:49 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:25:49 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:25:49 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:25:49 user nova-compute[74247]:       <entry name="serial">67a48117-6273-46b7-a14b-5cc2e27847c7</entry>
Oct 16 18:25:49 user nova-compute[74247]:       <entry name="uuid">67a48117-6273-46b7-a14b-5cc2e27847c7</entry>
Oct 16 18:25:49 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:25:49 user nova-compute[74247]:     </system>
Oct 16 18:25:49 user nova-compute[74247]:   </sysinfo>
Oct 16 18:25:49 user nova-compute[74247]:   <os>
Oct 16 18:25:49 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:25:49 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:25:49 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:25:49 user nova-compute[74247]:   </os>
Oct 16 18:25:49 user nova-compute[74247]:   <features>
Oct 16 18:25:49 user nova-compute[74247]:     <acpi/>
Oct 16 18:25:49 user nova-compute[74247]:     <apic/>
Oct 16 18:25:49 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:25:49 user nova-compute[74247]:   </features>
Oct 16 18:25:49 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:25:49 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:25:49 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:25:49 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:25:49 user nova-compute[74247]:   </clock>
Oct 16 18:25:49 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:25:49 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:25:49 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:25:49 user nova-compute[74247]:   </cpu>
Oct 16 18:25:49 user nova-compute[74247]:   <devices>
Oct 16 18:25:49 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:25:49 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:25:49 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/67a48117-6273-46b7-a14b-5cc2e27847c7/disk"/>
Oct 16 18:25:49 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:25:49 user nova-compute[74247]:     </disk>
Oct 16 18:25:49 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:25:49 user nova-compute[74247]:       <mac address="fa:16:3e:5b:48:b4"/>
Oct 16 18:25:49 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:25:49 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:25:49 user nova-compute[74247]:       <target dev="tap01255990-d7"/>
Oct 16 18:25:49 user nova-compute[74247]:     </interface>
Oct 16 18:25:49 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:25:49 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/67a48117-6273-46b7-a14b-5cc2e27847c7/console.log" append="off"/>
Oct 16 18:25:49 user nova-compute[74247]:     </serial>
Oct 16 18:25:49 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:25:49 user nova-compute[74247]:     <video>
Oct 16 18:25:49 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:25:49 user nova-compute[74247]:     </video>
Oct 16 18:25:49 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:25:49 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:25:49 user nova-compute[74247]:     </rng>
Oct 16 18:25:49 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:25:49 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:25:49 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:25:49 user nova-compute[74247]:     </memballoon>
Oct 16 18:25:49 user nova-compute[74247]:   </devices>
Oct 16 18:25:49 user nova-compute[74247]: </domain>
Oct 16 18:25:49 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:25:49 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:25:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-322704963',display_name='tempest-ServersNegativeTestJSON-server-322704963',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-322704963',id=10,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94e9d0485eec462990dd029379397962',ramdisk_id='',reservation_id='r-sfpwxr0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1696683961',owner_user_name='tempest-ServersNegativeTestJSON-1696683961-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:25:47Z,user_data=None,user_id='8c82a90fcbed4a38b4f69a18de607f1f',uuid=67a48117-6273-46b7-a14b-5cc2e27847c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01255990-d759-4061-9b3e-967def280d73", "address": "fa:16:3e:5b:48:b4", "network": {"id": "f99cbf0c-7d0c-4ef8-934a-aaac218e9381", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2096188408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94e9d0485eec462990dd029379397962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01255990-d7", "ovs_interfaceid": "01255990-d759-4061-9b3e-967def280d73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:25:49 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Converting VIF {"id": "01255990-d759-4061-9b3e-967def280d73", "address": "fa:16:3e:5b:48:b4", "network": {"id": "f99cbf0c-7d0c-4ef8-934a-aaac218e9381", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2096188408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94e9d0485eec462990dd029379397962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01255990-d7", "ovs_interfaceid": "01255990-d759-4061-9b3e-967def280d73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:25:49 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:48:b4,bridge_name='br-int',has_traffic_filtering=True,id=01255990-d759-4061-9b3e-967def280d73,network=Network(f99cbf0c-7d0c-4ef8-934a-aaac218e9381),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01255990-d7') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:25:49 user nova-compute[74247]: DEBUG os_vif [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:48:b4,bridge_name='br-int',has_traffic_filtering=True,id=01255990-d759-4061-9b3e-967def280d73,network=Network(f99cbf0c-7d0c-4ef8-934a-aaac218e9381),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01255990-d7') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:25:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:25:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:25:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:25:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:25:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b17b2682-5987-5533-b8a8-6f4c2e6a4cea', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:25:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:25:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:25:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:25:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01255990-d7, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:25:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap01255990-d7, col_values=(('qos', UUID('0a3bfc13-b4e1-4f22-8adb-66ec565d53d7')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:25:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap01255990-d7, col_values=(('external_ids', {'iface-id': '01255990-d759-4061-9b3e-967def280d73', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:48:b4', 'vm-uuid': '67a48117-6273-46b7-a14b-5cc2e27847c7'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:25:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:25:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:25:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:25:49 user nova-compute[74247]: INFO os_vif [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:48:b4,bridge_name='br-int',has_traffic_filtering=True,id=01255990-d759-4061-9b3e-967def280d73,network=Network(f99cbf0c-7d0c-4ef8-934a-aaac218e9381),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01255990-d7')
Oct 16 18:25:49 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:25:49 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] No VIF found with MAC fa:16:3e:5b:48:b4, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:25:49 user nova-compute[74247]: DEBUG nova.network.neutron [req-348f665d-4566-4521-9925-a1dcee501ca8 req-49116d03-6b89-4371-8fa7-d976a1896c0f service nova] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Updated VIF entry in instance network info cache for port 01255990-d759-4061-9b3e-967def280d73. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:25:49 user nova-compute[74247]: DEBUG nova.network.neutron [req-348f665d-4566-4521-9925-a1dcee501ca8 req-49116d03-6b89-4371-8fa7-d976a1896c0f service nova] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Updating instance_info_cache with network_info: [{"id": "01255990-d759-4061-9b3e-967def280d73", "address": "fa:16:3e:5b:48:b4", "network": {"id": "f99cbf0c-7d0c-4ef8-934a-aaac218e9381", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2096188408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94e9d0485eec462990dd029379397962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01255990-d7", "ovs_interfaceid": "01255990-d759-4061-9b3e-967def280d73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:25:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-348f665d-4566-4521-9925-a1dcee501ca8 req-49116d03-6b89-4371-8fa7-d976a1896c0f service nova] Releasing lock "refresh_cache-67a48117-6273-46b7-a14b-5cc2e27847c7" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:25:49 user nova-compute[74247]: DEBUG nova.network.neutron [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Successfully created port: 15bdf694-4ae8-4cdd-a76d-34e4b2b19517 {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:25:49 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Updating instance_info_cache with network_info: [{"id": "634511f9-ce96-4fe6-8bfc-51846e4dcb4f", "address": "fa:16:3e:d2:d2:f4", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634511f9-ce", "ovs_interfaceid": "634511f9-ce96-4fe6-8bfc-51846e4dcb4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:25:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Releasing lock "refresh_cache-e37fbc27-3404-479a-be08-4d590391cf30" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:25:49 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Updated the network info_cache for instance {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 18:25:49 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:25:49 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:25:50 user nova-compute[74247]: DEBUG nova.network.neutron [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Successfully created port: f18e494b-cafc-4382-9808-0ea17ecadb46 {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:25:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:25:50 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:25:50 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:25:50 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:25:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:25:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:25:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:25:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:25:51 user nova-compute[74247]: DEBUG nova.network.neutron [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Successfully created port: c1c3e1dc-e2fd-4292-927d-26f011f66294 {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:25:51 user nova-compute[74247]: DEBUG nova.compute.manager [req-a6bf6185-637f-45db-bdf9-7962e5316fdb req-b7fd2af6-d8d0-41ef-9732-96635a07e12c service nova] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Received event network-vif-plugged-01255990-d759-4061-9b3e-967def280d73 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:25:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a6bf6185-637f-45db-bdf9-7962e5316fdb req-b7fd2af6-d8d0-41ef-9732-96635a07e12c service nova] Acquiring lock "67a48117-6273-46b7-a14b-5cc2e27847c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:25:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a6bf6185-637f-45db-bdf9-7962e5316fdb req-b7fd2af6-d8d0-41ef-9732-96635a07e12c service nova] Lock "67a48117-6273-46b7-a14b-5cc2e27847c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:25:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a6bf6185-637f-45db-bdf9-7962e5316fdb req-b7fd2af6-d8d0-41ef-9732-96635a07e12c service nova] Lock "67a48117-6273-46b7-a14b-5cc2e27847c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:25:51 user nova-compute[74247]: DEBUG nova.compute.manager [req-a6bf6185-637f-45db-bdf9-7962e5316fdb req-b7fd2af6-d8d0-41ef-9732-96635a07e12c service nova] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] No waiting events found dispatching network-vif-plugged-01255990-d759-4061-9b3e-967def280d73 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:25:51 user nova-compute[74247]: WARNING nova.compute.manager [req-a6bf6185-637f-45db-bdf9-7962e5316fdb req-b7fd2af6-d8d0-41ef-9732-96635a07e12c service nova] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Received unexpected event network-vif-plugged-01255990-d759-4061-9b3e-967def280d73 for instance with vm_state building and task_state spawning.
Oct 16 18:25:51 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:25:52 user nova-compute[74247]: DEBUG nova.network.neutron [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Successfully created port: f89f8d7b-d509-44ca-9c19-3c99b28b72fc {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:25:52 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:25:52 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 18:25:52 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:25:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:25:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:25:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:25:52 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 18:25:53 user nova-compute[74247]: DEBUG nova.network.neutron [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Successfully updated port: 1b75991c-526f-4cbc-a6f1-6a54d998d217 {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:25:53 user nova-compute[74247]: DEBUG nova.compute.manager [req-ec3a9988-d1fb-4ac4-8cad-351040716881 req-da81f1d7-a4ab-46a6-928a-42446e3b5f62 service nova] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Received event network-vif-plugged-01255990-d759-4061-9b3e-967def280d73 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:25:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-ec3a9988-d1fb-4ac4-8cad-351040716881 req-da81f1d7-a4ab-46a6-928a-42446e3b5f62 service nova] Acquiring lock "67a48117-6273-46b7-a14b-5cc2e27847c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:25:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-ec3a9988-d1fb-4ac4-8cad-351040716881 req-da81f1d7-a4ab-46a6-928a-42446e3b5f62 service nova] Lock "67a48117-6273-46b7-a14b-5cc2e27847c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:25:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-ec3a9988-d1fb-4ac4-8cad-351040716881 req-da81f1d7-a4ab-46a6-928a-42446e3b5f62 service nova] Lock "67a48117-6273-46b7-a14b-5cc2e27847c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:25:53 user nova-compute[74247]: DEBUG nova.compute.manager [req-ec3a9988-d1fb-4ac4-8cad-351040716881 req-da81f1d7-a4ab-46a6-928a-42446e3b5f62 service nova] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] No waiting events found dispatching network-vif-plugged-01255990-d759-4061-9b3e-967def280d73 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:25:53 user nova-compute[74247]: WARNING nova.compute.manager [req-ec3a9988-d1fb-4ac4-8cad-351040716881 req-da81f1d7-a4ab-46a6-928a-42446e3b5f62 service nova] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Received unexpected event network-vif-plugged-01255990-d759-4061-9b3e-967def280d73 for instance with vm_state building and task_state spawning.
Oct 16 18:25:53 user nova-compute[74247]: DEBUG nova.compute.manager [req-ec3a9988-d1fb-4ac4-8cad-351040716881 req-da81f1d7-a4ab-46a6-928a-42446e3b5f62 service nova] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Received event network-changed-1b75991c-526f-4cbc-a6f1-6a54d998d217 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:25:53 user nova-compute[74247]: DEBUG nova.compute.manager [req-ec3a9988-d1fb-4ac4-8cad-351040716881 req-da81f1d7-a4ab-46a6-928a-42446e3b5f62 service nova] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Refreshing instance network info cache due to event network-changed-1b75991c-526f-4cbc-a6f1-6a54d998d217. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:25:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-ec3a9988-d1fb-4ac4-8cad-351040716881 req-da81f1d7-a4ab-46a6-928a-42446e3b5f62 service nova] Acquiring lock "refresh_cache-2a7c7eac-216c-4920-ba10-09a06ce90670" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:25:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-ec3a9988-d1fb-4ac4-8cad-351040716881 req-da81f1d7-a4ab-46a6-928a-42446e3b5f62 service nova] Acquired lock "refresh_cache-2a7c7eac-216c-4920-ba10-09a06ce90670" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:25:53 user nova-compute[74247]: DEBUG nova.network.neutron [req-ec3a9988-d1fb-4ac4-8cad-351040716881 req-da81f1d7-a4ab-46a6-928a-42446e3b5f62 service nova] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Refreshing network info cache for port 1b75991c-526f-4cbc-a6f1-6a54d998d217 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:25:53 user nova-compute[74247]: DEBUG nova.compute.manager [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:25:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:25:53 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Instance spawned successfully.
Oct 16 18:25:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 18:25:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:25:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:25:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:25:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:25:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:25:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:25:53 user nova-compute[74247]: DEBUG nova.network.neutron [req-ec3a9988-d1fb-4ac4-8cad-351040716881 req-da81f1d7-a4ab-46a6-928a-42446e3b5f62 service nova] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:25:53 user nova-compute[74247]: INFO nova.compute.manager [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Took 6.15 seconds to spawn the instance on the hypervisor.
Oct 16 18:25:53 user nova-compute[74247]: DEBUG nova.compute.manager [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:25:53 user nova-compute[74247]: INFO nova.compute.manager [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Took 7.13 seconds to build instance.
Oct 16 18:25:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-63042c11-5daf-4371-9c1d-5683a79475ff tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Lock "67a48117-6273-46b7-a14b-5cc2e27847c7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.360s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:25:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:25:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:53 user nova-compute[74247]: DEBUG nova.network.neutron [req-ec3a9988-d1fb-4ac4-8cad-351040716881 req-da81f1d7-a4ab-46a6-928a-42446e3b5f62 service nova] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:25:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-ec3a9988-d1fb-4ac4-8cad-351040716881 req-da81f1d7-a4ab-46a6-928a-42446e3b5f62 service nova] Releasing lock "refresh_cache-2a7c7eac-216c-4920-ba10-09a06ce90670" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:25:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:25:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:53 user nova-compute[74247]: DEBUG nova.network.neutron [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Successfully updated port: bb0df529-b40c-48af-91ee-009b5086c644 {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:25:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:25:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:54 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:25:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:25:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c868ea1c-0c1c-4470-b125-0a7a76d96c4d/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c868ea1c-0c1c-4470-b125-0a7a76d96c4d/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:25:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c868ea1c-0c1c-4470-b125-0a7a76d96c4d/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c868ea1c-0c1c-4470-b125-0a7a76d96c4d/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:25:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/738eb591-f3dc-4392-b8f2-41530d30ff58/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Acquiring lock "738eb591-f3dc-4392-b8f2-41530d30ff58" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:25:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Lock "738eb591-f3dc-4392-b8f2-41530d30ff58" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:25:54 user nova-compute[74247]: DEBUG nova.objects.instance [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Lazy-loading 'flavor' on Instance uuid 738eb591-f3dc-4392-b8f2-41530d30ff58 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:25:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Lock "738eb591-f3dc-4392-b8f2-41530d30ff58" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.101s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:25:54 user nova-compute[74247]: DEBUG nova.network.neutron [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Successfully updated port: 11f23933-052e-43ba-bafd-f89fd03d307d {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:25:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/738eb591-f3dc-4392-b8f2-41530d30ff58/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:25:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/738eb591-f3dc-4392-b8f2-41530d30ff58/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG nova.compute.manager [req-41cd8c22-c768-402d-b6d8-38efd70f387d req-f32e2517-36fd-4eae-8721-8c3327176d59 service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] Received event network-changed-8cb168df-92d2-4ecc-946a-7d9075f75561 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG nova.compute.manager [req-41cd8c22-c768-402d-b6d8-38efd70f387d req-f32e2517-36fd-4eae-8721-8c3327176d59 service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] Refreshing instance network info cache due to event network-changed-8cb168df-92d2-4ecc-946a-7d9075f75561. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-41cd8c22-c768-402d-b6d8-38efd70f387d req-f32e2517-36fd-4eae-8721-8c3327176d59 service nova] Acquiring lock "refresh_cache-a686ee86-272c-47be-8801-9c1500af272f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-41cd8c22-c768-402d-b6d8-38efd70f387d req-f32e2517-36fd-4eae-8721-8c3327176d59 service nova] Acquired lock "refresh_cache-a686ee86-272c-47be-8801-9c1500af272f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG nova.network.neutron [req-41cd8c22-c768-402d-b6d8-38efd70f387d req-f32e2517-36fd-4eae-8721-8c3327176d59 service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] Refreshing network info cache for port 8cb168df-92d2-4ecc-946a-7d9075f75561 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Acquiring lock "738eb591-f3dc-4392-b8f2-41530d30ff58" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Lock "738eb591-f3dc-4392-b8f2-41530d30ff58" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:25:55 user nova-compute[74247]: INFO nova.compute.manager [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Attaching volume 4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee to /dev/vdb
Oct 16 18:25:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/738eb591-f3dc-4392-b8f2-41530d30ff58/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG os_brick.utils [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1e2d26-57c5-4aa1-b66f-3ead29571b7e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6d955a-e539-4686-8a40-90cb25604150]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG nova.compute.manager [req-4c18dbbf-cb76-466b-8660-e9fcf6942328 req-205e1c2f-98d9-4216-a4c0-f39742a1991f service nova] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Received event network-changed-bb0df529-b40c-48af-91ee-009b5086c644 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG nova.compute.manager [req-4c18dbbf-cb76-466b-8660-e9fcf6942328 req-205e1c2f-98d9-4216-a4c0-f39742a1991f service nova] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Refreshing instance network info cache due to event network-changed-bb0df529-b40c-48af-91ee-009b5086c644. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4c18dbbf-cb76-466b-8660-e9fcf6942328 req-205e1c2f-98d9-4216-a4c0-f39742a1991f service nova] Acquiring lock "refresh_cache-2a7c7eac-216c-4920-ba10-09a06ce90670" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4c18dbbf-cb76-466b-8660-e9fcf6942328 req-205e1c2f-98d9-4216-a4c0-f39742a1991f service nova] Acquired lock "refresh_cache-2a7c7eac-216c-4920-ba10-09a06ce90670" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG nova.network.neutron [req-4c18dbbf-cb76-466b-8660-e9fcf6942328 req-205e1c2f-98d9-4216-a4c0-f39742a1991f service nova] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Refreshing network info cache for port bb0df529-b40c-48af-91ee-009b5086c644 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdeb448a-7591-490e-a809-5fecb51aff89]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[33db2b93-9331-452c-b073-7118ac5ee435]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f473b26a-3ec8-4f04-91b4-db8f587b7357]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG nova.network.neutron [req-4c18dbbf-cb76-466b-8660-e9fcf6942328 req-205e1c2f-98d9-4216-a4c0-f39742a1991f service nova] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:25:55 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 18:25:55 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0dd7223-49ba-49da-8a32-9708761926ed]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG os_brick.utils [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] <== get_connector_properties: return (198ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Updating existing volume attachment record: 1be9e859-d2e6-48d8-8cbe-63f752bbd962 {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1e2d26-57c5-4aa1-b66f-3ead29571b7e/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1e2d26-57c5-4aa1-b66f-3ead29571b7e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG nova.network.neutron [req-4c18dbbf-cb76-466b-8660-e9fcf6942328 req-205e1c2f-98d9-4216-a4c0-f39742a1991f service nova] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4c18dbbf-cb76-466b-8660-e9fcf6942328 req-205e1c2f-98d9-4216-a4c0-f39742a1991f service nova] Releasing lock "refresh_cache-2a7c7eac-216c-4920-ba10-09a06ce90670" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG nova.compute.manager [req-4c18dbbf-cb76-466b-8660-e9fcf6942328 req-205e1c2f-98d9-4216-a4c0-f39742a1991f service nova] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Received event network-changed-11f23933-052e-43ba-bafd-f89fd03d307d {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG nova.compute.manager [req-4c18dbbf-cb76-466b-8660-e9fcf6942328 req-205e1c2f-98d9-4216-a4c0-f39742a1991f service nova] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Refreshing instance network info cache due to event network-changed-11f23933-052e-43ba-bafd-f89fd03d307d. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4c18dbbf-cb76-466b-8660-e9fcf6942328 req-205e1c2f-98d9-4216-a4c0-f39742a1991f service nova] Acquiring lock "refresh_cache-2a7c7eac-216c-4920-ba10-09a06ce90670" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4c18dbbf-cb76-466b-8660-e9fcf6942328 req-205e1c2f-98d9-4216-a4c0-f39742a1991f service nova] Acquired lock "refresh_cache-2a7c7eac-216c-4920-ba10-09a06ce90670" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG nova.network.neutron [req-4c18dbbf-cb76-466b-8660-e9fcf6942328 req-205e1c2f-98d9-4216-a4c0-f39742a1991f service nova] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Refreshing network info cache for port 11f23933-052e-43ba-bafd-f89fd03d307d {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1e2d26-57c5-4aa1-b66f-3ead29571b7e/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG nova.network.neutron [req-4c18dbbf-cb76-466b-8660-e9fcf6942328 req-205e1c2f-98d9-4216-a4c0-f39742a1991f service nova] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG nova.network.neutron [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Successfully updated port: 15bdf694-4ae8-4cdd-a76d-34e4b2b19517 {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG nova.network.neutron [req-41cd8c22-c768-402d-b6d8-38efd70f387d req-f32e2517-36fd-4eae-8721-8c3327176d59 service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] Updated VIF entry in instance network info cache for port 8cb168df-92d2-4ecc-946a-7d9075f75561. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG nova.network.neutron [req-41cd8c22-c768-402d-b6d8-38efd70f387d req-f32e2517-36fd-4eae-8721-8c3327176d59 service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] Updating instance_info_cache with network_info: [{"id": "8cb168df-92d2-4ecc-946a-7d9075f75561", "address": "fa:16:3e:9d:bb:be", "network": {"id": "f12e9b98-2724-4b9c-a299-7286c163458c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1410604293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973c8310858e4e1dafbc2fa926995940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb168df-92", "ovs_interfaceid": "8cb168df-92d2-4ecc-946a-7d9075f75561", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-41cd8c22-c768-402d-b6d8-38efd70f387d req-f32e2517-36fd-4eae-8721-8c3327176d59 service nova] Releasing lock "refresh_cache-a686ee86-272c-47be-8801-9c1500af272f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG nova.network.neutron [req-4c18dbbf-cb76-466b-8660-e9fcf6942328 req-205e1c2f-98d9-4216-a4c0-f39742a1991f service nova] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:25:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4c18dbbf-cb76-466b-8660-e9fcf6942328 req-205e1c2f-98d9-4216-a4c0-f39742a1991f service nova] Releasing lock "refresh_cache-2a7c7eac-216c-4920-ba10-09a06ce90670" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:25:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:25:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4daa6370-2cdf-4668-b66b-e10196377c9c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4daa6370-2cdf-4668-b66b-e10196377c9c/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:25:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4daa6370-2cdf-4668-b66b-e10196377c9c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:56 user nova-compute[74247]: DEBUG nova.network.neutron [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Successfully updated port: f18e494b-cafc-4382-9808-0ea17ecadb46 {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:25:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4daa6370-2cdf-4668-b66b-e10196377c9c/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:25:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:25:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:25:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67a48117-6273-46b7-a14b-5cc2e27847c7/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:57 user nova-compute[74247]: DEBUG nova.network.neutron [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Successfully updated port: c1c3e1dc-e2fd-4292-927d-26f011f66294 {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:25:57 user nova-compute[74247]: DEBUG nova.compute.manager [req-255a8cfd-ac57-477a-a9ce-20ca3741719d req-19606403-4925-4550-87d5-b1726d0a3908 service nova] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Received event network-changed-15bdf694-4ae8-4cdd-a76d-34e4b2b19517 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:25:57 user nova-compute[74247]: DEBUG nova.compute.manager [req-255a8cfd-ac57-477a-a9ce-20ca3741719d req-19606403-4925-4550-87d5-b1726d0a3908 service nova] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Refreshing instance network info cache due to event network-changed-15bdf694-4ae8-4cdd-a76d-34e4b2b19517. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:25:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-255a8cfd-ac57-477a-a9ce-20ca3741719d req-19606403-4925-4550-87d5-b1726d0a3908 service nova] Acquiring lock "refresh_cache-2a7c7eac-216c-4920-ba10-09a06ce90670" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:25:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-255a8cfd-ac57-477a-a9ce-20ca3741719d req-19606403-4925-4550-87d5-b1726d0a3908 service nova] Acquired lock "refresh_cache-2a7c7eac-216c-4920-ba10-09a06ce90670" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:25:57 user nova-compute[74247]: DEBUG nova.network.neutron [req-255a8cfd-ac57-477a-a9ce-20ca3741719d req-19606403-4925-4550-87d5-b1726d0a3908 service nova] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Refreshing network info cache for port 15bdf694-4ae8-4cdd-a76d-34e4b2b19517 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:25:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67a48117-6273-46b7-a14b-5cc2e27847c7/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:25:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67a48117-6273-46b7-a14b-5cc2e27847c7/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:25:57 user nova-compute[74247]: DEBUG nova.network.neutron [req-255a8cfd-ac57-477a-a9ce-20ca3741719d req-19606403-4925-4550-87d5-b1726d0a3908 service nova] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:25:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67a48117-6273-46b7-a14b-5cc2e27847c7/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:25:57 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:25:58 user nova-compute[74247]: DEBUG nova.network.neutron [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Successfully updated port: f89f8d7b-d509-44ca-9c19-3c99b28b72fc {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:25:58 user nova-compute[74247]: DEBUG nova.network.neutron [req-255a8cfd-ac57-477a-a9ce-20ca3741719d req-19606403-4925-4550-87d5-b1726d0a3908 service nova] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:25:58 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:25:58 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:25:58 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=7258MB free_disk=25.44318389892578GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 18:25:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:25:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:25:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Acquiring lock "refresh_cache-2a7c7eac-216c-4920-ba10-09a06ce90670" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:25:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-255a8cfd-ac57-477a-a9ce-20ca3741719d req-19606403-4925-4550-87d5-b1726d0a3908 service nova] Releasing lock "refresh_cache-2a7c7eac-216c-4920-ba10-09a06ce90670" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:25:58 user nova-compute[74247]: DEBUG nova.compute.manager [req-255a8cfd-ac57-477a-a9ce-20ca3741719d req-19606403-4925-4550-87d5-b1726d0a3908 service nova] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Received event network-changed-f18e494b-cafc-4382-9808-0ea17ecadb46 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:25:58 user nova-compute[74247]: DEBUG nova.compute.manager [req-255a8cfd-ac57-477a-a9ce-20ca3741719d req-19606403-4925-4550-87d5-b1726d0a3908 service nova] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Refreshing instance network info cache due to event network-changed-f18e494b-cafc-4382-9808-0ea17ecadb46. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:25:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-255a8cfd-ac57-477a-a9ce-20ca3741719d req-19606403-4925-4550-87d5-b1726d0a3908 service nova] Acquiring lock "refresh_cache-2a7c7eac-216c-4920-ba10-09a06ce90670" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:25:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-255a8cfd-ac57-477a-a9ce-20ca3741719d req-19606403-4925-4550-87d5-b1726d0a3908 service nova] Acquired lock "refresh_cache-2a7c7eac-216c-4920-ba10-09a06ce90670" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:25:58 user nova-compute[74247]: DEBUG nova.network.neutron [req-255a8cfd-ac57-477a-a9ce-20ca3741719d req-19606403-4925-4550-87d5-b1726d0a3908 service nova] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Refreshing network info cache for port f18e494b-cafc-4382-9808-0ea17ecadb46 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:25:58 user nova-compute[74247]: DEBUG nova.network.neutron [req-255a8cfd-ac57-477a-a9ce-20ca3741719d req-19606403-4925-4550-87d5-b1726d0a3908 service nova] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:25:58 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:25:58 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance e37fbc27-3404-479a-be08-4d590391cf30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:25:58 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 738eb591-f3dc-4392-b8f2-41530d30ff58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:25:58 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance a686ee86-272c-47be-8801-9c1500af272f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:25:58 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 4daa6370-2cdf-4668-b66b-e10196377c9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:25:58 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance c048698e-de64-4124-8d72-57fb819bb80e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:25:58 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance ff1e2d26-57c5-4aa1-b66f-3ead29571b7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:25:58 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance c868ea1c-0c1c-4470-b125-0a7a76d96c4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:25:58 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:25:58 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 67a48117-6273-46b7-a14b-5cc2e27847c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:25:58 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 2a7c7eac-216c-4920-ba10-09a06ce90670 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:25:58 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 18:25:58 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 18:25:58 user nova-compute[74247]: DEBUG nova.network.neutron [req-255a8cfd-ac57-477a-a9ce-20ca3741719d req-19606403-4925-4550-87d5-b1726d0a3908 service nova] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:25:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-255a8cfd-ac57-477a-a9ce-20ca3741719d req-19606403-4925-4550-87d5-b1726d0a3908 service nova] Releasing lock "refresh_cache-2a7c7eac-216c-4920-ba10-09a06ce90670" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:25:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Acquired lock "refresh_cache-2a7c7eac-216c-4920-ba10-09a06ce90670" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:25:58 user nova-compute[74247]: DEBUG nova.network.neutron [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:25:58 user nova-compute[74247]: DEBUG nova.network.neutron [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:25:58 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:25:58 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:25:59 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 18:25:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.837s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:25:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:25:59 user nova-compute[74247]: DEBUG nova.compute.manager [req-37e9acd2-4902-4294-9bb3-99bc3a9595eb req-b1de6707-a086-4f21-85f6-2db7ced8d039 service nova] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Received event network-changed-c1c3e1dc-e2fd-4292-927d-26f011f66294 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:25:59 user nova-compute[74247]: DEBUG nova.compute.manager [req-37e9acd2-4902-4294-9bb3-99bc3a9595eb req-b1de6707-a086-4f21-85f6-2db7ced8d039 service nova] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Refreshing instance network info cache due to event network-changed-c1c3e1dc-e2fd-4292-927d-26f011f66294. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:25:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-37e9acd2-4902-4294-9bb3-99bc3a9595eb req-b1de6707-a086-4f21-85f6-2db7ced8d039 service nova] Acquiring lock "refresh_cache-2a7c7eac-216c-4920-ba10-09a06ce90670" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:26:00 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:26:00 user nova-compute[74247]: DEBUG nova.network.neutron [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Updating instance_info_cache with network_info: [{"id": "1b75991c-526f-4cbc-a6f1-6a54d998d217", "address": "fa:16:3e:c7:fa:00", "network": {"id": "02486354-2092-462f-b666-40a7d80aca54", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1221482774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "805d12d8898a467cabcfe75d9a7993e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b75991c-52", "ovs_interfaceid": "1b75991c-526f-4cbc-a6f1-6a54d998d217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb0df529-b40c-48af-91ee-009b5086c644", "address": "fa:16:3e:29:d2:55", "network": {"id": "cde9d65e-9ab9-49b6-b931-371b5c6a9e51", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092195528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "805d12d8898a467cabcfe75d9a7993e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb0df529-b4", "ovs_interfaceid": "bb0df529-b40c-48af-91ee-009b5086c644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "11f23933-052e-43ba-bafd-f89fd03d307d", "address": "fa:16:3e:54:12:92", "network": {"id": "cde9d65e-9ab9-49b6-b931-371b5c6a9e51", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092195528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "805d12d8898a467cabcfe75d9a7993e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11f23933-05", "ovs_interfaceid": "11f23933-052e-43ba-bafd-f89fd03d307d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15bdf694-4ae8-4cdd-a76d-34e4b2b19517", "address": "fa:16:3e:97:51:a6", "network": {"id": "cde9d65e-9ab9-49b6-b931-371b5c6a9e51", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092195528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "805d12d8898a467cabcfe75d9a7993e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15bdf694-4a", "ovs_interfaceid": "15bdf694-4ae8-4cdd-a76d-34e4b2b19517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f18e494b-cafc-4382-9808-0ea17ecadb46", "address": "fa:16:3e:46:25:58", "network": {"id": "cde9d65e-9ab9-49b6-b931-371b5c6a9e51", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092195528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "805d12d8898a467cabcfe75d9a7993e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18e494b-ca", "ovs_interfaceid": "f18e494b-cafc-4382-9808-0ea17ecadb46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1c3e1dc-e2fd-4292-927d-26f011f66294", "address": "fa:16:3e:89:48:70", "network": {"id": "c1d8ca7b-2b19-46c3-a3c3-a68051e3ef92", "bridge": "br-int", "label": "tempest-device-tagging-net2-1464764926", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "805d12d8898a467cabcfe75d9a7993e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1c3e1dc-e2", "ovs_interfaceid": "c1c3e1dc-e2fd-4292-927d-26f011f66294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f89f8d7b-d509-44ca-9c19-3c99b28b72fc", "address": "fa:16:3e:8e:a9:c0", "network": {"id": "c1d8ca7b-2b19-46c3-a3c3-a68051e3ef92", "bridge": "br-int", "label": "tempest-device-tagging-net2-1464764926", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "805d12d8898a467cabcfe75d9a7993e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf89f8d7b-d5", "ovs_interfaceid": "f89f8d7b-d509-44ca-9c19-3c99b28b72fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:26:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Releasing lock "refresh_cache-2a7c7eac-216c-4920-ba10-09a06ce90670" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:26:00 user nova-compute[74247]: DEBUG nova.compute.manager [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Instance network_info: |[{"id": "1b75991c-526f-4cbc-a6f1-6a54d998d217", "address": "fa:16:3e:c7:fa:00", "network": {"id": "02486354-2092-462f-b666-40a7d80aca54", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1221482774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "805d12d8898a467cabcfe75d9a7993e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b75991c-52", "ovs_interfaceid": "1b75991c-526f-4cbc-a6f1-6a54d998d217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb0df529-b40c-48af-91ee-009b5086c644", "address": "fa:16:3e:29:d2:55", "network": {"id": "cde9d65e-9ab9-49b6-b931-371b5c6a9e51", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092195528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "805d12d8898a467cabcfe75d9a7993e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb0df529-b4", "ovs_interfaceid": "bb0df529-b40c-48af-91ee-009b5086c644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "11f23933-052e-43ba-bafd-f89fd03d307d", "address": "fa:16:3e:54:12:92", "network": {"id": "cde9d65e-9ab9-49b6-b931-371b5c6a9e51", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092195528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "805d12d8898a467cabcfe75d9a7993e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11f23933-05", "ovs_interfaceid": "11f23933-052e-43ba-bafd-f89fd03d307d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15bdf694-4ae8-4cdd-a76d-34e4b2b19517", "address": "fa:16:3e:97:51:a6", "network": {"id": "cde9d65e-9ab9-49b6-b931-371b5c6a9e51", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092195528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "805d12d8898a467cabcfe75d9a7993e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15bdf694-4a", "ovs_interfaceid": "15bdf694-4ae8-4cdd-a76d-34e4b2b19517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f18e494b-cafc-4382-9808-0ea17ecadb46", "address": "fa:16:3e:46:25:58", "network": {"id": "cde9d65e-9ab9-49b6-b931-371b5c6a9e51", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092195528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "805d12d8898a467cabcfe75d9a7993e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18e494b-ca", "ovs_interfaceid": "f18e494b-cafc-4382-9808-0ea17ecadb46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1c3e1dc-e2fd-4292-927d-26f011f66294", "address": "fa:16:3e:89:48:70", "network": {"id": "c1d8ca7b-2b19-46c3-a3c3-a68051e3ef92", "bridge": "br-int", "label": "tempest-device-tagging-net2-1464764926", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "805d12d8898a467cabcfe75d9a7993e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1c3e1dc-e2", "ovs_interfaceid": "c1c3e1dc-e2fd-4292-927d-26f011f66294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f89f8d7b-d509-44ca-9c19-3c99b28b72fc", "address": "fa:16:3e:8e:a9:c0", "network": {"id": "c1d8ca7b-2b19-46c3-a3c3-a68051e3ef92", "bridge": "br-int", "label": "tempest-device-tagging-net2-1464764926", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "805d12d8898a467cabcfe75d9a7993e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf89f8d7b-d5", "ovs_interfaceid": "f89f8d7b-d509-44ca-9c19-3c99b28b72fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 18:26:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-37e9acd2-4902-4294-9bb3-99bc3a9595eb req-b1de6707-a086-4f21-85f6-2db7ced8d039 service nova] Acquired lock "refresh_cache-2a7c7eac-216c-4920-ba10-09a06ce90670" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:26:00 user nova-compute[74247]: DEBUG nova.network.neutron [req-37e9acd2-4902-4294-9bb3-99bc3a9595eb req-b1de6707-a086-4f21-85f6-2db7ced8d039 service nova] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Refreshing network info cache for port c1c3e1dc-e2fd-4292-927d-26f011f66294 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:26:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:00 user nova-compute[74247]: DEBUG nova.network.neutron [req-37e9acd2-4902-4294-9bb3-99bc3a9595eb req-b1de6707-a086-4f21-85f6-2db7ced8d039 service nova] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Updated VIF entry in instance network info cache for port c1c3e1dc-e2fd-4292-927d-26f011f66294. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:26:00 user nova-compute[74247]: DEBUG nova.network.neutron [req-37e9acd2-4902-4294-9bb3-99bc3a9595eb req-b1de6707-a086-4f21-85f6-2db7ced8d039 service nova] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Updating instance_info_cache with network_info: [{"id": "1b75991c-526f-4cbc-a6f1-6a54d998d217", "address": "fa:16:3e:c7:fa:00", "network": {"id": "02486354-2092-462f-b666-40a7d80aca54", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1221482774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "805d12d8898a467cabcfe75d9a7993e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b75991c-52", "ovs_interfaceid": "1b75991c-526f-4cbc-a6f1-6a54d998d217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb0df529-b40c-48af-91ee-009b5086c644", "address": "fa:16:3e:29:d2:55", "network": {"id": "cde9d65e-9ab9-49b6-b931-371b5c6a9e51", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092195528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "805d12d8898a467cabcfe75d9a7993e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb0df529-b4", "ovs_interfaceid": "bb0df529-b40c-48af-91ee-009b5086c644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "11f23933-052e-43ba-bafd-f89fd03d307d", "address": "fa:16:3e:54:12:92", "network": {"id": "cde9d65e-9ab9-49b6-b931-371b5c6a9e51", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092195528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "805d12d8898a467cabcfe75d9a7993e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11f23933-05", "ovs_interfaceid": "11f23933-052e-43ba-bafd-f89fd03d307d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15bdf694-4ae8-4cdd-a76d-34e4b2b19517", "address": "fa:16:3e:97:51:a6", "network": {"id": "cde9d65e-9ab9-49b6-b931-371b5c6a9e51", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092195528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "805d12d8898a467cabcfe75d9a7993e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15bdf694-4a", "ovs_interfaceid": "15bdf694-4ae8-4cdd-a76d-34e4b2b19517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f18e494b-cafc-4382-9808-0ea17ecadb46", "address": "fa:16:3e:46:25:58", "network": {"id": "cde9d65e-9ab9-49b6-b931-371b5c6a9e51", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092195528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "805d12d8898a467cabcfe75d9a7993e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18e494b-ca", "ovs_interfaceid": "f18e494b-cafc-4382-9808-0ea17ecadb46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1c3e1dc-e2fd-4292-927d-26f011f66294", "address": "fa:16:3e:89:48:70", "network": {"id": "c1d8ca7b-2b19-46c3-a3c3-a68051e3ef92", "bridge": "br-int", "label": "tempest-device-tagging-net2-1464764926", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "805d12d8898a467cabcfe75d9a7993e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1c3e1dc-e2", "ovs_interfaceid": "c1c3e1dc-e2fd-4292-927d-26f011f66294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f89f8d7b-d509-44ca-9c19-3c99b28b72fc", "address": "fa:16:3e:8e:a9:c0", "network": {"id": "c1d8ca7b-2b19-46c3-a3c3-a68051e3ef92", "bridge": "br-int", "label": "tempest-device-tagging-net2-1464764926", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "805d12d8898a467cabcfe75d9a7993e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf89f8d7b-d5", "ovs_interfaceid": "f89f8d7b-d509-44ca-9c19-3c99b28b72fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:26:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-37e9acd2-4902-4294-9bb3-99bc3a9595eb req-b1de6707-a086-4f21-85f6-2db7ced8d039 service nova] Releasing lock "refresh_cache-2a7c7eac-216c-4920-ba10-09a06ce90670" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:26:00 user nova-compute[74247]: DEBUG nova.compute.manager [req-37e9acd2-4902-4294-9bb3-99bc3a9595eb req-b1de6707-a086-4f21-85f6-2db7ced8d039 service nova] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Received event network-changed-f89f8d7b-d509-44ca-9c19-3c99b28b72fc {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:26:00 user nova-compute[74247]: DEBUG nova.compute.manager [req-37e9acd2-4902-4294-9bb3-99bc3a9595eb req-b1de6707-a086-4f21-85f6-2db7ced8d039 service nova] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Refreshing instance network info cache due to event network-changed-f89f8d7b-d509-44ca-9c19-3c99b28b72fc. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:26:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-37e9acd2-4902-4294-9bb3-99bc3a9595eb req-b1de6707-a086-4f21-85f6-2db7ced8d039 service nova] Acquiring lock "refresh_cache-2a7c7eac-216c-4920-ba10-09a06ce90670" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:26:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-37e9acd2-4902-4294-9bb3-99bc3a9595eb req-b1de6707-a086-4f21-85f6-2db7ced8d039 service nova] Acquired lock "refresh_cache-2a7c7eac-216c-4920-ba10-09a06ce90670" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:26:00 user nova-compute[74247]: DEBUG nova.network.neutron [req-37e9acd2-4902-4294-9bb3-99bc3a9595eb req-b1de6707-a086-4f21-85f6-2db7ced8d039 service nova] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Refreshing network info cache for port f89f8d7b-d509-44ca-9c19-3c99b28b72fc {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:26:01 user nova-compute[74247]: DEBUG nova.network.neutron [req-37e9acd2-4902-4294-9bb3-99bc3a9595eb req-b1de6707-a086-4f21-85f6-2db7ced8d039 service nova] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Updated VIF entry in instance network info cache for port f89f8d7b-d509-44ca-9c19-3c99b28b72fc. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:26:01 user nova-compute[74247]: DEBUG nova.network.neutron [req-37e9acd2-4902-4294-9bb3-99bc3a9595eb req-b1de6707-a086-4f21-85f6-2db7ced8d039 service nova] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Updating instance_info_cache with network_info: [{"id": "1b75991c-526f-4cbc-a6f1-6a54d998d217", "address": "fa:16:3e:c7:fa:00", "network": {"id": "02486354-2092-462f-b666-40a7d80aca54", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1221482774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "805d12d8898a467cabcfe75d9a7993e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b75991c-52", "ovs_interfaceid": "1b75991c-526f-4cbc-a6f1-6a54d998d217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb0df529-b40c-48af-91ee-009b5086c644", "address": "fa:16:3e:29:d2:55", "network": {"id": "cde9d65e-9ab9-49b6-b931-371b5c6a9e51", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092195528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "805d12d8898a467cabcfe75d9a7993e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb0df529-b4", "ovs_interfaceid": "bb0df529-b40c-48af-91ee-009b5086c644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "11f23933-052e-43ba-bafd-f89fd03d307d", "address": "fa:16:3e:54:12:92", "network": {"id": "cde9d65e-9ab9-49b6-b931-371b5c6a9e51", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092195528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "805d12d8898a467cabcfe75d9a7993e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11f23933-05", "ovs_interfaceid": "11f23933-052e-43ba-bafd-f89fd03d307d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15bdf694-4ae8-4cdd-a76d-34e4b2b19517", "address": "fa:16:3e:97:51:a6", "network": {"id": "cde9d65e-9ab9-49b6-b931-371b5c6a9e51", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092195528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "805d12d8898a467cabcfe75d9a7993e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15bdf694-4a", "ovs_interfaceid": "15bdf694-4ae8-4cdd-a76d-34e4b2b19517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f18e494b-cafc-4382-9808-0ea17ecadb46", "address": "fa:16:3e:46:25:58", "network": {"id": "cde9d65e-9ab9-49b6-b931-371b5c6a9e51", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092195528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "805d12d8898a467cabcfe75d9a7993e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18e494b-ca", "ovs_interfaceid": "f18e494b-cafc-4382-9808-0ea17ecadb46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1c3e1dc-e2fd-4292-927d-26f011f66294", "address": "fa:16:3e:89:48:70", "network": {"id": "c1d8ca7b-2b19-46c3-a3c3-a68051e3ef92", "bridge": "br-int", "label": "tempest-device-tagging-net2-1464764926", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "805d12d8898a467cabcfe75d9a7993e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1c3e1dc-e2", "ovs_interfaceid": "c1c3e1dc-e2fd-4292-927d-26f011f66294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f89f8d7b-d509-44ca-9c19-3c99b28b72fc", "address": "fa:16:3e:8e:a9:c0", "network": {"id": "c1d8ca7b-2b19-46c3-a3c3-a68051e3ef92", "bridge": "br-int", "label": "tempest-device-tagging-net2-1464764926", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "805d12d8898a467cabcfe75d9a7993e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf89f8d7b-d5", "ovs_interfaceid": "f89f8d7b-d509-44ca-9c19-3c99b28b72fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:26:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-37e9acd2-4902-4294-9bb3-99bc3a9595eb req-b1de6707-a086-4f21-85f6-2db7ced8d039 service nova] Releasing lock "refresh_cache-2a7c7eac-216c-4920-ba10-09a06ce90670" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:26:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:06 user nova-compute[74247]: DEBUG nova.compute.manager [req-e615e9e2-7cbb-4b81-9aef-c5eec7804b63 req-7c086a0f-1f76-4800-87fe-cd41680ec696 service nova] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Received event network-changed-4d30f22d-4337-41a7-965d-f9c172049b00 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:26:06 user nova-compute[74247]: DEBUG nova.compute.manager [req-e615e9e2-7cbb-4b81-9aef-c5eec7804b63 req-7c086a0f-1f76-4800-87fe-cd41680ec696 service nova] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Refreshing instance network info cache due to event network-changed-4d30f22d-4337-41a7-965d-f9c172049b00. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:26:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e615e9e2-7cbb-4b81-9aef-c5eec7804b63 req-7c086a0f-1f76-4800-87fe-cd41680ec696 service nova] Acquiring lock "refresh_cache-4daa6370-2cdf-4668-b66b-e10196377c9c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:26:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e615e9e2-7cbb-4b81-9aef-c5eec7804b63 req-7c086a0f-1f76-4800-87fe-cd41680ec696 service nova] Acquired lock "refresh_cache-4daa6370-2cdf-4668-b66b-e10196377c9c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:26:06 user nova-compute[74247]: DEBUG nova.network.neutron [req-e615e9e2-7cbb-4b81-9aef-c5eec7804b63 req-7c086a0f-1f76-4800-87fe-cd41680ec696 service nova] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Refreshing network info cache for port 4d30f22d-4337-41a7-965d-f9c172049b00 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:26:07 user nova-compute[74247]: DEBUG nova.network.neutron [req-e615e9e2-7cbb-4b81-9aef-c5eec7804b63 req-7c086a0f-1f76-4800-87fe-cd41680ec696 service nova] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Updated VIF entry in instance network info cache for port 4d30f22d-4337-41a7-965d-f9c172049b00. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:26:07 user nova-compute[74247]: DEBUG nova.network.neutron [req-e615e9e2-7cbb-4b81-9aef-c5eec7804b63 req-7c086a0f-1f76-4800-87fe-cd41680ec696 service nova] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Updating instance_info_cache with network_info: [{"id": "4d30f22d-4337-41a7-965d-f9c172049b00", "address": "fa:16:3e:5c:05:1d", "network": {"id": "8451dc81-ded8-462e-a394-f5cd774f684b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1470365086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42df518506b24ac5bedd9d75b15fa9b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d30f22d-43", "ovs_interfaceid": "4d30f22d-4337-41a7-965d-f9c172049b00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:26:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e615e9e2-7cbb-4b81-9aef-c5eec7804b63 req-7c086a0f-1f76-4800-87fe-cd41680ec696 service nova] Releasing lock "refresh_cache-4daa6370-2cdf-4668-b66b-e10196377c9c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:26:07 user nova-compute[74247]: INFO nova.virt.block_device [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Booting with volume e6d39438-b426-45d7-b8dd-418e85b054a7 at /dev/vdb
Oct 16 18:26:07 user nova-compute[74247]: DEBUG os_brick.utils [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:26:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:07 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff2a289-8730-486f-a1d9-97fe75a3e113]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:08 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1fefc7-2e35-4eb3-bf40-c4c66b2d7d61]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:08 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c931bcf-8ec3-4422-999e-1c762534bf8e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:08 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7ae1b6-78a7-4a68-a18d-4df0355f5f2e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:26:08 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 18:26:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:26:08 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 18:26:08 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[83071988-b2a3-485b-a987-b6a266961ef7]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:08 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 18:26:08 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 18:26:08 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 18:26:08 user nova-compute[74247]: DEBUG os_brick.utils [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:26:08 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Updating existing volume attachment record: e0698c08-39c5-4c0d-9041-2c1057553ecb {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 18:26:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:10 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:11 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Acquiring lock "4daa6370-2cdf-4668-b66b-e10196377c9c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:26:11 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lock "4daa6370-2cdf-4668-b66b-e10196377c9c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:26:11 user nova-compute[74247]: DEBUG nova.objects.instance [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lazy-loading 'flavor' on Instance uuid 4daa6370-2cdf-4668-b66b-e10196377c9c {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:26:11 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lock "4daa6370-2cdf-4668-b66b-e10196377c9c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.123s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:26:12 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Acquiring lock "4daa6370-2cdf-4668-b66b-e10196377c9c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:26:12 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lock "4daa6370-2cdf-4668-b66b-e10196377c9c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:26:12 user nova-compute[74247]: INFO nova.compute.manager [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Attaching volume e5c213b1-8485-4361-8cc8-7b771cacc572 to /dev/vdb
Oct 16 18:26:12 user nova-compute[74247]: DEBUG os_brick.utils [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:26:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:12 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3b443c-122c-409f-af07-cd3c07ab527f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:12 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[935b6f6b-367a-496f-aee1-e9d928e52aa2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:12 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[139416bb-0259-48d6-92fd-5c3151993edd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:12 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[05277d42-edfe-41b1-9957-69f1e1ca30a6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:26:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 18:26:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:26:12 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 18:26:12 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4d5ba3-d5a2-4a17-9267-37b222099563]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 18:26:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 18:26:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 18:26:12 user nova-compute[74247]: DEBUG os_brick.utils [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:26:12 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Updating existing volume attachment record: 76f478af-9820-4b90-a070-d5ca5a618d74 {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nUdhOSLH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:26:14 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:26:14 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:26:14 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:26:14 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:26:14 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:26:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc1162f-7f26-48f9-a18f-70daa4823e87]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 18:26:14 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9b43aa-5437-4da7-97d1-21546b16305f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee] added
Oct 16 18:26:14 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3806566-998e-4cd4-9709-4741b0427f97]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8683ea4-60cd-4343-966a-6f4c71806061]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nUdhOSLH {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nUdhOSLH" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2abba0d-fd37-4df7-9cb5-d2781ba6f3bf]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nUdhOSLH'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9677e4ce-ed92-4f1a-af27-655efdfbd6ca]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b506fa09-cdef-4774-af7c-4a513faa8fef]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)
Oct 16 18:26:14 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)
Oct 16 18:26:14 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1eb2ab3-4a52-4791-96f9-b28d44a4ab8f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee, portal: 172.16.0.220,3260]
Oct 16 18:26:14 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee, portal: 172.16.0.220,3260] successful.
Oct 16 18:26:14 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adc9ffa-7b78-4b36-ba0d-0bc0698de2fb]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4cca74b-1ba5-412e-890c-01fbe0738d61]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)
Oct 16 18:26:14 user nova-compute[74247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee (non-flash)
Oct 16 18:26:14 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)
Oct 16 18:26:14 user nova-compute[74247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee (non-flash)
Oct 16 18:26:14 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aebc5a7-aac2-4c72-816b-1800aebeaf84]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:26:14 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nUdhOSLH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:26:15 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:26:15 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23333333130303236', 'path': '/dev/sdc'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:26:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333333130303236', 'path': '/dev/sdc'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:26:15 user nova-compute[74247]: DEBUG nova.objects.instance [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Lazy-loading 'flavor' on Instance uuid 738eb591-f3dc-4392-b8f2-41530d30ff58 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:26:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 18:26:15 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:26:15 user nova-compute[74247]:   <source dev="/dev/sdc"/>
Oct 16 18:26:15 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:26:15 user nova-compute[74247]:   <serial>4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee</serial>
Oct 16 18:26:15 user nova-compute[74247]: </disk>
Oct 16 18:26:15 user nova-compute[74247]:  {{(pid=74247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 18:26:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:16 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:26:16 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:26:16 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] No VIF found with MAC fa:16:3e:25:25:81, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:26:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-fe11f1ff-a2f2-48ab-919f-1ddd1c0dc4de tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Lock "738eb591-f3dc-4392-b8f2-41530d30ff58" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.262s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:26:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Acquiring lock "738eb591-f3dc-4392-b8f2-41530d30ff58" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:26:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Lock "738eb591-f3dc-4392-b8f2-41530d30ff58" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:26:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Acquiring lock "738eb591-f3dc-4392-b8f2-41530d30ff58-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:26:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Lock "738eb591-f3dc-4392-b8f2-41530d30ff58-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:26:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Lock "738eb591-f3dc-4392-b8f2-41530d30ff58-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:26:16 user nova-compute[74247]: INFO nova.compute.manager [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Terminating instance
Oct 16 18:26:16 user nova-compute[74247]: DEBUG nova.compute.manager [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 18:26:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG nova.compute.manager [req-f3852f27-6f81-48c9-9807-5e08d7264210 req-3d0db00e-3c55-4885-b452-d4872841eada service nova] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Received event network-vif-unplugged-69bb0aea-e59a-49fc-8049-c04a3dc8597c {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f3852f27-6f81-48c9-9807-5e08d7264210 req-3d0db00e-3c55-4885-b452-d4872841eada service nova] Acquiring lock "738eb591-f3dc-4392-b8f2-41530d30ff58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f3852f27-6f81-48c9-9807-5e08d7264210 req-3d0db00e-3c55-4885-b452-d4872841eada service nova] Lock "738eb591-f3dc-4392-b8f2-41530d30ff58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f3852f27-6f81-48c9-9807-5e08d7264210 req-3d0db00e-3c55-4885-b452-d4872841eada service nova] Lock "738eb591-f3dc-4392-b8f2-41530d30ff58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG nova.compute.manager [req-f3852f27-6f81-48c9-9807-5e08d7264210 req-3d0db00e-3c55-4885-b452-d4872841eada service nova] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] No waiting events found dispatching network-vif-unplugged-69bb0aea-e59a-49fc-8049-c04a3dc8597c {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG nova.compute.manager [req-f3852f27-6f81-48c9-9807-5e08d7264210 req-3d0db00e-3c55-4885-b452-d4872841eada service nova] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Received event network-vif-unplugged-69bb0aea-e59a-49fc-8049-c04a3dc8597c for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:26:17 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Instance destroyed successfully.
Oct 16 18:26:17 user nova-compute[74247]: DEBUG nova.objects.instance [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Lazy-loading 'resources' on Instance uuid 738eb591-f3dc-4392-b8f2-41530d30ff58 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:23:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1043768477',display_name='tempest-DeleteServersTestJSON-server-1043768477',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1043768477',id=3,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:24:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8fdc21ff13d14516bf4b96c7b6fee216',ramdisk_id='',reservation_id='r-st5pd0fz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-910315946',owner_user_name='tempest-DeleteServersTestJSON-910315946-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:24:14Z,user_data=None,user_id='179ec1d05cf849078826929622dbfc4c',uuid=738eb591-f3dc-4392-b8f2-41530d30ff58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69bb0aea-e59a-49fc-8049-c04a3dc8597c", "address": "fa:16:3e:25:25:81", "network": {"id": "2ee6c29c-3eb2-4ad9-8405-3c088bb6bf95", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-275444579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fdc21ff13d14516bf4b96c7b6fee216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69bb0aea-e5", "ovs_interfaceid": "69bb0aea-e59a-49fc-8049-c04a3dc8597c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Converting VIF {"id": "69bb0aea-e59a-49fc-8049-c04a3dc8597c", "address": "fa:16:3e:25:25:81", "network": {"id": "2ee6c29c-3eb2-4ad9-8405-3c088bb6bf95", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-275444579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fdc21ff13d14516bf4b96c7b6fee216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69bb0aea-e5", "ovs_interfaceid": "69bb0aea-e59a-49fc-8049-c04a3dc8597c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:25:81,bridge_name='br-int',has_traffic_filtering=True,id=69bb0aea-e59a-49fc-8049-c04a3dc8597c,network=Network(2ee6c29c-3eb2-4ad9-8405-3c088bb6bf95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69bb0aea-e5') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG os_vif [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:25:81,bridge_name='br-int',has_traffic_filtering=True,id=69bb0aea-e59a-49fc-8049-c04a3dc8597c,network=Network(2ee6c29c-3eb2-4ad9-8405-3c088bb6bf95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69bb0aea-e5') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69bb0aea-e5, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2053e99a-25d5-4606-8773-30cdc26f6a35) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:17 user nova-compute[74247]: INFO os_vif [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:25:81,bridge_name='br-int',has_traffic_filtering=True,id=69bb0aea-e59a-49fc-8049-c04a3dc8597c,network=Network(2ee6c29c-3eb2-4ad9-8405-3c088bb6bf95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69bb0aea-e5')
Oct 16 18:26:17 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nUdhOSLH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:26:17 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:26:17 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fecac5-20a7-4966-b05b-a111a5b49f5f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 18:26:17 user nova-compute[74247]: No targets found.
Oct 16 18:26:17 user nova-compute[74247]: iSNS:
Oct 16 18:26:17 user nova-compute[74247]: No targets found.
Oct 16 18:26:17 user nova-compute[74247]: STATIC:
Oct 16 18:26:17 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688
Oct 16 18:26:17 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:26:17 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:26:17 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee
Oct 16 18:26:17 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:26:17 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:26:17 user nova-compute[74247]: FIRMWARE:
Oct 16 18:26:17 user nova-compute[74247]: No targets found.
Oct 16 18:26:17 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 18:26:17 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 18:26:17 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbc7dbc-e540-46e0-a265-1d8834df55b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f47e2f-a231-45e1-9975-e2009b66d2c2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)
Oct 16 18:26:17 user nova-compute[74247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee (non-flash)
Oct 16 18:26:17 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)
Oct 16 18:26:17 user nova-compute[74247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee (non-flash)
Oct 16 18:26:17 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe068373ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee'): ({'sdc'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Removing single pathed devices sdc {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d0aff5-0567-429b-93f7-24508766190f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad4a850-10cf-4eaa-a2d5-b28978f2b839]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Flushing IO for device /dev/sdc {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a405fd-77cf-45c2-ba53-81641201872b]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac34239b-8863-45ed-a19d-807b21fa808c]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] SCSI volumes sdc have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.045s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad70d569-f32b-45c9-9724-7c7cb27c7f07]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c6e027-60f3-4778-b184-490d7a399f98]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee, portal: 172.16.0.220,3260]
Oct 16 18:26:17 user nova-compute[74247]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee, portal: 172.16.0.220,3260] successful.
Oct 16 18:26:17 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:26:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a8f8f82-8f6f-45bc-928f-32acd6f1b0ee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:18 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3e6591-cbbd-40ac-95a9-5b993f6d9dc9]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:18 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:26:18 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:26:18 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] <== disconnect_volume: return (315ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:26:18 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 18:26:18 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Deleting instance files /opt/stack/data/nova/instances/738eb591-f3dc-4392-b8f2-41530d30ff58_del
Oct 16 18:26:18 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Deletion of /opt/stack/data/nova/instances/738eb591-f3dc-4392-b8f2-41530d30ff58_del complete
Oct 16 18:26:18 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74247) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Oct 16 18:26:18 user nova-compute[74247]: INFO nova.virt.libvirt.host [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] UEFI support detected
Oct 16 18:26:18 user nova-compute[74247]: INFO nova.compute.manager [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Took 1.30 seconds to destroy the instance on the hypervisor.
Oct 16 18:26:18 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 18:26:18 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 18:26:18 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 18:26:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:18 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:26:18 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Took 0.80 seconds to deallocate network for instance.
Oct 16 18:26:18 user nova-compute[74247]: DEBUG nova.compute.manager [req-88c148a4-5be4-45d2-9a8c-8b43ee7a3543 req-4bd35609-52ef-4eaa-9f1f-46aa6f71043d service nova] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Received event network-vif-deleted-69bb0aea-e59a-49fc-8049-c04a3dc8597c {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:26:19 user nova-compute[74247]: DEBUG nova.compute.manager [req-c186b1c4-c8d3-40b9-a7d4-85e986f5a5c7 req-5e86e391-a20d-4310-9c4d-679d9ca2d536 service nova] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Received event network-vif-plugged-69bb0aea-e59a-49fc-8049-c04a3dc8597c {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:26:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c186b1c4-c8d3-40b9-a7d4-85e986f5a5c7 req-5e86e391-a20d-4310-9c4d-679d9ca2d536 service nova] Acquiring lock "738eb591-f3dc-4392-b8f2-41530d30ff58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:26:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c186b1c4-c8d3-40b9-a7d4-85e986f5a5c7 req-5e86e391-a20d-4310-9c4d-679d9ca2d536 service nova] Lock "738eb591-f3dc-4392-b8f2-41530d30ff58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:26:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c186b1c4-c8d3-40b9-a7d4-85e986f5a5c7 req-5e86e391-a20d-4310-9c4d-679d9ca2d536 service nova] Lock "738eb591-f3dc-4392-b8f2-41530d30ff58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:26:19 user nova-compute[74247]: DEBUG nova.compute.manager [req-c186b1c4-c8d3-40b9-a7d4-85e986f5a5c7 req-5e86e391-a20d-4310-9c4d-679d9ca2d536 service nova] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] No waiting events found dispatching network-vif-plugged-69bb0aea-e59a-49fc-8049-c04a3dc8597c {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:26:19 user nova-compute[74247]: WARNING nova.compute.manager [req-c186b1c4-c8d3-40b9-a7d4-85e986f5a5c7 req-5e86e391-a20d-4310-9c4d-679d9ca2d536 service nova] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Received unexpected event network-vif-plugged-69bb0aea-e59a-49fc-8049-c04a3dc8597c for instance with vm_state active and task_state deleting.
Oct 16 18:26:19 user nova-compute[74247]: INFO nova.compute.manager [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] [instance: 738eb591-f3dc-4392-b8f2-41530d30ff58] Took 0.85 seconds to detach 1 volumes for instance.
Oct 16 18:26:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:26:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:26:20 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Deleted allocations for instance 738eb591-f3dc-4392-b8f2-41530d30ff58
Oct 16 18:26:20 user nova-compute[74247]: ERROR nova.volume.cinder [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Update attachment failed for attachment e0698c08-39c5-4c0d-9041-2c1057553ecb. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-515a72c2-650d-4253-bb5a-b084998157c1) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-515a72c2-650d-4253-bb5a-b084998157c1)
Oct 16 18:26:20 user nova-compute[74247]: ERROR nova.compute.manager [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-515a72c2-650d-4253-bb5a-b084998157c1)
Oct 16 18:26:20 user nova-compute[74247]: ERROR nova.compute.manager [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Traceback (most recent call last):
Oct 16 18:26:20 user nova-compute[74247]: ERROR nova.compute.manager [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Oct 16 18:26:20 user nova-compute[74247]: ERROR nova.compute.manager [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670]     driver_block_device.attach_block_devices(
Oct 16 18:26:20 user nova-compute[74247]: ERROR nova.compute.manager [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Oct 16 18:26:20 user nova-compute[74247]: ERROR nova.compute.manager [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670]     _log_and_attach(device)
Oct 16 18:26:20 user nova-compute[74247]: ERROR nova.compute.manager [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Oct 16 18:26:20 user nova-compute[74247]: ERROR nova.compute.manager [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670]     bdm.attach(*attach_args, **attach_kwargs)
Oct 16 18:26:20 user nova-compute[74247]: ERROR nova.compute.manager [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 16 18:26:20 user nova-compute[74247]: ERROR nova.compute.manager [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670]     ret_val = method(obj, context, *args, **kwargs)
Oct 16 18:26:20 user nova-compute[74247]: ERROR nova.compute.manager [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 16 18:26:20 user nova-compute[74247]: ERROR nova.compute.manager [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670]     self._do_attach(context, instance, volume, volume_api,
Oct 16 18:26:20 user nova-compute[74247]: ERROR nova.compute.manager [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 16 18:26:20 user nova-compute[74247]: ERROR nova.compute.manager [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670]     self._volume_attach(context, volume, connector, instance,
Oct 16 18:26:20 user nova-compute[74247]: ERROR nova.compute.manager [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 16 18:26:20 user nova-compute[74247]: ERROR nova.compute.manager [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670]     connection_info = volume_api.attachment_update(
Oct 16 18:26:20 user nova-compute[74247]: ERROR nova.compute.manager [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 16 18:26:20 user nova-compute[74247]: ERROR nova.compute.manager [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670]     res = method(self, ctx, *args, **kwargs)
Oct 16 18:26:20 user nova-compute[74247]: ERROR nova.compute.manager [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 16 18:26:20 user nova-compute[74247]: ERROR nova.compute.manager [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 16 18:26:20 user nova-compute[74247]: ERROR nova.compute.manager [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 16 18:26:20 user nova-compute[74247]: ERROR nova.compute.manager [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670]     with excutils.save_and_reraise_exception():
Oct 16 18:26:20 user nova-compute[74247]: ERROR nova.compute.manager [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 16 18:26:20 user nova-compute[74247]: ERROR nova.compute.manager [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670]     self.force_reraise()
Oct 16 18:26:20 user nova-compute[74247]: ERROR nova.compute.manager [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 16 18:26:20 user nova-compute[74247]: ERROR nova.compute.manager [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670]     raise self.value
Oct 16 18:26:20 user nova-compute[74247]: ERROR nova.compute.manager [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 16 18:26:20 user nova-compute[74247]: ERROR nova.compute.manager [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670]     context, '3.44', skip_version_check=True).attachments.update(
Oct 16 18:26:20 user nova-compute[74247]: ERROR nova.compute.manager [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 16 18:26:20 user nova-compute[74247]: ERROR nova.compute.manager [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670]     return method.func(obj, *args, **kwargs)
Oct 16 18:26:20 user nova-compute[74247]: ERROR nova.compute.manager [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 16 18:26:20 user nova-compute[74247]: ERROR nova.compute.manager [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670]     resp = self._update('/attachments/%s' % id, body)
Oct 16 18:26:20 user nova-compute[74247]: ERROR nova.compute.manager [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 16 18:26:20 user nova-compute[74247]: ERROR nova.compute.manager [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 16 18:26:20 user nova-compute[74247]: ERROR nova.compute.manager [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 16 18:26:20 user nova-compute[74247]: ERROR nova.compute.manager [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670]     return self._cs_request(url, 'PUT', **kwargs)
Oct 16 18:26:20 user nova-compute[74247]: ERROR nova.compute.manager [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 16 18:26:20 user nova-compute[74247]: ERROR nova.compute.manager [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670]     return self.request(url, method, **kwargs)
Oct 16 18:26:20 user nova-compute[74247]: ERROR nova.compute.manager [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 16 18:26:20 user nova-compute[74247]: ERROR nova.compute.manager [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670]     raise exceptions.from_response(resp, body)
Oct 16 18:26:20 user nova-compute[74247]: ERROR nova.compute.manager [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-515a72c2-650d-4253-bb5a-b084998157c1)
Oct 16 18:26:20 user nova-compute[74247]: ERROR nova.compute.manager [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] 
Oct 16 18:26:20 user nova-compute[74247]: DEBUG nova.compute.claims [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Aborting claim: <nova.compute.claims.Claim object at 0x7fe068209420> {{(pid=74247) abort /opt/stack/nova/nova/compute/claims.py:84}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e71c74d2-dae5-4ac8-b395-6e016a862b14 tempest-DeleteServersTestJSON-910315946 tempest-DeleteServersTestJSON-910315946-project-member] Lock "738eb591-f3dc-4392-b8f2-41530d30ff58" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.539s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.433s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG nova.compute.manager [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Build of instance 2a7c7eac-216c-4920-ba10-09a06ce90670 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-515a72c2-650d-4253-bb5a-b084998157c1) {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG nova.compute.utils [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Build of instance 2a7c7eac-216c-4920-ba10-09a06ce90670 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=74247) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Oct 16 18:26:20 user nova-compute[74247]: ERROR nova.compute.manager [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Build of instance 2a7c7eac-216c-4920-ba10-09a06ce90670 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-515a72c2-650d-4253-bb5a-b084998157c1): nova.exception.BuildAbortException: Build of instance 2a7c7eac-216c-4920-ba10-09a06ce90670 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-515a72c2-650d-4253-bb5a-b084998157c1)
Oct 16 18:26:20 user nova-compute[74247]: DEBUG nova.compute.manager [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Unplugging VIFs for instance {{(pid=74247) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T18:25:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1309860003',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1309860003',id=11,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmENqe7fXmoP0nWM6gm5nDntKxokCKLS/ZO/3beD5WobXkaoQqE+YcbdsPSKAFN3/yybUZKr+l3+FQ7BQcLjpQ8L/Uh7PlywOkyBH5FM+qkJD/4EUWJQ2lYSt8RrfaD3Q==',key_name='tempest-keypair-494983767',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='805d12d8898a467cabcfe75d9a7993e3',ramdisk_id='',reservation_id='r-55tr4cdh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1047620643',owner_user_name='tempest-TaggedBootDevicesTest-1047620643-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:25:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6157f67de9cf484c9d609fdae827b409',uuid=2a7c7eac-216c-4920-ba10-09a06ce90670,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b75991c-526f-4cbc-a6f1-6a54d998d217", "address": "fa:16:3e:c7:fa:00", "network": {"id": "02486354-2092-462f-b666-40a7d80aca54", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1221482774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "805d12d8898a467cabcfe75d9a7993e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b75991c-52", "ovs_interfaceid": "1b75991c-526f-4cbc-a6f1-6a54d998d217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Converting VIF {"id": "1b75991c-526f-4cbc-a6f1-6a54d998d217", "address": "fa:16:3e:c7:fa:00", "network": {"id": "02486354-2092-462f-b666-40a7d80aca54", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1221482774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "805d12d8898a467cabcfe75d9a7993e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b75991c-52", "ovs_interfaceid": "1b75991c-526f-4cbc-a6f1-6a54d998d217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:fa:00,bridge_name='br-int',has_traffic_filtering=True,id=1b75991c-526f-4cbc-a6f1-6a54d998d217,network=Network(02486354-2092-462f-b666-40a7d80aca54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b75991c-52') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG os_vif [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:fa:00,bridge_name='br-int',has_traffic_filtering=True,id=1b75991c-526f-4cbc-a6f1-6a54d998d217,network=Network(02486354-2092-462f-b666-40a7d80aca54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b75991c-52') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b75991c-52, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:26:20 user nova-compute[74247]: INFO os_vif [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:fa:00,bridge_name='br-int',has_traffic_filtering=True,id=1b75991c-526f-4cbc-a6f1-6a54d998d217,network=Network(02486354-2092-462f-b666-40a7d80aca54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b75991c-52')
Oct 16 18:26:20 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T18:25:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1309860003',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1309860003',id=11,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmENqe7fXmoP0nWM6gm5nDntKxokCKLS/ZO/3beD5WobXkaoQqE+YcbdsPSKAFN3/yybUZKr+l3+FQ7BQcLjpQ8L/Uh7PlywOkyBH5FM+qkJD/4EUWJQ2lYSt8RrfaD3Q==',key_name='tempest-keypair-494983767',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='805d12d8898a467cabcfe75d9a7993e3',ramdisk_id='',reservation_id='r-55tr4cdh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1047620643',owner_user_name='tempest-TaggedBootDevicesTest-1047620643-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:25:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6157f67de9cf484c9d609fdae827b409',uuid=2a7c7eac-216c-4920-ba10-09a06ce90670,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb0df529-b40c-48af-91ee-009b5086c644", "address": "fa:16:3e:29:d2:55", "network": {"id": "cde9d65e-9ab9-49b6-b931-371b5c6a9e51", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092195528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "805d12d8898a467cabcfe75d9a7993e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb0df529-b4", "ovs_interfaceid": "bb0df529-b40c-48af-91ee-009b5086c644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Converting VIF {"id": "bb0df529-b40c-48af-91ee-009b5086c644", "address": "fa:16:3e:29:d2:55", "network": {"id": "cde9d65e-9ab9-49b6-b931-371b5c6a9e51", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092195528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "805d12d8898a467cabcfe75d9a7993e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb0df529-b4", "ovs_interfaceid": "bb0df529-b40c-48af-91ee-009b5086c644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:d2:55,bridge_name='br-int',has_traffic_filtering=True,id=bb0df529-b40c-48af-91ee-009b5086c644,network=Network(cde9d65e-9ab9-49b6-b931-371b5c6a9e51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbb0df529-b4') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG os_vif [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:d2:55,bridge_name='br-int',has_traffic_filtering=True,id=bb0df529-b40c-48af-91ee-009b5086c644,network=Network(cde9d65e-9ab9-49b6-b931-371b5c6a9e51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbb0df529-b4') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbb0df529-b4, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:26:20 user nova-compute[74247]: INFO os_vif [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:d2:55,bridge_name='br-int',has_traffic_filtering=True,id=bb0df529-b40c-48af-91ee-009b5086c644,network=Network(cde9d65e-9ab9-49b6-b931-371b5c6a9e51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbb0df529-b4')
Oct 16 18:26:20 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T18:25:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1309860003',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1309860003',id=11,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmENqe7fXmoP0nWM6gm5nDntKxokCKLS/ZO/3beD5WobXkaoQqE+YcbdsPSKAFN3/yybUZKr+l3+FQ7BQcLjpQ8L/Uh7PlywOkyBH5FM+qkJD/4EUWJQ2lYSt8RrfaD3Q==',key_name='tempest-keypair-494983767',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='805d12d8898a467cabcfe75d9a7993e3',ramdisk_id='',reservation_id='r-55tr4cdh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1047620643',owner_user_name='tempest-TaggedBootDevicesTest-1047620643-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:25:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6157f67de9cf484c9d609fdae827b409',uuid=2a7c7eac-216c-4920-ba10-09a06ce90670,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11f23933-052e-43ba-bafd-f89fd03d307d", "address": "fa:16:3e:54:12:92", "network": {"id": "cde9d65e-9ab9-49b6-b931-371b5c6a9e51", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092195528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "805d12d8898a467cabcfe75d9a7993e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11f23933-05", "ovs_interfaceid": "11f23933-052e-43ba-bafd-f89fd03d307d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Converting VIF {"id": "11f23933-052e-43ba-bafd-f89fd03d307d", "address": "fa:16:3e:54:12:92", "network": {"id": "cde9d65e-9ab9-49b6-b931-371b5c6a9e51", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092195528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "805d12d8898a467cabcfe75d9a7993e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11f23933-05", "ovs_interfaceid": "11f23933-052e-43ba-bafd-f89fd03d307d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:12:92,bridge_name='br-int',has_traffic_filtering=True,id=11f23933-052e-43ba-bafd-f89fd03d307d,network=Network(cde9d65e-9ab9-49b6-b931-371b5c6a9e51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap11f23933-05') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG os_vif [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:12:92,bridge_name='br-int',has_traffic_filtering=True,id=11f23933-052e-43ba-bafd-f89fd03d307d,network=Network(cde9d65e-9ab9-49b6-b931-371b5c6a9e51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap11f23933-05') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11f23933-05, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:26:20 user nova-compute[74247]: INFO os_vif [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:12:92,bridge_name='br-int',has_traffic_filtering=True,id=11f23933-052e-43ba-bafd-f89fd03d307d,network=Network(cde9d65e-9ab9-49b6-b931-371b5c6a9e51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap11f23933-05')
Oct 16 18:26:20 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T18:25:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1309860003',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1309860003',id=11,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmENqe7fXmoP0nWM6gm5nDntKxokCKLS/ZO/3beD5WobXkaoQqE+YcbdsPSKAFN3/yybUZKr+l3+FQ7BQcLjpQ8L/Uh7PlywOkyBH5FM+qkJD/4EUWJQ2lYSt8RrfaD3Q==',key_name='tempest-keypair-494983767',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='805d12d8898a467cabcfe75d9a7993e3',ramdisk_id='',reservation_id='r-55tr4cdh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1047620643',owner_user_name='tempest-TaggedBootDevicesTest-1047620643-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:25:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6157f67de9cf484c9d609fdae827b409',uuid=2a7c7eac-216c-4920-ba10-09a06ce90670,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15bdf694-4ae8-4cdd-a76d-34e4b2b19517", "address": "fa:16:3e:97:51:a6", "network": {"id": "cde9d65e-9ab9-49b6-b931-371b5c6a9e51", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092195528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "805d12d8898a467cabcfe75d9a7993e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15bdf694-4a", "ovs_interfaceid": "15bdf694-4ae8-4cdd-a76d-34e4b2b19517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Converting VIF {"id": "15bdf694-4ae8-4cdd-a76d-34e4b2b19517", "address": "fa:16:3e:97:51:a6", "network": {"id": "cde9d65e-9ab9-49b6-b931-371b5c6a9e51", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092195528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "805d12d8898a467cabcfe75d9a7993e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15bdf694-4a", "ovs_interfaceid": "15bdf694-4ae8-4cdd-a76d-34e4b2b19517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:51:a6,bridge_name='br-int',has_traffic_filtering=True,id=15bdf694-4ae8-4cdd-a76d-34e4b2b19517,network=Network(cde9d65e-9ab9-49b6-b931-371b5c6a9e51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15bdf694-4a') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG os_vif [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:51:a6,bridge_name='br-int',has_traffic_filtering=True,id=15bdf694-4ae8-4cdd-a76d-34e4b2b19517,network=Network(cde9d65e-9ab9-49b6-b931-371b5c6a9e51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15bdf694-4a') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15bdf694-4a, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:26:20 user nova-compute[74247]: INFO os_vif [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:51:a6,bridge_name='br-int',has_traffic_filtering=True,id=15bdf694-4ae8-4cdd-a76d-34e4b2b19517,network=Network(cde9d65e-9ab9-49b6-b931-371b5c6a9e51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15bdf694-4a')
Oct 16 18:26:20 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T18:25:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1309860003',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1309860003',id=11,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmENqe7fXmoP0nWM6gm5nDntKxokCKLS/ZO/3beD5WobXkaoQqE+YcbdsPSKAFN3/yybUZKr+l3+FQ7BQcLjpQ8L/Uh7PlywOkyBH5FM+qkJD/4EUWJQ2lYSt8RrfaD3Q==',key_name='tempest-keypair-494983767',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='805d12d8898a467cabcfe75d9a7993e3',ramdisk_id='',reservation_id='r-55tr4cdh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1047620643',owner_user_name='tempest-TaggedBootDevicesTest-1047620643-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:25:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6157f67de9cf484c9d609fdae827b409',uuid=2a7c7eac-216c-4920-ba10-09a06ce90670,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f18e494b-cafc-4382-9808-0ea17ecadb46", "address": "fa:16:3e:46:25:58", "network": {"id": "cde9d65e-9ab9-49b6-b931-371b5c6a9e51", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092195528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "805d12d8898a467cabcfe75d9a7993e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18e494b-ca", "ovs_interfaceid": "f18e494b-cafc-4382-9808-0ea17ecadb46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Converting VIF {"id": "f18e494b-cafc-4382-9808-0ea17ecadb46", "address": "fa:16:3e:46:25:58", "network": {"id": "cde9d65e-9ab9-49b6-b931-371b5c6a9e51", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092195528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "805d12d8898a467cabcfe75d9a7993e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18e494b-ca", "ovs_interfaceid": "f18e494b-cafc-4382-9808-0ea17ecadb46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:25:58,bridge_name='br-int',has_traffic_filtering=True,id=f18e494b-cafc-4382-9808-0ea17ecadb46,network=Network(cde9d65e-9ab9-49b6-b931-371b5c6a9e51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf18e494b-ca') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG os_vif [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:25:58,bridge_name='br-int',has_traffic_filtering=True,id=f18e494b-cafc-4382-9808-0ea17ecadb46,network=Network(cde9d65e-9ab9-49b6-b931-371b5c6a9e51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf18e494b-ca') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf18e494b-ca, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:26:20 user nova-compute[74247]: INFO os_vif [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:25:58,bridge_name='br-int',has_traffic_filtering=True,id=f18e494b-cafc-4382-9808-0ea17ecadb46,network=Network(cde9d65e-9ab9-49b6-b931-371b5c6a9e51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf18e494b-ca')
Oct 16 18:26:20 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T18:25:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1309860003',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1309860003',id=11,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmENqe7fXmoP0nWM6gm5nDntKxokCKLS/ZO/3beD5WobXkaoQqE+YcbdsPSKAFN3/yybUZKr+l3+FQ7BQcLjpQ8L/Uh7PlywOkyBH5FM+qkJD/4EUWJQ2lYSt8RrfaD3Q==',key_name='tempest-keypair-494983767',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='805d12d8898a467cabcfe75d9a7993e3',ramdisk_id='',reservation_id='r-55tr4cdh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1047620643',owner_user_name='tempest-TaggedBootDevicesTest-1047620643-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:25:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6157f67de9cf484c9d609fdae827b409',uuid=2a7c7eac-216c-4920-ba10-09a06ce90670,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1c3e1dc-e2fd-4292-927d-26f011f66294", "address": "fa:16:3e:89:48:70", "network": {"id": "c1d8ca7b-2b19-46c3-a3c3-a68051e3ef92", "bridge": "br-int", "label": "tempest-device-tagging-net2-1464764926", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "805d12d8898a467cabcfe75d9a7993e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1c3e1dc-e2", "ovs_interfaceid": "c1c3e1dc-e2fd-4292-927d-26f011f66294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Converting VIF {"id": "c1c3e1dc-e2fd-4292-927d-26f011f66294", "address": "fa:16:3e:89:48:70", "network": {"id": "c1d8ca7b-2b19-46c3-a3c3-a68051e3ef92", "bridge": "br-int", "label": "tempest-device-tagging-net2-1464764926", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "805d12d8898a467cabcfe75d9a7993e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1c3e1dc-e2", "ovs_interfaceid": "c1c3e1dc-e2fd-4292-927d-26f011f66294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:48:70,bridge_name='br-int',has_traffic_filtering=True,id=c1c3e1dc-e2fd-4292-927d-26f011f66294,network=Network(c1d8ca7b-2b19-46c3-a3c3-a68051e3ef92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1c3e1dc-e2') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG os_vif [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:48:70,bridge_name='br-int',has_traffic_filtering=True,id=c1c3e1dc-e2fd-4292-927d-26f011f66294,network=Network(c1d8ca7b-2b19-46c3-a3c3-a68051e3ef92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1c3e1dc-e2') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc1c3e1dc-e2, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:26:20 user nova-compute[74247]: INFO os_vif [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:48:70,bridge_name='br-int',has_traffic_filtering=True,id=c1c3e1dc-e2fd-4292-927d-26f011f66294,network=Network(c1d8ca7b-2b19-46c3-a3c3-a68051e3ef92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1c3e1dc-e2')
Oct 16 18:26:20 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T18:25:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1309860003',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1309860003',id=11,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmENqe7fXmoP0nWM6gm5nDntKxokCKLS/ZO/3beD5WobXkaoQqE+YcbdsPSKAFN3/yybUZKr+l3+FQ7BQcLjpQ8L/Uh7PlywOkyBH5FM+qkJD/4EUWJQ2lYSt8RrfaD3Q==',key_name='tempest-keypair-494983767',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='805d12d8898a467cabcfe75d9a7993e3',ramdisk_id='',reservation_id='r-55tr4cdh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1047620643',owner_user_name='tempest-TaggedBootDevicesTest-1047620643-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:25:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6157f67de9cf484c9d609fdae827b409',uuid=2a7c7eac-216c-4920-ba10-09a06ce90670,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f89f8d7b-d509-44ca-9c19-3c99b28b72fc", "address": "fa:16:3e:8e:a9:c0", "network": {"id": "c1d8ca7b-2b19-46c3-a3c3-a68051e3ef92", "bridge": "br-int", "label": "tempest-device-tagging-net2-1464764926", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "805d12d8898a467cabcfe75d9a7993e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf89f8d7b-d5", "ovs_interfaceid": "f89f8d7b-d509-44ca-9c19-3c99b28b72fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Converting VIF {"id": "f89f8d7b-d509-44ca-9c19-3c99b28b72fc", "address": "fa:16:3e:8e:a9:c0", "network": {"id": "c1d8ca7b-2b19-46c3-a3c3-a68051e3ef92", "bridge": "br-int", "label": "tempest-device-tagging-net2-1464764926", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "805d12d8898a467cabcfe75d9a7993e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf89f8d7b-d5", "ovs_interfaceid": "f89f8d7b-d509-44ca-9c19-3c99b28b72fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:a9:c0,bridge_name='br-int',has_traffic_filtering=True,id=f89f8d7b-d509-44ca-9c19-3c99b28b72fc,network=Network(c1d8ca7b-2b19-46c3-a3c3-a68051e3ef92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf89f8d7b-d5') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG os_vif [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:a9:c0,bridge_name='br-int',has_traffic_filtering=True,id=f89f8d7b-d509-44ca-9c19-3c99b28b72fc,network=Network(c1d8ca7b-2b19-46c3-a3c3-a68051e3ef92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf89f8d7b-d5') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf89f8d7b-d5, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:26:20 user nova-compute[74247]: INFO os_vif [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:a9:c0,bridge_name='br-int',has_traffic_filtering=True,id=f89f8d7b-d509-44ca-9c19-3c99b28b72fc,network=Network(c1d8ca7b-2b19-46c3-a3c3-a68051e3ef92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf89f8d7b-d5')
Oct 16 18:26:20 user nova-compute[74247]: DEBUG nova.compute.manager [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Unplugged VIFs for instance {{(pid=74247) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG nova.compute.manager [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 18:26:20 user nova-compute[74247]: DEBUG nova.network.neutron [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 18:26:21 user nova-compute[74247]: DEBUG nova.compute.manager [req-a813bc03-a6f9-4170-981d-5945c1a21def req-ca8e0111-d7b2-4d33-96c0-c7637336d097 service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Received event network-changed-59256fa7-ebbd-4cde-80c4-012340d7aea0 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:26:21 user nova-compute[74247]: DEBUG nova.compute.manager [req-a813bc03-a6f9-4170-981d-5945c1a21def req-ca8e0111-d7b2-4d33-96c0-c7637336d097 service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Refreshing instance network info cache due to event network-changed-59256fa7-ebbd-4cde-80c4-012340d7aea0. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:26:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a813bc03-a6f9-4170-981d-5945c1a21def req-ca8e0111-d7b2-4d33-96c0-c7637336d097 service nova] Acquiring lock "refresh_cache-c048698e-de64-4124-8d72-57fb819bb80e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:26:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a813bc03-a6f9-4170-981d-5945c1a21def req-ca8e0111-d7b2-4d33-96c0-c7637336d097 service nova] Acquired lock "refresh_cache-c048698e-de64-4124-8d72-57fb819bb80e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:26:21 user nova-compute[74247]: DEBUG nova.network.neutron [req-a813bc03-a6f9-4170-981d-5945c1a21def req-ca8e0111-d7b2-4d33-96c0-c7637336d097 service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Refreshing network info cache for port 59256fa7-ebbd-4cde-80c4-012340d7aea0 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:26:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5414777c-c59f-44fb-8c96-d1f48660be16 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Acquiring lock "interface-c048698e-de64-4124-8d72-57fb819bb80e-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:26:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5414777c-c59f-44fb-8c96-d1f48660be16 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Lock "interface-c048698e-de64-4124-8d72-57fb819bb80e-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:26:21 user nova-compute[74247]: DEBUG nova.objects.instance [None req-5414777c-c59f-44fb-8c96-d1f48660be16 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Lazy-loading 'flavor' on Instance uuid c048698e-de64-4124-8d72-57fb819bb80e {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:26:21 user nova-compute[74247]: DEBUG nova.objects.instance [None req-5414777c-c59f-44fb-8c96-d1f48660be16 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Lazy-loading 'pci_requests' on Instance uuid c048698e-de64-4124-8d72-57fb819bb80e {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:26:21 user nova-compute[74247]: DEBUG nova.objects.base [None req-5414777c-c59f-44fb-8c96-d1f48660be16 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Object Instance<c048698e-de64-4124-8d72-57fb819bb80e> lazy-loaded attributes: flavor,pci_requests {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:26:21 user nova-compute[74247]: DEBUG nova.network.neutron [None req-5414777c-c59f-44fb-8c96-d1f48660be16 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 18:26:22 user nova-compute[74247]: DEBUG nova.policy [None req-5414777c-c59f-44fb-8c96-d1f48660be16 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b2000726f45b45feb6c3c5cedcbd40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab4b3ccbd914164a2d5b38c7b89777b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 18:26:22 user nova-compute[74247]: DEBUG nova.network.neutron [req-a813bc03-a6f9-4170-981d-5945c1a21def req-ca8e0111-d7b2-4d33-96c0-c7637336d097 service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Updated VIF entry in instance network info cache for port 59256fa7-ebbd-4cde-80c4-012340d7aea0. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:26:22 user nova-compute[74247]: DEBUG nova.network.neutron [req-a813bc03-a6f9-4170-981d-5945c1a21def req-ca8e0111-d7b2-4d33-96c0-c7637336d097 service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Updating instance_info_cache with network_info: [{"id": "59256fa7-ebbd-4cde-80c4-012340d7aea0", "address": "fa:16:3e:ff:27:0b", "network": {"id": "f35ee734-1070-4c5a-84f5-c76501c1b6cb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1676802825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ab4b3ccbd914164a2d5b38c7b89777b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59256fa7-eb", "ovs_interfaceid": "59256fa7-ebbd-4cde-80c4-012340d7aea0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:26:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a813bc03-a6f9-4170-981d-5945c1a21def req-ca8e0111-d7b2-4d33-96c0-c7637336d097 service nova] Releasing lock "refresh_cache-c048698e-de64-4124-8d72-57fb819bb80e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:26:22 user nova-compute[74247]: DEBUG nova.network.neutron [None req-5414777c-c59f-44fb-8c96-d1f48660be16 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Successfully created port: 246d0c9d-bed7-460d-bbfd-0cb2ebe16dda {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:26:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:23 user nova-compute[74247]: DEBUG nova.network.neutron [None req-5414777c-c59f-44fb-8c96-d1f48660be16 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Successfully updated port: 246d0c9d-bed7-460d-bbfd-0cb2ebe16dda {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:26:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5414777c-c59f-44fb-8c96-d1f48660be16 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Acquiring lock "refresh_cache-c048698e-de64-4124-8d72-57fb819bb80e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:26:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5414777c-c59f-44fb-8c96-d1f48660be16 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Acquired lock "refresh_cache-c048698e-de64-4124-8d72-57fb819bb80e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:26:23 user nova-compute[74247]: DEBUG nova.network.neutron [None req-5414777c-c59f-44fb-8c96-d1f48660be16 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:26:23 user nova-compute[74247]: DEBUG nova.compute.manager [req-e7a00619-4ab7-455d-a0fb-a0cd2385f97b req-55979387-21bb-49f6-9fe6-34fa6fc6e2b8 service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Received event network-changed-246d0c9d-bed7-460d-bbfd-0cb2ebe16dda {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:26:23 user nova-compute[74247]: DEBUG nova.compute.manager [req-e7a00619-4ab7-455d-a0fb-a0cd2385f97b req-55979387-21bb-49f6-9fe6-34fa6fc6e2b8 service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Refreshing instance network info cache due to event network-changed-246d0c9d-bed7-460d-bbfd-0cb2ebe16dda. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:26:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e7a00619-4ab7-455d-a0fb-a0cd2385f97b req-55979387-21bb-49f6-9fe6-34fa6fc6e2b8 service nova] Acquiring lock "refresh_cache-c048698e-de64-4124-8d72-57fb819bb80e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:26:23 user nova-compute[74247]: DEBUG nova.network.neutron [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:26:23 user nova-compute[74247]: INFO nova.compute.manager [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Took 2.89 seconds to deallocate network for instance.
Oct 16 18:26:23 user nova-compute[74247]: DEBUG nova.compute.manager [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Detaching volume: fb4857db-f30c-4dc5-9bab-a55a8e551f70 {{(pid=74247) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Oct 16 18:26:23 user nova-compute[74247]: INFO nova.compute.manager [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Detaching volume fb4857db-f30c-4dc5-9bab-a55a8e551f70
Oct 16 18:26:23 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Skipping driver_detach during remote rebuild. {{(pid=74247) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG nova.network.neutron [None req-5414777c-c59f-44fb-8c96-d1f48660be16 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Updating instance_info_cache with network_info: [{"id": "59256fa7-ebbd-4cde-80c4-012340d7aea0", "address": "fa:16:3e:ff:27:0b", "network": {"id": "f35ee734-1070-4c5a-84f5-c76501c1b6cb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1676802825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ab4b3ccbd914164a2d5b38c7b89777b", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59256fa7-eb", "ovs_interfaceid": "59256fa7-ebbd-4cde-80c4-012340d7aea0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "246d0c9d-bed7-460d-bbfd-0cb2ebe16dda", "address": "fa:16:3e:bc:93:6e", "network": {"id": "d0a8c577-68e9-4fc9-bb48-78cf1feb05a5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1663196803", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4ab4b3ccbd914164a2d5b38c7b89777b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap246d0c9d-be", "ovs_interfaceid": "246d0c9d-bed7-460d-bbfd-0cb2ebe16dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5414777c-c59f-44fb-8c96-d1f48660be16 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Releasing lock "refresh_cache-c048698e-de64-4124-8d72-57fb819bb80e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e7a00619-4ab7-455d-a0fb-a0cd2385f97b req-55979387-21bb-49f6-9fe6-34fa6fc6e2b8 service nova] Acquired lock "refresh_cache-c048698e-de64-4124-8d72-57fb819bb80e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG nova.network.neutron [req-e7a00619-4ab7-455d-a0fb-a0cd2385f97b req-55979387-21bb-49f6-9fe6-34fa6fc6e2b8 service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Refreshing network info cache for port 246d0c9d-bed7-460d-bbfd-0cb2ebe16dda {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-5414777c-c59f-44fb-8c96-d1f48660be16 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T18:24:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1708908380',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1708908380',id=6,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4t5/HxarVjAIcPE9zeByR72HYnWO4eclBUfo863abS/M64e1Oj/mYiR12Cs6HtPrtMLyPaTm6rvsRa3pNGaznOooPgv/HGuQCekMNKw81O1jY6NY8zkFrvxeZV5v6ZKw==',key_name='tempest-keypair-1905579868',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:24:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4ab4b3ccbd914164a2d5b38c7b89777b',ramdisk_id='',reservation_id='r-jcqqfx36',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1522926684',owner_user_name='tempest-TaggedAttachmentsTest-1522926684-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:24:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2000726f45b45feb6c3c5cedcbd40e2',uuid=c048698e-de64-4124-8d72-57fb819bb80e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "246d0c9d-bed7-460d-bbfd-0cb2ebe16dda", "address": "fa:16:3e:bc:93:6e", "network": {"id": "d0a8c577-68e9-4fc9-bb48-78cf1feb05a5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1663196803", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4ab4b3ccbd914164a2d5b38c7b89777b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap246d0c9d-be", "ovs_interfaceid": "246d0c9d-bed7-460d-bbfd-0cb2ebe16dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-5414777c-c59f-44fb-8c96-d1f48660be16 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Converting VIF {"id": "246d0c9d-bed7-460d-bbfd-0cb2ebe16dda", "address": "fa:16:3e:bc:93:6e", "network": {"id": "d0a8c577-68e9-4fc9-bb48-78cf1feb05a5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1663196803", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4ab4b3ccbd914164a2d5b38c7b89777b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap246d0c9d-be", "ovs_interfaceid": "246d0c9d-bed7-460d-bbfd-0cb2ebe16dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-5414777c-c59f-44fb-8c96-d1f48660be16 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:93:6e,bridge_name='br-int',has_traffic_filtering=True,id=246d0c9d-bed7-460d-bbfd-0cb2ebe16dda,network=Network(d0a8c577-68e9-4fc9-bb48-78cf1feb05a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap246d0c9d-be') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG os_vif [None req-5414777c-c59f-44fb-8c96-d1f48660be16 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:93:6e,bridge_name='br-int',has_traffic_filtering=True,id=246d0c9d-bed7-460d-bbfd-0cb2ebe16dda,network=Network(d0a8c577-68e9-4fc9-bb48-78cf1feb05a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap246d0c9d-be') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c05f73db-c8e7-5163-86ed-e3a2077c1cfa', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap246d0c9d-be, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap246d0c9d-be, col_values=(('qos', UUID('61030170-22af-44db-a911-d256451a9f44')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap246d0c9d-be, col_values=(('external_ids', {'iface-id': '246d0c9d-bed7-460d-bbfd-0cb2ebe16dda', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:93:6e', 'vm-uuid': 'c048698e-de64-4124-8d72-57fb819bb80e'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:24 user nova-compute[74247]: INFO os_vif [None req-5414777c-c59f-44fb-8c96-d1f48660be16 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:93:6e,bridge_name='br-int',has_traffic_filtering=True,id=246d0c9d-bed7-460d-bbfd-0cb2ebe16dda,network=Network(d0a8c577-68e9-4fc9-bb48-78cf1feb05a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap246d0c9d-be')
Oct 16 18:26:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-5414777c-c59f-44fb-8c96-d1f48660be16 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T18:24:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1708908380',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1708908380',id=6,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4t5/HxarVjAIcPE9zeByR72HYnWO4eclBUfo863abS/M64e1Oj/mYiR12Cs6HtPrtMLyPaTm6rvsRa3pNGaznOooPgv/HGuQCekMNKw81O1jY6NY8zkFrvxeZV5v6ZKw==',key_name='tempest-keypair-1905579868',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:24:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4ab4b3ccbd914164a2d5b38c7b89777b',ramdisk_id='',reservation_id='r-jcqqfx36',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1522926684',owner_user_name='tempest-TaggedAttachmentsTest-1522926684-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:24:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2000726f45b45feb6c3c5cedcbd40e2',uuid=c048698e-de64-4124-8d72-57fb819bb80e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "246d0c9d-bed7-460d-bbfd-0cb2ebe16dda", "address": "fa:16:3e:bc:93:6e", "network": {"id": "d0a8c577-68e9-4fc9-bb48-78cf1feb05a5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1663196803", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4ab4b3ccbd914164a2d5b38c7b89777b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap246d0c9d-be", "ovs_interfaceid": "246d0c9d-bed7-460d-bbfd-0cb2ebe16dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-5414777c-c59f-44fb-8c96-d1f48660be16 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Converting VIF {"id": "246d0c9d-bed7-460d-bbfd-0cb2ebe16dda", "address": "fa:16:3e:bc:93:6e", "network": {"id": "d0a8c577-68e9-4fc9-bb48-78cf1feb05a5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1663196803", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4ab4b3ccbd914164a2d5b38c7b89777b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap246d0c9d-be", "ovs_interfaceid": "246d0c9d-bed7-460d-bbfd-0cb2ebe16dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-5414777c-c59f-44fb-8c96-d1f48660be16 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:93:6e,bridge_name='br-int',has_traffic_filtering=True,id=246d0c9d-bed7-460d-bbfd-0cb2ebe16dda,network=Network(d0a8c577-68e9-4fc9-bb48-78cf1feb05a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap246d0c9d-be') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-5414777c-c59f-44fb-8c96-d1f48660be16 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] attach device xml: <interface type="ethernet">
Oct 16 18:26:24 user nova-compute[74247]:   <mac address="fa:16:3e:bc:93:6e"/>
Oct 16 18:26:24 user nova-compute[74247]:   <model type="virtio"/>
Oct 16 18:26:24 user nova-compute[74247]:   <mtu size="1442"/>
Oct 16 18:26:24 user nova-compute[74247]:   <target dev="tap246d0c9d-be"/>
Oct 16 18:26:24 user nova-compute[74247]: </interface>
Oct 16 18:26:24 user nova-compute[74247]:  {{(pid=74247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG nova.network.neutron [req-e7a00619-4ab7-455d-a0fb-a0cd2385f97b req-55979387-21bb-49f6-9fe6-34fa6fc6e2b8 service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Updated VIF entry in instance network info cache for port 246d0c9d-bed7-460d-bbfd-0cb2ebe16dda. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG nova.network.neutron [req-e7a00619-4ab7-455d-a0fb-a0cd2385f97b req-55979387-21bb-49f6-9fe6-34fa6fc6e2b8 service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Updating instance_info_cache with network_info: [{"id": "59256fa7-ebbd-4cde-80c4-012340d7aea0", "address": "fa:16:3e:ff:27:0b", "network": {"id": "f35ee734-1070-4c5a-84f5-c76501c1b6cb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1676802825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ab4b3ccbd914164a2d5b38c7b89777b", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59256fa7-eb", "ovs_interfaceid": "59256fa7-ebbd-4cde-80c4-012340d7aea0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "246d0c9d-bed7-460d-bbfd-0cb2ebe16dda", "address": "fa:16:3e:bc:93:6e", "network": {"id": "d0a8c577-68e9-4fc9-bb48-78cf1feb05a5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1663196803", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4ab4b3ccbd914164a2d5b38c7b89777b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap246d0c9d-be", "ovs_interfaceid": "246d0c9d-bed7-460d-bbfd-0cb2ebe16dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e7a00619-4ab7-455d-a0fb-a0cd2385f97b req-55979387-21bb-49f6-9fe6-34fa6fc6e2b8 service nova] Releasing lock "refresh_cache-c048698e-de64-4124-8d72-57fb819bb80e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-5414777c-c59f-44fb-8c96-d1f48660be16 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-5414777c-c59f-44fb-8c96-d1f48660be16 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] No BDM found with device name hda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-5414777c-c59f-44fb-8c96-d1f48660be16 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] No VIF found with MAC fa:16:3e:ff:27:0b, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-5414777c-c59f-44fb-8c96-d1f48660be16 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:26:24 user nova-compute[74247]:   <nova:package version="0.0.0"/>
Oct 16 18:26:24 user nova-compute[74247]:   <nova:name>tempest-device-tagging-server-1708908380</nova:name>
Oct 16 18:26:24 user nova-compute[74247]:   <nova:creationTime>2023-10-16 18:26:24</nova:creationTime>
Oct 16 18:26:24 user nova-compute[74247]:   <nova:flavor name="m1.tiny">
Oct 16 18:26:24 user nova-compute[74247]:     <nova:memory>512</nova:memory>
Oct 16 18:26:24 user nova-compute[74247]:     <nova:disk>1</nova:disk>
Oct 16 18:26:24 user nova-compute[74247]:     <nova:swap>0</nova:swap>
Oct 16 18:26:24 user nova-compute[74247]:     <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:26:24 user nova-compute[74247]:     <nova:vcpus>1</nova:vcpus>
Oct 16 18:26:24 user nova-compute[74247]:   </nova:flavor>
Oct 16 18:26:24 user nova-compute[74247]:   <nova:owner>
Oct 16 18:26:24 user nova-compute[74247]:     <nova:user uuid="b2000726f45b45feb6c3c5cedcbd40e2">tempest-TaggedAttachmentsTest-1522926684-project-member</nova:user>
Oct 16 18:26:24 user nova-compute[74247]:     <nova:project uuid="4ab4b3ccbd914164a2d5b38c7b89777b">tempest-TaggedAttachmentsTest-1522926684</nova:project>
Oct 16 18:26:24 user nova-compute[74247]:   </nova:owner>
Oct 16 18:26:24 user nova-compute[74247]:   <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:26:24 user nova-compute[74247]:   <nova:ports>
Oct 16 18:26:24 user nova-compute[74247]:     <nova:port uuid="59256fa7-ebbd-4cde-80c4-012340d7aea0">
Oct 16 18:26:24 user nova-compute[74247]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 16 18:26:24 user nova-compute[74247]:     </nova:port>
Oct 16 18:26:24 user nova-compute[74247]:     <nova:port uuid="246d0c9d-bed7-460d-bbfd-0cb2ebe16dda">
Oct 16 18:26:24 user nova-compute[74247]:       <nova:ip type="fixed" address="10.10.10.162" ipVersion="4"/>
Oct 16 18:26:24 user nova-compute[74247]:     </nova:port>
Oct 16 18:26:24 user nova-compute[74247]:   </nova:ports>
Oct 16 18:26:24 user nova-compute[74247]: </nova:instance>
Oct 16 18:26:24 user nova-compute[74247]:  {{(pid=74247) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG nova.compute.manager [req-dafd6fb1-d017-413d-80be-f08bcff93667 req-b61577a8-902a-4e2b-b8ac-8df81858ad60 service nova] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Received event network-changed-9f035e65-b642-4b32-a5b2-1e82808c6ccc {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG nova.compute.manager [req-dafd6fb1-d017-413d-80be-f08bcff93667 req-b61577a8-902a-4e2b-b8ac-8df81858ad60 service nova] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Refreshing instance network info cache due to event network-changed-9f035e65-b642-4b32-a5b2-1e82808c6ccc. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-dafd6fb1-d017-413d-80be-f08bcff93667 req-b61577a8-902a-4e2b-b8ac-8df81858ad60 service nova] Acquiring lock "refresh_cache-ff1e2d26-57c5-4aa1-b66f-3ead29571b7e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-dafd6fb1-d017-413d-80be-f08bcff93667 req-b61577a8-902a-4e2b-b8ac-8df81858ad60 service nova] Acquired lock "refresh_cache-ff1e2d26-57c5-4aa1-b66f-3ead29571b7e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG nova.network.neutron [req-dafd6fb1-d017-413d-80be-f08bcff93667 req-b61577a8-902a-4e2b-b8ac-8df81858ad60 service nova] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Refreshing network info cache for port 9f035e65-b642-4b32-a5b2-1e82808c6ccc {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5414777c-c59f-44fb-8c96-d1f48660be16 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Lock "interface-c048698e-de64-4124-8d72-57fb819bb80e-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.027s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Acquiring lock "ff1e2d26-57c5-4aa1-b66f-3ead29571b7e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Lock "ff1e2d26-57c5-4aa1-b66f-3ead29571b7e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:26:24 user nova-compute[74247]: DEBUG nova.objects.instance [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Lazy-loading 'flavor' on Instance uuid ff1e2d26-57c5-4aa1-b66f-3ead29571b7e {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:26:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Lock "ff1e2d26-57c5-4aa1-b66f-3ead29571b7e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:26:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Acquiring lock "ff1e2d26-57c5-4aa1-b66f-3ead29571b7e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:26:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Lock "ff1e2d26-57c5-4aa1-b66f-3ead29571b7e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:26:25 user nova-compute[74247]: INFO nova.compute.manager [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Attaching volume be80392d-488c-4d06-8ff0-9e11c788399c to /dev/vdb
Oct 16 18:26:25 user nova-compute[74247]: DEBUG nova.network.neutron [req-dafd6fb1-d017-413d-80be-f08bcff93667 req-b61577a8-902a-4e2b-b8ac-8df81858ad60 service nova] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Updated VIF entry in instance network info cache for port 9f035e65-b642-4b32-a5b2-1e82808c6ccc. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:26:25 user nova-compute[74247]: DEBUG nova.network.neutron [req-dafd6fb1-d017-413d-80be-f08bcff93667 req-b61577a8-902a-4e2b-b8ac-8df81858ad60 service nova] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Updating instance_info_cache with network_info: [{"id": "9f035e65-b642-4b32-a5b2-1e82808c6ccc", "address": "fa:16:3e:0b:8b:d0", "network": {"id": "d463c254-d68d-4ea5-9642-08d9a1418f04", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1349151729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcd68f315ff3434d955243adda597196", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f035e65-b6", "ovs_interfaceid": "9f035e65-b642-4b32-a5b2-1e82808c6ccc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:26:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Acquiring lock "c048698e-de64-4124-8d72-57fb819bb80e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:26:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Lock "c048698e-de64-4124-8d72-57fb819bb80e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:26:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-dafd6fb1-d017-413d-80be-f08bcff93667 req-b61577a8-902a-4e2b-b8ac-8df81858ad60 service nova] Releasing lock "refresh_cache-ff1e2d26-57c5-4aa1-b66f-3ead29571b7e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:26:25 user nova-compute[74247]: DEBUG nova.objects.instance [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Lazy-loading 'flavor' on Instance uuid c048698e-de64-4124-8d72-57fb819bb80e {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:26:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Lock "c048698e-de64-4124-8d72-57fb819bb80e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:26:25 user nova-compute[74247]: DEBUG os_brick.utils [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:26:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:25 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc2ae42-6d28-4a1d-b7cc-02b9720efc95]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:25 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e52510-02ac-4d15-819a-2321dfca7aed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:25 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e383b5-e9aa-4e4c-be83-92d2969f3a0e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:25 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e489ada7-96c8-45fa-8120-b48ecbe2551d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:26:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 18:26:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:26:25 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 18:26:25 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db009c4-2749-42aa-ba1d-7c578b9cc200]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 18:26:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 18:26:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 18:26:25 user nova-compute[74247]: DEBUG os_brick.utils [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:26:25 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Updating existing volume attachment record: f2f50c07-1ab3-47f3-a379-2f136ed4fd15 {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 18:26:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Acquiring lock "c048698e-de64-4124-8d72-57fb819bb80e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:26:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Lock "c048698e-de64-4124-8d72-57fb819bb80e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:26:25 user nova-compute[74247]: INFO nova.compute.manager [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Attaching volume a55b52d4-4e00-49e8-85a8-4dc2a00fc704 to /dev/vdb
Oct 16 18:26:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:26 user nova-compute[74247]: DEBUG nova.compute.manager [req-8244c4a6-536f-40eb-a71c-e99118c2e8c3 req-0174b536-d697-481d-9fcc-3252b55e8da4 service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Received event network-vif-plugged-246d0c9d-bed7-460d-bbfd-0cb2ebe16dda {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:26:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-8244c4a6-536f-40eb-a71c-e99118c2e8c3 req-0174b536-d697-481d-9fcc-3252b55e8da4 service nova] Acquiring lock "c048698e-de64-4124-8d72-57fb819bb80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:26:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-8244c4a6-536f-40eb-a71c-e99118c2e8c3 req-0174b536-d697-481d-9fcc-3252b55e8da4 service nova] Lock "c048698e-de64-4124-8d72-57fb819bb80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:26:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-8244c4a6-536f-40eb-a71c-e99118c2e8c3 req-0174b536-d697-481d-9fcc-3252b55e8da4 service nova] Lock "c048698e-de64-4124-8d72-57fb819bb80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:26:26 user nova-compute[74247]: DEBUG nova.compute.manager [req-8244c4a6-536f-40eb-a71c-e99118c2e8c3 req-0174b536-d697-481d-9fcc-3252b55e8da4 service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] No waiting events found dispatching network-vif-plugged-246d0c9d-bed7-460d-bbfd-0cb2ebe16dda {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:26:26 user nova-compute[74247]: WARNING nova.compute.manager [req-8244c4a6-536f-40eb-a71c-e99118c2e8c3 req-0174b536-d697-481d-9fcc-3252b55e8da4 service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Received unexpected event network-vif-plugged-246d0c9d-bed7-460d-bbfd-0cb2ebe16dda for instance with vm_state active and task_state None.
Oct 16 18:26:26 user nova-compute[74247]: DEBUG nova.compute.manager [req-8244c4a6-536f-40eb-a71c-e99118c2e8c3 req-0174b536-d697-481d-9fcc-3252b55e8da4 service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Received event network-vif-plugged-246d0c9d-bed7-460d-bbfd-0cb2ebe16dda {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:26:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-8244c4a6-536f-40eb-a71c-e99118c2e8c3 req-0174b536-d697-481d-9fcc-3252b55e8da4 service nova] Acquiring lock "c048698e-de64-4124-8d72-57fb819bb80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:26:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-8244c4a6-536f-40eb-a71c-e99118c2e8c3 req-0174b536-d697-481d-9fcc-3252b55e8da4 service nova] Lock "c048698e-de64-4124-8d72-57fb819bb80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:26:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-8244c4a6-536f-40eb-a71c-e99118c2e8c3 req-0174b536-d697-481d-9fcc-3252b55e8da4 service nova] Lock "c048698e-de64-4124-8d72-57fb819bb80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:26:26 user nova-compute[74247]: DEBUG nova.compute.manager [req-8244c4a6-536f-40eb-a71c-e99118c2e8c3 req-0174b536-d697-481d-9fcc-3252b55e8da4 service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] No waiting events found dispatching network-vif-plugged-246d0c9d-bed7-460d-bbfd-0cb2ebe16dda {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:26:26 user nova-compute[74247]: WARNING nova.compute.manager [req-8244c4a6-536f-40eb-a71c-e99118c2e8c3 req-0174b536-d697-481d-9fcc-3252b55e8da4 service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Received unexpected event network-vif-plugged-246d0c9d-bed7-460d-bbfd-0cb2ebe16dda for instance with vm_state active and task_state None.
Oct 16 18:26:27 user nova-compute[74247]: DEBUG nova.compute.manager [req-500d263d-7c4b-42d5-8c79-419e7d6fc182 req-a6e14c63-c193-4cf5-910f-8eeea32d5212 service nova] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Received event network-changed-e9ecd4e6-2676-47b4-baf8-d8f68156007d {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:26:27 user nova-compute[74247]: DEBUG nova.compute.manager [req-500d263d-7c4b-42d5-8c79-419e7d6fc182 req-a6e14c63-c193-4cf5-910f-8eeea32d5212 service nova] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Refreshing instance network info cache due to event network-changed-e9ecd4e6-2676-47b4-baf8-d8f68156007d. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:26:27 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-500d263d-7c4b-42d5-8c79-419e7d6fc182 req-a6e14c63-c193-4cf5-910f-8eeea32d5212 service nova] Acquiring lock "refresh_cache-c868ea1c-0c1c-4470-b125-0a7a76d96c4d" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:26:27 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-500d263d-7c4b-42d5-8c79-419e7d6fc182 req-a6e14c63-c193-4cf5-910f-8eeea32d5212 service nova] Acquired lock "refresh_cache-c868ea1c-0c1c-4470-b125-0a7a76d96c4d" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:26:27 user nova-compute[74247]: DEBUG nova.network.neutron [req-500d263d-7c4b-42d5-8c79-419e7d6fc182 req-a6e14c63-c193-4cf5-910f-8eeea32d5212 service nova] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Refreshing network info cache for port e9ecd4e6-2676-47b4-baf8-d8f68156007d {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:26:28 user nova-compute[74247]: DEBUG nova.network.neutron [req-500d263d-7c4b-42d5-8c79-419e7d6fc182 req-a6e14c63-c193-4cf5-910f-8eeea32d5212 service nova] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Updated VIF entry in instance network info cache for port e9ecd4e6-2676-47b4-baf8-d8f68156007d. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:26:28 user nova-compute[74247]: DEBUG nova.network.neutron [req-500d263d-7c4b-42d5-8c79-419e7d6fc182 req-a6e14c63-c193-4cf5-910f-8eeea32d5212 service nova] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Updating instance_info_cache with network_info: [{"id": "e9ecd4e6-2676-47b4-baf8-d8f68156007d", "address": "fa:16:3e:91:15:33", "network": {"id": "00543722-2a00-4d5d-b9d4-8ee2814fa989", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1795227661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47bf1a9c1d4b408195d15bccd73e818b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ecd4e6-26", "ovs_interfaceid": "e9ecd4e6-2676-47b4-baf8-d8f68156007d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:26:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-500d263d-7c4b-42d5-8c79-419e7d6fc182 req-a6e14c63-c193-4cf5-910f-8eeea32d5212 service nova] Releasing lock "refresh_cache-c868ea1c-0c1c-4470-b125-0a7a76d96c4d" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:26:29 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:33 user nova-compute[74247]: WARNING nova.compute.manager [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Failed to detach volume: fb4857db-f30c-4dc5-9bab-a55a8e551f70 due to 'NoneType' object has no attribute 'devices'
Oct 16 18:26:33 user nova-compute[74247]: DEBUG nova.compute.manager [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Detaching volume: e6d39438-b426-45d7-b8dd-418e85b054a7 {{(pid=74247) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Oct 16 18:26:33 user nova-compute[74247]: INFO nova.compute.manager [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Detaching volume e6d39438-b426-45d7-b8dd-418e85b054a7
Oct 16 18:26:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] Acquiring lock "c868ea1c-0c1c-4470-b125-0a7a76d96c4d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:26:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] Lock "c868ea1c-0c1c-4470-b125-0a7a76d96c4d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:26:33 user nova-compute[74247]: DEBUG nova.objects.instance [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] Lazy-loading 'flavor' on Instance uuid c868ea1c-0c1c-4470-b125-0a7a76d96c4d {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:26:33 user nova-compute[74247]: DEBUG os_brick.utils [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:26:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:33 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4c689f-c1c1-4e05-8ba9-9b3f63a31115]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:33 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3491df1d-36cc-4f74-ae06-75a2640c3e15]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] Lock "c868ea1c-0c1c-4470-b125-0a7a76d96c4d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.098s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:26:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:33 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b5f72b-e98d-45b1-9ab7-ccb280f57cb8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:33 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70c3970-8cf7-4565-96c3-ff1b840fef2d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:33 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Skipping driver_detach during remote rebuild. {{(pid=74247) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Oct 16 18:26:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:26:33 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 18:26:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:26:33 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 18:26:33 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9998c2b0-4a32-4df5-a798-da0ed7d02dca]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:33 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 18:26:33 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 18:26:33 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 18:26:33 user nova-compute[74247]: DEBUG os_brick.utils [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:26:33 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Updating existing volume attachment record: 61d6166b-40ec-41f8-8802-3a203cdc0dd7 {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 18:26:33 user nova-compute[74247]: WARNING nova.compute.manager [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Failed to detach volume: e6d39438-b426-45d7-b8dd-418e85b054a7 due to 'NoneType' object has no attribute 'devices'
Oct 16 18:26:33 user nova-compute[74247]: DEBUG nova.compute.manager [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Detaching volume: 6ccb777d-dfdf-4587-8220-1032047788d1 {{(pid=74247) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Oct 16 18:26:33 user nova-compute[74247]: INFO nova.compute.manager [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Detaching volume 6ccb777d-dfdf-4587-8220-1032047788d1
Oct 16 18:26:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] Acquiring lock "c868ea1c-0c1c-4470-b125-0a7a76d96c4d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:26:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] Lock "c868ea1c-0c1c-4470-b125-0a7a76d96c4d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:26:34 user nova-compute[74247]: INFO nova.compute.manager [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Attaching volume bce2e5f4-efe4-40fe-8f76-67eed6c6c375 to /dev/vdb
Oct 16 18:26:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:40 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:44 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'npqiOYvu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:26:46 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:26:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:26:46 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:26:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:26:46 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572 -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a1af3a-0e06-4d7e-8b8e-44033cbe9330]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 18:26:46 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572 -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85c5e74-e72c-40d2-975b-aa93f1a602b0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572] added
Oct 16 18:26:46 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a005d5ce-c8e1-4245-bdbd-5a6577aa53f1]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f015e51-8267-4036-b053-6eb8316c7d77]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v npqiOYvu {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aBIGibKX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:26:46 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:26:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v npqiOYvu" returned: 0 in 0.029s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e55b325-b34e-4704-aa6c-54d29616f048]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'npqiOYvu'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68c2a97-e35c-463e-9116-511dcc58ae63]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f288b7-02ca-4775-95c0-c34c46f50a12]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)
Oct 16 18:26:46 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)
Oct 16 18:26:46 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572 -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[44217d24-4560-4636-b465-e29c0310c425]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572, portal: 172.16.0.220,3260]
Oct 16 18:26:46 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572, portal: 172.16.0.220,3260] successful.
Oct 16 18:26:46 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d71729-1593-4c9c-8129-d23473ec11e9]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] [instance: 2a7c7eac-216c-4920-ba10-09a06ce90670] Skipping driver_detach during remote rebuild. {{(pid=74247) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG os_brick.utils [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a597b6-8aa1-481c-9eef-c9c9d0ba4b77]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)
Oct 16 18:26:46 user nova-compute[74247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572 (non-flash)
Oct 16 18:26:46 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)
Oct 16 18:26:46 user nova-compute[74247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572 (non-flash)
Oct 16 18:26:46 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c191ab-ecc7-4f6d-8c1a-3a2dd1abf43e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bfd524-c845-4917-b4d2-9182efbf1a5b]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'npqiOYvu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f702f6a7-4911-44c9-925e-b6f852d735c7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[085e1799-92b8-4b1c-af3a-6e8aee623391]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4f7cc9-b125-4d6b-9368-eb7a6e0066f1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:26:46 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 18:26:46 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f69e11b-c4a4-48f5-ba23-e9efa4fff63f]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG os_brick.utils [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:26:46 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Updating existing volume attachment record: ee84bec9-85f7-4a1f-a65a-4251cb6d2ecd {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 18:26:47 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Deleted allocations for instance 2a7c7eac-216c-4920-ba10-09a06ce90670
Oct 16 18:26:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-113e411e-639c-45fb-8cb9-e141e0cdceb8 tempest-TaggedBootDevicesTest-1047620643 tempest-TaggedBootDevicesTest-1047620643-project-member] Lock "2a7c7eac-216c-4920-ba10-09a06ce90670" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 60.365s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:26:47 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:26:47 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26561336338316262', 'path': '/dev/sdc'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:26:47 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561336338316262', 'path': '/dev/sdc'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:26:47 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.233s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:26:47 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:26:47 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:26:47 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:26:47 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:26:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:47 user nova-compute[74247]: DEBUG nova.objects.instance [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lazy-loading 'flavor' on Instance uuid 4daa6370-2cdf-4668-b66b-e10196377c9c {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:26:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:47 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[913e5a57-3a49-4208-9bcd-d3f365d4f04d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:47 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 18:26:47 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:26:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:47 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de62cde-1eb6-4e83-9435-10cde0724fef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:47 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c] added
Oct 16 18:26:47 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:26:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:47 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 18:26:47 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:26:47 user nova-compute[74247]:   <source dev="/dev/sdc"/>
Oct 16 18:26:47 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:26:47 user nova-compute[74247]:   <serial>e5c213b1-8485-4361-8cc8-7b771cacc572</serial>
Oct 16 18:26:47 user nova-compute[74247]: </disk>
Oct 16 18:26:47 user nova-compute[74247]:  {{(pid=74247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 18:26:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:47 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1113c86f-cada-442e-b9a2-6949ee0db7f9]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:47 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:26:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:47 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c17bbca-90f3-4e28-b050-1afe0055af36]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:47 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:26:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aBIGibKX {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:48 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aBIGibKX" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:48 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b632ebff-c3a7-4edb-b6ea-ff68f2dc3f11]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:48 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aBIGibKX'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:26:48 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:48 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:48 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf16421-f4f3-4c50-9d9c-279fb35fb9c7]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:48 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:26:48 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:48 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:48 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8714e64a-5bf7-47df-942f-9d43264aec91]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:48 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)
Oct 16 18:26:48 user nova-compute[74247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572 (non-flash)
Oct 16 18:26:48 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:26:48 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)
Oct 16 18:26:48 user nova-compute[74247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572 (non-flash)
Oct 16 18:26:48 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:26:48 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:48 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:48 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c4162c-20d4-4f5f-a019-9c34a9066aff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:48 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c, portal: 172.16.0.220,3260]
Oct 16 18:26:48 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c, portal: 172.16.0.220,3260] successful.
Oct 16 18:26:48 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:26:48 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:48 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:48 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff176bdb-5bb6-4dd7-97e2-7cdfa7aa3550]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:48 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:26:48 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:48 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:48 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[334d4d32-518d-4c48-89c4-3d836e3a1677]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:48 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)
Oct 16 18:26:48 user nova-compute[74247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572 (non-flash)
Oct 16 18:26:48 user nova-compute[74247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)
Oct 16 18:26:48 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:26:48 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)
Oct 16 18:26:48 user nova-compute[74247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572 (non-flash)
Oct 16 18:26:48 user nova-compute[74247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)
Oct 16 18:26:48 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:26:48 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:26:48 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:26:48 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:26:48 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:26:48 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:48 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:48 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7590e9d-b1a2-4bd5-8dbc-6507d331be5a]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:48 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:26:48 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aBIGibKX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:26:48 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:26:48 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:26:48 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] No VIF found with MAC fa:16:3e:5c:05:1d, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:26:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0faafcbc-790d-4b50-aa23-15f6f1f08538 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lock "4daa6370-2cdf-4668-b66b-e10196377c9c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 36.442s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:26:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:49 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:26:49 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] <== connect_volume: return (2598ms) {'type': 'block', 'scsi_wwn': '23863336232613133', 'path': '/dev/sdd'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:26:49 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863336232613133', 'path': '/dev/sdd'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:26:49 user nova-compute[74247]: DEBUG nova.objects.instance [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Lazy-loading 'flavor' on Instance uuid ff1e2d26-57c5-4aa1-b66f-3ead29571b7e {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:26:49 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 18:26:49 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:26:49 user nova-compute[74247]:   <source dev="/dev/sdd"/>
Oct 16 18:26:49 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:26:49 user nova-compute[74247]:   <serial>be80392d-488c-4d06-8ff0-9e11c788399c</serial>
Oct 16 18:26:49 user nova-compute[74247]: </disk>
Oct 16 18:26:49 user nova-compute[74247]:  {{(pid=74247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 18:26:49 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:26:49 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 18:26:49 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:26:49 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:26:49 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] No VIF found with MAC fa:16:3e:0b:8b:d0, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:26:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "refresh_cache-a686ee86-272c-47be-8801-9c1500af272f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:26:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquired lock "refresh_cache-a686ee86-272c-47be-8801-9c1500af272f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:26:49 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: a686ee86-272c-47be-8801-9c1500af272f] Forcefully refreshing network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 18:26:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-80c0e4ee-7d38-48c0-822e-4459fccab7db tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Lock "ff1e2d26-57c5-4aa1-b66f-3ead29571b7e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.702s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:26:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-d8565a01-7c8f-4ef5-9ea4-a9ade97e5c13 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Acquiring lock "4daa6370-2cdf-4668-b66b-e10196377c9c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:26:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-d8565a01-7c8f-4ef5-9ea4-a9ade97e5c13 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lock "4daa6370-2cdf-4668-b66b-e10196377c9c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:26:50 user nova-compute[74247]: INFO nova.compute.manager [None req-d8565a01-7c8f-4ef5-9ea4-a9ade97e5c13 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Detaching volume e5c213b1-8485-4361-8cc8-7b771cacc572
Oct 16 18:26:50 user nova-compute[74247]: INFO nova.virt.block_device [None req-d8565a01-7c8f-4ef5-9ea4-a9ade97e5c13 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Attempting to driver detach volume e5c213b1-8485-4361-8cc8-7b771cacc572 from mountpoint /dev/vdb
Oct 16 18:26:50 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-d8565a01-7c8f-4ef5-9ea4-a9ade97e5c13 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Attempting to detach device vdb from instance 4daa6370-2cdf-4668-b66b-e10196377c9c from the persistent domain config. {{(pid=74247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 18:26:50 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-d8565a01-7c8f-4ef5-9ea4-a9ade97e5c13 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 18:26:50 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:26:50 user nova-compute[74247]:   <source dev="/dev/sdc"/>
Oct 16 18:26:50 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:26:50 user nova-compute[74247]:   <serial>e5c213b1-8485-4361-8cc8-7b771cacc572</serial>
Oct 16 18:26:50 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 18:26:50 user nova-compute[74247]: </disk>
Oct 16 18:26:50 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:26:50 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-d8565a01-7c8f-4ef5-9ea4-a9ade97e5c13 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Successfully detached device vdb from instance 4daa6370-2cdf-4668-b66b-e10196377c9c from the persistent domain config.
Oct 16 18:26:50 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-d8565a01-7c8f-4ef5-9ea4-a9ade97e5c13 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4daa6370-2cdf-4668-b66b-e10196377c9c from the live domain config. {{(pid=74247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 18:26:50 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-d8565a01-7c8f-4ef5-9ea4-a9ade97e5c13 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 18:26:50 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:26:50 user nova-compute[74247]:   <source dev="/dev/sdc"/>
Oct 16 18:26:50 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:26:50 user nova-compute[74247]:   <serial>e5c213b1-8485-4361-8cc8-7b771cacc572</serial>
Oct 16 18:26:50 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 18:26:50 user nova-compute[74247]: </disk>
Oct 16 18:26:50 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:26:50 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: a686ee86-272c-47be-8801-9c1500af272f] Updating instance_info_cache with network_info: [{"id": "8cb168df-92d2-4ecc-946a-7d9075f75561", "address": "fa:16:3e:9d:bb:be", "network": {"id": "f12e9b98-2724-4b9c-a299-7286c163458c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1410604293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973c8310858e4e1dafbc2fa926995940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb168df-92", "ovs_interfaceid": "8cb168df-92d2-4ecc-946a-7d9075f75561", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:26:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Releasing lock "refresh_cache-a686ee86-272c-47be-8801-9c1500af272f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:26:50 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: a686ee86-272c-47be-8801-9c1500af272f] Updated the network info_cache for instance {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 18:26:50 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:26:50 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:26:51 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-d8565a01-7c8f-4ef5-9ea4-a9ade97e5c13 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4daa6370-2cdf-4668-b66b-e10196377c9c {{(pid=74247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 18:26:51 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:26:51 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:26:51 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:26:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Acquiring lock "ff1e2d26-57c5-4aa1-b66f-3ead29571b7e" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:26:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Lock "ff1e2d26-57c5-4aa1-b66f-3ead29571b7e" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:26:52 user nova-compute[74247]: DEBUG os_brick.utils [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:26:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:52 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b02f53-21b4-4f0e-9f07-aa31510a48b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:52 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[17379ca4-3bce-4b5a-a5f6-c52a17cacfe8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:52 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9988f128-7089-46fb-8f82-09a950cff473]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:52 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7289b70e-fba0-411c-b01e-04b1b9da1a60]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:26:52 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 18:26:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:26:52 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 18:26:52 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95da96c-8074-40b1-a39c-340ca7dd312b]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:26:52 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 18:26:52 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 18:26:52 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 18:26:52 user nova-compute[74247]: DEBUG os_brick.utils [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:26:52 user nova-compute[74247]: INFO nova.compute.manager [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Swapping volume be80392d-488c-4d06-8ff0-9e11c788399c for 48aab4d3-c6ab-4b02-b87b-874e0f995ddf
Oct 16 18:26:53 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:26:54 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:26:54 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:26:54 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 18:26:54 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:26:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:26:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:26:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:26:54 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 18:26:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:26:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c868ea1c-0c1c-4470-b125-0a7a76d96c4d/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c868ea1c-0c1c-4470-b125-0a7a76d96c4d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c868ea1c-0c1c-4470-b125-0a7a76d96c4d/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c868ea1c-0c1c-4470-b125-0a7a76d96c4d/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1e2d26-57c5-4aa1-b66f-3ead29571b7e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1e2d26-57c5-4aa1-b66f-3ead29571b7e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1e2d26-57c5-4aa1-b66f-3ead29571b7e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1e2d26-57c5-4aa1-b66f-3ead29571b7e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:56 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:26:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4daa6370-2cdf-4668-b66b-e10196377c9c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4daa6370-2cdf-4668-b66b-e10196377c9c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4daa6370-2cdf-4668-b66b-e10196377c9c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4daa6370-2cdf-4668-b66b-e10196377c9c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67a48117-6273-46b7-a14b-5cc2e27847c7/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67a48117-6273-46b7-a14b-5cc2e27847c7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67a48117-6273-46b7-a14b-5cc2e27847c7/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:26:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67a48117-6273-46b7-a14b-5cc2e27847c7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:26:57 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:26:58 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:26:58 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:26:58 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=7463MB free_disk=25.43027114868164GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 18:26:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:26:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:26:58 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:26:58 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance e37fbc27-3404-479a-be08-4d590391cf30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:26:58 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance a686ee86-272c-47be-8801-9c1500af272f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:26:58 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 4daa6370-2cdf-4668-b66b-e10196377c9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:26:58 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance c048698e-de64-4124-8d72-57fb819bb80e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:26:58 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance ff1e2d26-57c5-4aa1-b66f-3ead29571b7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:26:58 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance c868ea1c-0c1c-4470-b125-0a7a76d96c4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:26:58 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:26:58 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 67a48117-6273-46b7-a14b-5cc2e27847c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:26:58 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 18:26:58 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 18:26:58 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:26:58 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:26:58 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 18:26:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.455s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:26:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-08138dd8-22f3-4675-9331-497e177e4e60 req-3109646d-7eb7-46df-ba57-a47fed415f46 service nova] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Received event network-changed-2f140983-b9a6-4fdd-a301-a9b42927c561 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:27:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-08138dd8-22f3-4675-9331-497e177e4e60 req-3109646d-7eb7-46df-ba57-a47fed415f46 service nova] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Refreshing instance network info cache due to event network-changed-2f140983-b9a6-4fdd-a301-a9b42927c561. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:27:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-08138dd8-22f3-4675-9331-497e177e4e60 req-3109646d-7eb7-46df-ba57-a47fed415f46 service nova] Acquiring lock "refresh_cache-73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:27:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-08138dd8-22f3-4675-9331-497e177e4e60 req-3109646d-7eb7-46df-ba57-a47fed415f46 service nova] Acquired lock "refresh_cache-73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:27:05 user nova-compute[74247]: DEBUG nova.network.neutron [req-08138dd8-22f3-4675-9331-497e177e4e60 req-3109646d-7eb7-46df-ba57-a47fed415f46 service nova] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Refreshing network info cache for port 2f140983-b9a6-4fdd-a301-a9b42927c561 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:27:05 user nova-compute[74247]: DEBUG nova.network.neutron [req-08138dd8-22f3-4675-9331-497e177e4e60 req-3109646d-7eb7-46df-ba57-a47fed415f46 service nova] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Updated VIF entry in instance network info cache for port 2f140983-b9a6-4fdd-a301-a9b42927c561. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:27:05 user nova-compute[74247]: DEBUG nova.network.neutron [req-08138dd8-22f3-4675-9331-497e177e4e60 req-3109646d-7eb7-46df-ba57-a47fed415f46 service nova] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Updating instance_info_cache with network_info: [{"id": "2f140983-b9a6-4fdd-a301-a9b42927c561", "address": "fa:16:3e:a8:1a:a3", "network": {"id": "64ae2feb-5041-4479-a5a1-02e5ff636224", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-402083057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "670a27f9af4f4b32a86386d343a0694b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f140983-b9", "ovs_interfaceid": "2f140983-b9a6-4fdd-a301-a9b42927c561", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:27:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-08138dd8-22f3-4675-9331-497e177e4e60 req-3109646d-7eb7-46df-ba57-a47fed415f46 service nova] Releasing lock "refresh_cache-73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:27:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:27:10 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jEbLJQli', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:27:11 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:27:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:27:11 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:27:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:27:11 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:27:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c70908-8f7e-4927-9258-d15cda335951]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 18:27:11 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0ab0fc-dbb6-4811-ba16-46a4c7c3c5d0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704] added
Oct 16 18:27:11 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9c6092-2070-41ac-9543-120dee151428]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8788687-1e4d-42d0-817c-d30733792de9]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jEbLJQli {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:11 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-d8565a01-7c8f-4ef5-9ea4-a9ade97e5c13 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4daa6370-2cdf-4668-b66b-e10196377c9c is timed out.
Oct 16 18:27:11 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-d8565a01-7c8f-4ef5-9ea4-a9ade97e5c13 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Successfully detached device vdb from instance 4daa6370-2cdf-4668-b66b-e10196377c9c from the live domain config.
Oct 16 18:27:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jEbLJQli" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b856678-4145-40f8-b4f4-f61e264c59eb]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jEbLJQli'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8565a01-7c8f-4ef5-9ea4-a9ade97e5c13 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8565a01-7c8f-4ef5-9ea4-a9ade97e5c13 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'npqiOYvu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:27:11 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-d8565a01-7c8f-4ef5-9ea4-a9ade97e5c13 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:27:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-d8565a01-7c8f-4ef5-9ea4-a9ade97e5c13 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb653fc-0387-48c1-842c-f8dd8febc872]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f3a874-d2df-41cf-ad5b-33e639e10dc8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)
Oct 16 18:27:11 user nova-compute[74247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572 (non-flash)
Oct 16 18:27:11 user nova-compute[74247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)
Oct 16 18:27:11 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)
Oct 16 18:27:11 user nova-compute[74247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572 (non-flash)
Oct 16 18:27:11 user nova-compute[74247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)
Oct 16 18:27:11 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8df4c3-679f-455b-89cf-49068b20380a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704, portal: 172.16.0.220,3260]
Oct 16 18:27:11 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704, portal: 172.16.0.220,3260] successful.
Oct 16 18:27:11 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ce4642-1487-4cec-a076-9b9f2dea760e]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed92888-9de8-47ee-9449-a1f975446f9c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)
Oct 16 18:27:11 user nova-compute[74247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572 (non-flash)
Oct 16 18:27:11 user nova-compute[74247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)
Oct 16 18:27:11 user nova-compute[74247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 (non-flash)
Oct 16 18:27:11 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)
Oct 16 18:27:11 user nova-compute[74247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572 (non-flash)
Oct 16 18:27:11 user nova-compute[74247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)
Oct 16 18:27:11 user nova-compute[74247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 (non-flash)
Oct 16 18:27:11 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bd1297-cd82-484c-b843-0230588e6229]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:27:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jEbLJQli', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26364343361383332', 'path': '/dev/sde'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364343361383332', 'path': '/dev/sde'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-d8565a01-7c8f-4ef5-9ea4-a9ade97e5c13 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.200s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG nova.objects.instance [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Lazy-loading 'flavor' on Instance uuid c048698e-de64-4124-8d72-57fb819bb80e {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d540df-9f97-47a3-b3c0-7d98a3127c5e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8565a01-7c8f-4ef5-9ea4-a9ade97e5c13 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 18:27:12 user nova-compute[74247]: No targets found.
Oct 16 18:27:12 user nova-compute[74247]: iSNS:
Oct 16 18:27:12 user nova-compute[74247]: No targets found.
Oct 16 18:27:12 user nova-compute[74247]: STATIC:
Oct 16 18:27:12 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688
Oct 16 18:27:12 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:27:12 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:27:12 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572
Oct 16 18:27:12 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:27:12 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:27:12 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704
Oct 16 18:27:12 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:27:12 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:27:12 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c
Oct 16 18:27:12 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:27:12 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:27:12 user nova-compute[74247]: FIRMWARE:
Oct 16 18:27:12 user nova-compute[74247]: No targets found.
Oct 16 18:27:12 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8565a01-7c8f-4ef5-9ea4-a9ade97e5c13 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 18:27:12 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 18:27:12 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8565a01-7c8f-4ef5-9ea4-a9ade97e5c13 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9f70f0-8cae-4b20-9387-2ab08c18e82c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 18:27:12 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:27:12 user nova-compute[74247]:   <source dev="/dev/sde"/>
Oct 16 18:27:12 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:27:12 user nova-compute[74247]:   <serial>a55b52d4-4e00-49e8-85a8-4dc2a00fc704</serial>
Oct 16 18:27:12 user nova-compute[74247]: </disk>
Oct 16 18:27:12 user nova-compute[74247]:  {{(pid=74247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddca1a9d-f796-4677-84e9-948d58e93109]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8565a01-7c8f-4ef5-9ea4-a9ade97e5c13 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)
Oct 16 18:27:12 user nova-compute[74247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572 (non-flash)
Oct 16 18:27:12 user nova-compute[74247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)
Oct 16 18:27:12 user nova-compute[74247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 (non-flash)
Oct 16 18:27:12 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8565a01-7c8f-4ef5-9ea4-a9ade97e5c13 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)
Oct 16 18:27:12 user nova-compute[74247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572 (non-flash)
Oct 16 18:27:12 user nova-compute[74247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)
Oct 16 18:27:12 user nova-compute[74247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 (non-flash)
Oct 16 18:27:12 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8565a01-7c8f-4ef5-9ea4-a9ade97e5c13 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe06838bd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572'): ({'sdc'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-d8565a01-7c8f-4ef5-9ea4-a9ade97e5c13 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Removing single pathed devices sdc {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c1032b-d6d6-4728-9be0-2383208dcea7]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af09543-d2ea-4c13-a339-0652b48221bc]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-d8565a01-7c8f-4ef5-9ea4-a9ade97e5c13 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Flushing IO for device /dev/sdc {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d46f166-f8cb-4ec3-a865-f0c4594aff9d]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-d8565a01-7c8f-4ef5-9ea4-a9ade97e5c13 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cf8bb1-1da5-4e1d-8034-7a63d4b7c39f]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-d8565a01-7c8f-4ef5-9ea4-a9ade97e5c13 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-d8565a01-7c8f-4ef5-9ea4-a9ade97e5c13 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] SCSI volumes sdc have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8565a01-7c8f-4ef5-9ea4-a9ade97e5c13 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf611e0-efbf-4961-bb3b-726bfd764915]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8565a01-7c8f-4ef5-9ea4-a9ade97e5c13 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572 -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:12 user nova-compute[74247]: INFO nova.compute.manager [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Rebuilding instance
Oct 16 18:27:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4427a2e2-9d68-4f67-8382-aaa92ce2cb52]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8565a01-7c8f-4ef5-9ea4-a9ade97e5c13 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572, portal: 172.16.0.220,3260]
Oct 16 18:27:12 user nova-compute[74247]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572, portal: 172.16.0.220,3260] successful.
Oct 16 18:27:12 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572 -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5c213b1-8485-4361-8cc8-7b771cacc572 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c778ace-bdf3-4fea-b875-6ee74c76aba9]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8565a01-7c8f-4ef5-9ea4-a9ade97e5c13 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-d8565a01-7c8f-4ef5-9ea4-a9ade97e5c13 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8565a01-7c8f-4ef5-9ea4-a9ade97e5c13 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] <== disconnect_volume: return (1525ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8565a01-7c8f-4ef5-9ea4-a9ade97e5c13 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] No BDM found with device name hda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] No VIF found with MAC fa:16:3e:ff:27:0b, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:12 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG nova.compute.manager [req-ff238828-9f03-4fc4-93e0-317bb481b8fc req-1950c902-35b3-44bd-bd82-63ca08c53bfb service nova] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Received event network-vif-unplugged-2f140983-b9a6-4fdd-a301-a9b42927c561 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-ff238828-9f03-4fc4-93e0-317bb481b8fc req-1950c902-35b3-44bd-bd82-63ca08c53bfb service nova] Acquiring lock "73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-ff238828-9f03-4fc4-93e0-317bb481b8fc req-1950c902-35b3-44bd-bd82-63ca08c53bfb service nova] Lock "73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-ff238828-9f03-4fc4-93e0-317bb481b8fc req-1950c902-35b3-44bd-bd82-63ca08c53bfb service nova] Lock "73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG nova.compute.manager [req-ff238828-9f03-4fc4-93e0-317bb481b8fc req-1950c902-35b3-44bd-bd82-63ca08c53bfb service nova] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] No waiting events found dispatching network-vif-unplugged-2f140983-b9a6-4fdd-a301-a9b42927c561 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:27:13 user nova-compute[74247]: WARNING nova.compute.manager [req-ff238828-9f03-4fc4-93e0-317bb481b8fc req-1950c902-35b3-44bd-bd82-63ca08c53bfb service nova] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Received unexpected event network-vif-unplugged-2f140983-b9a6-4fdd-a301-a9b42927c561 for instance with vm_state active and task_state rebuilding.
Oct 16 18:27:13 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Instance destroyed successfully.
Oct 16 18:27:13 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Instance destroyed successfully.
Oct 16 18:27:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:25:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1223998491',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-413859192',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEogCyeuhbzTI40G7oRGcfQg1ZDIdQQs+E8Zqfgq6jVx7RJjmhFUF8Of7DSwnrttqR/RrY35HAlR9+flGO4UILfkJp/XvsGQTltIdbBTBZgqMx2HchODLVDJxQEAyvBXA==',key_name='tempest-keypair-1699437087',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:25:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='670a27f9af4f4b32a86386d343a0694b',ramdisk_id='',reservation_id='r-5j8o190g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1771639004',owner_user_name='tempest-ServerActionsV293TestJSON-1771639004-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:27:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='493de9166585427c8714c5ba06c2ceec',uuid=73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f140983-b9a6-4fdd-a301-a9b42927c561", "address": "fa:16:3e:a8:1a:a3", "network": {"id": "64ae2feb-5041-4479-a5a1-02e5ff636224", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-402083057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "670a27f9af4f4b32a86386d343a0694b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f140983-b9", "ovs_interfaceid": "2f140983-b9a6-4fdd-a301-a9b42927c561", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Converting VIF {"id": "2f140983-b9a6-4fdd-a301-a9b42927c561", "address": "fa:16:3e:a8:1a:a3", "network": {"id": "64ae2feb-5041-4479-a5a1-02e5ff636224", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-402083057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "670a27f9af4f4b32a86386d343a0694b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f140983-b9", "ovs_interfaceid": "2f140983-b9a6-4fdd-a301-a9b42927c561", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:1a:a3,bridge_name='br-int',has_traffic_filtering=True,id=2f140983-b9a6-4fdd-a301-a9b42927c561,network=Network(64ae2feb-5041-4479-a5a1-02e5ff636224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f140983-b9') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG os_vif [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:1a:a3,bridge_name='br-int',has_traffic_filtering=True,id=2f140983-b9a6-4fdd-a301-a9b42927c561,network=Network(64ae2feb-5041-4479-a5a1-02e5ff636224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f140983-b9') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f140983-b9, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=46532f3d-2e8a-4028-9166-382588807c75) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:27:13 user nova-compute[74247]: INFO os_vif [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:1a:a3,bridge_name='br-int',has_traffic_filtering=True,id=2f140983-b9a6-4fdd-a301-a9b42927c561,network=Network(64ae2feb-5041-4479-a5a1-02e5ff636224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f140983-b9')
Oct 16 18:27:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fsdpBahK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:27:13 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 16 18:27:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c78af5d-e362-4b7e-940f-dddf8980e38c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 18:27:13 user nova-compute[74247]: No targets found.
Oct 16 18:27:13 user nova-compute[74247]: iSNS:
Oct 16 18:27:13 user nova-compute[74247]: No targets found.
Oct 16 18:27:13 user nova-compute[74247]: STATIC:
Oct 16 18:27:13 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688
Oct 16 18:27:13 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:27:13 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:27:13 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704
Oct 16 18:27:13 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:27:13 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:27:13 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c
Oct 16 18:27:13 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:27:13 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:27:13 user nova-compute[74247]: FIRMWARE:
Oct 16 18:27:13 user nova-compute[74247]: No targets found.
Oct 16 18:27:13 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 18:27:13 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 18:27:13 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c76723-cff2-4cfe-8a5a-1f4435e8b6e3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88a831c-0b3a-485b-962a-79ea31145bf9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)
Oct 16 18:27:13 user nova-compute[74247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)
Oct 16 18:27:13 user nova-compute[74247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 (non-flash)
Oct 16 18:27:13 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)
Oct 16 18:27:13 user nova-compute[74247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)
Oct 16 18:27:13 user nova-compute[74247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 (non-flash)
Oct 16 18:27:13 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe0685de440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688'): ({'sdb'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Removing single pathed devices sdb {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb440b37-d1c3-4e7c-ba04-1ce8586b2f59]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbfb271f-e66f-4949-8151-99880b99e60e]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Flushing IO for device /dev/sdb {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c975f6d-2a3d-49f4-85cf-c325aeb45249]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ada1055-b016-45d6-980e-40fcb06a7303]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] SCSI volumes sdb have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_e78033b0', '/dev/disk/by-id/scsi-23835623533313633', '/dev/disk/by-id/scsi-1SCST_BIOe78033b0-85b53163b8dee476') {{(pid=85128) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db7ee00-eb64-4c42-952e-e2ad9b06342d]: (4, None) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[de542ef7-55b6-4948-9aa6-f873f4aa202f]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c245a3d-cd74-4547-98c8-d53f784deecc]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688, portal: 172.16.0.220,3260]
Oct 16 18:27:13 user nova-compute[74247]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688, portal: 172.16.0.220,3260] successful.
Oct 16 18:27:13 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2461d0d7-6c1e-47e1-b84f-51ea0efcd1ee]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] <== disconnect_volume: return (322ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:27:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 18:27:13 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Deleting instance files /opt/stack/data/nova/instances/73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b_del
Oct 16 18:27:13 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Deletion of /opt/stack/data/nova/instances/73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b_del complete
Oct 16 18:27:15 user nova-compute[74247]: DEBUG nova.compute.manager [req-a1e0dc9a-b83b-4527-a43c-87f43d8b5a00 req-0ebc59e4-e319-4227-8b5e-952d8ffda91e service nova] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Received event network-vif-plugged-2f140983-b9a6-4fdd-a301-a9b42927c561 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:27:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a1e0dc9a-b83b-4527-a43c-87f43d8b5a00 req-0ebc59e4-e319-4227-8b5e-952d8ffda91e service nova] Acquiring lock "73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:27:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a1e0dc9a-b83b-4527-a43c-87f43d8b5a00 req-0ebc59e4-e319-4227-8b5e-952d8ffda91e service nova] Lock "73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:27:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a1e0dc9a-b83b-4527-a43c-87f43d8b5a00 req-0ebc59e4-e319-4227-8b5e-952d8ffda91e service nova] Lock "73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:27:15 user nova-compute[74247]: DEBUG nova.compute.manager [req-a1e0dc9a-b83b-4527-a43c-87f43d8b5a00 req-0ebc59e4-e319-4227-8b5e-952d8ffda91e service nova] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] No waiting events found dispatching network-vif-plugged-2f140983-b9a6-4fdd-a301-a9b42927c561 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:27:15 user nova-compute[74247]: WARNING nova.compute.manager [req-a1e0dc9a-b83b-4527-a43c-87f43d8b5a00 req-0ebc59e4-e319-4227-8b5e-952d8ffda91e service nova] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Received unexpected event network-vif-plugged-2f140983-b9a6-4fdd-a301-a9b42927c561 for instance with vm_state active and task_state rebuilding.
Oct 16 18:27:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:21 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:27:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fNVOvGET', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:27:21 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:27:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:27:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:27:21 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:27:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:27:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:27:21 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:27:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375 -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:21 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ba0d9c-655d-47fc-a41f-8692184109e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 18:27:21 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:27:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375 -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:21 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[198980c0-a6c7-4e7d-84d1-09dc1c077ee9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375] added
Oct 16 18:27:21 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:27:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:21 user nova-compute[74247]: DEBUG nova.compute.manager [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XVGFsqem', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ff1e2d26-57c5-4aa1-b66f-3ead29571b7e', 'attached_at': '', 'detached_at': '', 'volume_id': '48aab4d3-c6ab-4b02-b87b-874e0f995ddf', 'serial': '48aab4d3-c6ab-4b02-b87b-874e0f995ddf'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aBIGibKX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'ff1e2d26-57c5-4aa1-b66f-3ead29571b7e', 'attached_at': '', 'detached_at': '', 'volume_id': 'be80392d-488c-4d06-8ff0-9e11c788399c', 'serial'} {{(pid=74247) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 16 18:27:21 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:27:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XVGFsqem', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:27:21 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:27:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:27:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-60a48bdc-e00e-4ed3-a8f9-ecf7be3d664f tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Lock "c048698e-de64-4124-8d72-57fb819bb80e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 56.313s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:27:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.123s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:21 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87844d6-e750-4bff-9be6-bffda8a6c2ff]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:27:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:22 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c909f902-6863-4cb1-9b65-eafa54ca4bab]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:27:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fNVOvGET {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fNVOvGET" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:22 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1961d8-a039-4dfa-be8b-d1e10fc4b8b6]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fNVOvGET'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:27:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:22 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33cb6cf-5b36-465d-8775-9b088710d280]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:27:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:22 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d73361-3de4-4360-b11c-a9b0952eee8e]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)
Oct 16 18:27:22 user nova-compute[74247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 (non-flash)
Oct 16 18:27:22 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:27:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)
Oct 16 18:27:22 user nova-compute[74247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 (non-flash)
Oct 16 18:27:22 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:27:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375 -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:22 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[91fb3109-51f8-4732-9735-a1628e4a7725]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375, portal: 172.16.0.220,3260]
Oct 16 18:27:22 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375, portal: 172.16.0.220,3260] successful.
Oct 16 18:27:22 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:27:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:22 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b47b7a8-617a-4a0a-b582-5ecdd8aa8670]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:27:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:22 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b could not be found.
Oct 16 18:27:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:22 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9533dbd5-3d69-42c1-b90c-5145768e3673]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)
Oct 16 18:27:22 user nova-compute[74247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 (non-flash)
Oct 16 18:27:22 user nova-compute[74247]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375 (non-flash)
Oct 16 18:27:22 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:27:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)
Oct 16 18:27:22 user nova-compute[74247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 (non-flash)
Oct 16 18:27:22 user nova-compute[74247]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375 (non-flash)
Oct 16 18:27:22 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:27:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.403s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:27:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:27:22 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] HCTL ('33', '-', '-', 0) found on session 7 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:27:22 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:27:22 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 18:27:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fsdpBahK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:27:22 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 16 18:27:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:27:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:22 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[879da3a5-85dd-4680-81e1-600b82a75dbe]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:22 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] Searching for a device in session 7 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:27:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fNVOvGET', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:27:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a41903b2-f36f-46c3-a1c8-a5b2cf6203f9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Acquiring lock "c048698e-de64-4124-8d72-57fb819bb80e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:27:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a41903b2-f36f-46c3-a1c8-a5b2cf6203f9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Lock "c048698e-de64-4124-8d72-57fb819bb80e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:27:23 user nova-compute[74247]: INFO nova.compute.manager [None req-a41903b2-f36f-46c3-a1c8-a5b2cf6203f9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Detaching volume a55b52d4-4e00-49e8-85a8-4dc2a00fc704
Oct 16 18:27:23 user nova-compute[74247]: INFO nova.virt.block_device [None req-a41903b2-f36f-46c3-a1c8-a5b2cf6203f9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Attempting to driver detach volume a55b52d4-4e00-49e8-85a8-4dc2a00fc704 from mountpoint /dev/vdb
Oct 16 18:27:23 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a41903b2-f36f-46c3-a1c8-a5b2cf6203f9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Attempting to detach device vdb from instance c048698e-de64-4124-8d72-57fb819bb80e from the persistent domain config. {{(pid=74247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-a41903b2-f36f-46c3-a1c8-a5b2cf6203f9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 18:27:23 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:27:23 user nova-compute[74247]:   <source dev="/dev/sde"/>
Oct 16 18:27:23 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:27:23 user nova-compute[74247]:   <serial>a55b52d4-4e00-49e8-85a8-4dc2a00fc704</serial>
Oct 16 18:27:23 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 16 18:27:23 user nova-compute[74247]: </disk>
Oct 16 18:27:23 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:27:23 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-a41903b2-f36f-46c3-a1c8-a5b2cf6203f9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Successfully detached device vdb from instance c048698e-de64-4124-8d72-57fb819bb80e from the persistent domain config.
Oct 16 18:27:23 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a41903b2-f36f-46c3-a1c8-a5b2cf6203f9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c048698e-de64-4124-8d72-57fb819bb80e from the live domain config. {{(pid=74247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-a41903b2-f36f-46c3-a1c8-a5b2cf6203f9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 18:27:23 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:27:23 user nova-compute[74247]:   <source dev="/dev/sde"/>
Oct 16 18:27:23 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:27:23 user nova-compute[74247]:   <serial>a55b52d4-4e00-49e8-85a8-4dc2a00fc704</serial>
Oct 16 18:27:23 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 16 18:27:23 user nova-compute[74247]: </disk>
Oct 16 18:27:23 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.431s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] <== connect_volume: return (1433ms) {'type': 'block', 'scsi_wwn': '23234643463333363', 'path': '/dev/sdb'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234643463333363', 'path': '/dev/sdb'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.365s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:27:23 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:27:23 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:27:23 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:27:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG nova.objects.instance [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] Lazy-loading 'flavor' on Instance uuid c868ea1c-0c1c-4470-b125-0a7a76d96c4d {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[631e660a-9b0e-482b-af58-51ccbbdad673]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 18:27:23 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4fa519a-e3b7-4ccc-acf3-c03dbcbaf496]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf] added
Oct 16 18:27:23 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] attach device xml: <disk type="block" device="disk">
Oct 16 18:27:23 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:27:23 user nova-compute[74247]:   <source dev="/dev/sdb"/>
Oct 16 18:27:23 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:27:23 user nova-compute[74247]:   <serial>bce2e5f4-efe4-40fe-8f76-67eed6c6c375</serial>
Oct 16 18:27:23 user nova-compute[74247]: </disk>
Oct 16 18:27:23 user nova-compute[74247]:  {{(pid=74247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3effe1-98cf-454d-b3ec-82f776b67fc0]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d95303-eded-41d0-86c0-db4cabbd0890]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XVGFsqem {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XVGFsqem" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d8b4c4-0d04-4f22-ac7e-6480f1814074]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XVGFsqem'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[344c9082-bbf5-420c-a50f-19ff28dec591]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fd3d2a-fffd-41f5-9609-5f136f0147ba]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)
Oct 16 18:27:23 user nova-compute[74247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 (non-flash)
Oct 16 18:27:23 user nova-compute[74247]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375 (non-flash)
Oct 16 18:27:23 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)
Oct 16 18:27:23 user nova-compute[74247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 (non-flash)
Oct 16 18:27:23 user nova-compute[74247]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375 (non-flash)
Oct 16 18:27:23 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8898dc0-e172-418c-843f-4b9648ba31a1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf, portal: 172.16.0.220,3260]
Oct 16 18:27:23 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf, portal: 172.16.0.220,3260] successful.
Oct 16 18:27:23 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a049a7ea-3168-4933-95c4-6305b39fd5e7]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3384cfc6-b6f1-4a1d-a8e8-f6dde360506f]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)
Oct 16 18:27:23 user nova-compute[74247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 (non-flash)
Oct 16 18:27:23 user nova-compute[74247]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375 (non-flash)
Oct 16 18:27:23 user nova-compute[74247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf (non-flash)
Oct 16 18:27:23 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)
Oct 16 18:27:23 user nova-compute[74247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 (non-flash)
Oct 16 18:27:23 user nova-compute[74247]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375 (non-flash)
Oct 16 18:27:23 user nova-compute[74247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf (non-flash)
Oct 16 18:27:23 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] HCTL ('34', '-', '-', 0) found on session 8 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[48efdd52-e1ae-4507-953a-8dc8a0a1a144]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Searching for a device in session 8 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XVGFsqem', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a41903b2-f36f-46c3-a1c8-a5b2cf6203f9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c048698e-de64-4124-8d72-57fb819bb80e {{(pid=74247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:27:23 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] No VIF found with MAC fa:16:3e:91:15:33, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:27:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-834022c4-f0f4-4910-ad59-6576251e4867 tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] Lock "c868ea1c-0c1c-4470-b125-0a7a76d96c4d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 49.953s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:27:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-5d045339-cdab-4067-ae5c-83da4b33e4e6 tempest-VolumesAssistedSnapshotsTest-132715650 tempest-VolumesAssistedSnapshotsTest-132715650-project] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] volume_snapshot_create: create_info: {'snapshot_id': 'be7f732f-04e7-4b5b-ba9e-1a193d07642c', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74247) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Oct 16 18:27:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-5d045339-cdab-4067-ae5c-83da4b33e4e6 tempest-VolumesAssistedSnapshotsTest-132715650 tempest-VolumesAssistedSnapshotsTest-132715650-project] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] snap xml: <domainsnapshot>
Oct 16 18:27:24 user nova-compute[74247]:   <disks>
Oct 16 18:27:24 user nova-compute[74247]:     <disk name="/dev/sdb" snapshot="external" type="file">
Oct 16 18:27:24 user nova-compute[74247]:       <source file="/dev/new_file"/>
Oct 16 18:27:24 user nova-compute[74247]:     </disk>
Oct 16 18:27:24 user nova-compute[74247]:     <disk name="vda" snapshot="no"/>
Oct 16 18:27:24 user nova-compute[74247]:   </disks>
Oct 16 18:27:24 user nova-compute[74247]: </domainsnapshot>
Oct 16 18:27:24 user nova-compute[74247]:  {{(pid=74247) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Oct 16 18:27:24 user nova-compute[74247]: DEBUG nova.objects.instance [None req-5d045339-cdab-4067-ae5c-83da4b33e4e6 tempest-VolumesAssistedSnapshotsTest-132715650 tempest-VolumesAssistedSnapshotsTest-132715650-project] Lazy-loading 'system_metadata' on Instance uuid c868ea1c-0c1c-4470-b125-0a7a76d96c4d {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:27:24 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-5d045339-cdab-4067-ae5c-83da4b33e4e6 tempest-VolumesAssistedSnapshotsTest-132715650 tempest-VolumesAssistedSnapshotsTest-132715650-project] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [None req-5d045339-cdab-4067-ae5c-83da4b33e4e6 tempest-VolumesAssistedSnapshotsTest-132715650 tempest-VolumesAssistedSnapshotsTest-132715650-project] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Traceback (most recent call last):
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d]     rv = execute(f, *args, **kwargs)
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d]     six.reraise(c, e, tb)
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d]     raise value
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d]     rv = meth(*args, **kwargs)
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] 
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [None req-5d045339-cdab-4067-ae5c-83da4b33e4e6 tempest-VolumesAssistedSnapshotsTest-132715650 tempest-VolumesAssistedSnapshotsTest-132715650-project] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Traceback (most recent call last):
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d]     self._volume_snapshot_create(context, instance, guest,
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d]     rv = execute(f, *args, **kwargs)
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d]     six.reraise(c, e, tb)
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d]     raise value
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d]     rv = meth(*args, **kwargs)
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] 
Oct 16 18:27:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-13cc2c6d-5e11-4071-a8a0-2cd9383a8245 tempest-VolumesAssistedSnapshotsTest-132715650 tempest-VolumesAssistedSnapshotsTest-132715650-project] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] volume_snapshot_delete: delete_info: {'volume_id': 'bce2e5f4-efe4-40fe-8f76-67eed6c6c375'} {{(pid=74247) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [None req-13cc2c6d-5e11-4071-a8a0-2cd9383a8245 tempest-VolumesAssistedSnapshotsTest-132715650 tempest-VolumesAssistedSnapshotsTest-132715650-project] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Traceback (most recent call last):
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d]     self._volume_snapshot_delete(context, instance, volume_id,
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d]     if delete_info['type'] != 'qcow2':
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] KeyError: 'type'
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] 
Oct 16 18:27:24 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:27:24 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] <== connect_volume: return (2679ms) {'type': 'block', 'scsi_wwn': '23338613838373162', 'path': '/dev/sdc'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:27:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338613838373162', 'path': '/dev/sdc'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:27:24 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.341s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:27:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:24 user nova-compute[74247]: DEBUG nova.objects.instance [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Lazy-loading 'flavor' on Instance uuid ff1e2d26-57c5-4aa1-b66f-3ead29571b7e {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:27:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:24 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26c6ab5-883c-4aac-b793-6f976313cf4b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:24 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 18:27:24 user nova-compute[74247]: No targets found.
Oct 16 18:27:24 user nova-compute[74247]: iSNS:
Oct 16 18:27:24 user nova-compute[74247]: No targets found.
Oct 16 18:27:24 user nova-compute[74247]: STATIC:
Oct 16 18:27:24 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375
Oct 16 18:27:24 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:27:24 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:27:24 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704
Oct 16 18:27:24 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:27:24 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:27:24 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c
Oct 16 18:27:24 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:27:24 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:27:24 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf
Oct 16 18:27:24 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:27:24 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:27:24 user nova-compute[74247]: FIRMWARE:
Oct 16 18:27:24 user nova-compute[74247]: No targets found.
Oct 16 18:27:24 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:27:24 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 18:27:24 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 18:27:24 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 18:27:24 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 18:27:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:24 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b6f94c-2e54-4914-8b5e-6d6eacd9a665]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [None req-5d045339-cdab-4067-ae5c-83da4b33e4e6 tempest-VolumesAssistedSnapshotsTest-132715650 tempest-VolumesAssistedSnapshotsTest-132715650-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot be7f732f-04e7-4b5b-ba9e-1a193d07642c could not be found.
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     raise value
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver 
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver 
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot be7f732f-04e7-4b5b-ba9e-1a193d07642c could not be found. (HTTP 404) (Request-ID: req-563f71f1-1b82-4d7e-88f3-51f86277cbfe)
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver 
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver 
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot be7f732f-04e7-4b5b-ba9e-1a193d07642c could not be found.
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver 
Oct 16 18:27:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:24 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9b6402-be2a-42f9-a762-5a222f4a31af]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:24 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)
Oct 16 18:27:24 user nova-compute[74247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 (non-flash)
Oct 16 18:27:24 user nova-compute[74247]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375 (non-flash)
Oct 16 18:27:24 user nova-compute[74247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf (non-flash)
Oct 16 18:27:24 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:27:24 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)
Oct 16 18:27:24 user nova-compute[74247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 (non-flash)
Oct 16 18:27:24 user nova-compute[74247]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375 (non-flash)
Oct 16 18:27:24 user nova-compute[74247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf (non-flash)
Oct 16 18:27:24 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:27:24 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe0682e0280>, {}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 18:27:24 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Disconnecting from: [] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 18:27:24 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.089s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:27:24 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] <== disconnect_volume: return (2430ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:27:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server [None req-5d045339-cdab-4067-ae5c-83da4b33e4e6 tempest-VolumesAssistedSnapshotsTest-132715650 tempest-VolumesAssistedSnapshotsTest-132715650-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4504, in volume_snapshot_create
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server     raise value
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server 
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver [None req-13cc2c6d-5e11-4071-a8a0-2cd9383a8245 tempest-VolumesAssistedSnapshotsTest-132715650 tempest-VolumesAssistedSnapshotsTest-132715650-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver 
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver 
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-130fe04a-e62a-4ea8-8484-aee60b3e2535)
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver 
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver 
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 16 18:27:24 user nova-compute[74247]: ERROR nova.virt.libvirt.driver 
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server [None req-13cc2c6d-5e11-4071-a8a0-2cd9383a8245 tempest-VolumesAssistedSnapshotsTest-132715650 tempest-VolumesAssistedSnapshotsTest-132715650-project] Exception during message handling: KeyError: 'type'
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4516, in volume_snapshot_delete
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Oct 16 18:27:24 user nova-compute[74247]: ERROR oslo_messaging.rpc.server 
Oct 16 18:27:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c7c3f67c-2049-44a5-9aa6-438b0e6cd5ce tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] Acquiring lock "c868ea1c-0c1c-4470-b125-0a7a76d96c4d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:27:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c7c3f67c-2049-44a5-9aa6-438b0e6cd5ce tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] Lock "c868ea1c-0c1c-4470-b125-0a7a76d96c4d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:27:24 user nova-compute[74247]: INFO nova.compute.manager [None req-c7c3f67c-2049-44a5-9aa6-438b0e6cd5ce tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Detaching volume bce2e5f4-efe4-40fe-8f76-67eed6c6c375
Oct 16 18:27:24 user nova-compute[74247]: INFO nova.virt.block_device [None req-c7c3f67c-2049-44a5-9aa6-438b0e6cd5ce tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Attempting to driver detach volume bce2e5f4-efe4-40fe-8f76-67eed6c6c375 from mountpoint /dev/vdb
Oct 16 18:27:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c7c3f67c-2049-44a5-9aa6-438b0e6cd5ce tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] Attempting to detach device vdb from instance c868ea1c-0c1c-4470-b125-0a7a76d96c4d from the persistent domain config. {{(pid=74247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 18:27:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-c7c3f67c-2049-44a5-9aa6-438b0e6cd5ce tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] detach device xml: <disk type="block" device="disk">
Oct 16 18:27:24 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:27:24 user nova-compute[74247]:   <source dev="/dev/sdb"/>
Oct 16 18:27:24 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:27:24 user nova-compute[74247]:   <serial>bce2e5f4-efe4-40fe-8f76-67eed6c6c375</serial>
Oct 16 18:27:24 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 18:27:24 user nova-compute[74247]: </disk>
Oct 16 18:27:24 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:27:24 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-c7c3f67c-2049-44a5-9aa6-438b0e6cd5ce tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] Successfully detached device vdb from instance c868ea1c-0c1c-4470-b125-0a7a76d96c4d from the persistent domain config.
Oct 16 18:27:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c7c3f67c-2049-44a5-9aa6-438b0e6cd5ce tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c868ea1c-0c1c-4470-b125-0a7a76d96c4d from the live domain config. {{(pid=74247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 18:27:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-c7c3f67c-2049-44a5-9aa6-438b0e6cd5ce tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] detach device xml: <disk type="block" device="disk">
Oct 16 18:27:24 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:27:24 user nova-compute[74247]:   <source dev="/dev/sdb"/>
Oct 16 18:27:24 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:27:24 user nova-compute[74247]:   <serial>bce2e5f4-efe4-40fe-8f76-67eed6c6c375</serial>
Oct 16 18:27:24 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 18:27:24 user nova-compute[74247]: </disk>
Oct 16 18:27:24 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:27:25 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 18:27:25 user nova-compute[74247]: DEBUG nova.objects.instance [None req-d8565a01-7c8f-4ef5-9ea4-a9ade97e5c13 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lazy-loading 'flavor' on Instance uuid 4daa6370-2cdf-4668-b66b-e10196377c9c {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:27:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-d8565a01-7c8f-4ef5-9ea4-a9ade97e5c13 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lock "4daa6370-2cdf-4668-b66b-e10196377c9c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 35.163s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:27:25 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] COPY block job progress, current cursor: 80740352 final cursor: 1073741824 {{(pid=74247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 18:27:25 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c7c3f67c-2049-44a5-9aa6-438b0e6cd5ce tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c868ea1c-0c1c-4470-b125-0a7a76d96c4d {{(pid=74247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 18:27:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:25 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Preparing to wait for external event volume-reimaged-3ab08fda-c4e7-456c-8003-24c8bfb6c688 {{(pid=74247) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Oct 16 18:27:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Acquiring lock "73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:27:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Lock "73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:27:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Lock "73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:27:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] COPY block job progress, current cursor: 195035136 final cursor: 1073741824 {{(pid=74247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 18:27:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] COPY block job progress, current cursor: 331350016 final cursor: 1073741824 {{(pid=74247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 18:27:27 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] COPY block job progress, current cursor: 469762048 final cursor: 1073741824 {{(pid=74247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 18:27:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:27 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] COPY block job progress, current cursor: 654311424 final cursor: 1073741824 {{(pid=74247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 18:27:28 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] COPY block job progress, current cursor: 783286272 final cursor: 1073741824 {{(pid=74247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 18:27:28 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] COPY block job progress, current cursor: 950009856 final cursor: 1073741824 {{(pid=74247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 18:27:28 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aBIGibKX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:27:29 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:27:29 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[00709e13-c59e-4cd9-b480-419a6ef37d75]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 18:27:29 user nova-compute[74247]: No targets found.
Oct 16 18:27:29 user nova-compute[74247]: iSNS:
Oct 16 18:27:29 user nova-compute[74247]: No targets found.
Oct 16 18:27:29 user nova-compute[74247]: STATIC:
Oct 16 18:27:29 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375
Oct 16 18:27:29 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:27:29 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:27:29 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704
Oct 16 18:27:29 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:27:29 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:27:29 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c
Oct 16 18:27:29 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:27:29 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:27:29 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf
Oct 16 18:27:29 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:27:29 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:27:29 user nova-compute[74247]: FIRMWARE:
Oct 16 18:27:29 user nova-compute[74247]: No targets found.
Oct 16 18:27:29 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 18:27:29 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 18:27:29 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef30a6ed-125a-4d21-b616-ab779c8c790b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[10de7fee-8bc7-4eed-994b-20625b8764cb]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)
Oct 16 18:27:29 user nova-compute[74247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 (non-flash)
Oct 16 18:27:29 user nova-compute[74247]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375 (non-flash)
Oct 16 18:27:29 user nova-compute[74247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf (non-flash)
Oct 16 18:27:29 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)
Oct 16 18:27:29 user nova-compute[74247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 (non-flash)
Oct 16 18:27:29 user nova-compute[74247]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375 (non-flash)
Oct 16 18:27:29 user nova-compute[74247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf (non-flash)
Oct 16 18:27:29 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe0483ff7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c'): ({'sdd'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Removing single pathed devices sdd {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d75adc3-a80d-4ca5-87e7-fcd80b10c64b]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eda1513-4521-471a-9f0d-96caa7041918]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Flushing IO for device /dev/sdd {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[47030a46-657d-436b-b0e1-c134857230f7]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb178dd-f46e-41a8-b566-acc14f6ffbd6]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] SCSI volumes sdd have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed964a7-c329-4eff-9970-bc16c455013a]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5f86a9-227b-4133-ab51-357708fcd1ce]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c, portal: 172.16.0.220,3260]
Oct 16 18:27:29 user nova-compute[74247]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c, portal: 172.16.0.220,3260] successful.
Oct 16 18:27:29 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d35efe-854e-4cba-adca-54889901c360]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] <== disconnect_volume: return (355ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG nova.compute.manager [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XVGFsqem', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'ff1e2d26-57c5-4aa1-b66f-3ead29571b7e', 'attached_at': '', 'detached_at': '', 'volume_id': '48aab4d3-c6ab-4b02-b87b-874e0f995ddf', 'serial'} {{(pid=74247) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 16 18:27:29 user nova-compute[74247]: DEBUG nova.compute.manager [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] swap_volume: removing Cinder connection for volume be80392d-488c-4d06-8ff0-9e11c788399c {{(pid=74247) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 16 18:27:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:27:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1dfe497a-a6ce-4ed3-9ada-e9b2c74f0fb1 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Acquiring lock "67a48117-6273-46b7-a14b-5cc2e27847c7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:27:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1dfe497a-a6ce-4ed3-9ada-e9b2c74f0fb1 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Lock "67a48117-6273-46b7-a14b-5cc2e27847c7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:27:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1dfe497a-a6ce-4ed3-9ada-e9b2c74f0fb1 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Acquiring lock "67a48117-6273-46b7-a14b-5cc2e27847c7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:27:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1dfe497a-a6ce-4ed3-9ada-e9b2c74f0fb1 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Lock "67a48117-6273-46b7-a14b-5cc2e27847c7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:27:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1dfe497a-a6ce-4ed3-9ada-e9b2c74f0fb1 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Lock "67a48117-6273-46b7-a14b-5cc2e27847c7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:27:36 user nova-compute[74247]: INFO nova.compute.manager [None req-1dfe497a-a6ce-4ed3-9ada-e9b2c74f0fb1 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Terminating instance
Oct 16 18:27:36 user nova-compute[74247]: DEBUG nova.compute.manager [None req-1dfe497a-a6ce-4ed3-9ada-e9b2c74f0fb1 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 18:27:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:36 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Instance destroyed successfully.
Oct 16 18:27:36 user nova-compute[74247]: DEBUG nova.objects.instance [None req-1dfe497a-a6ce-4ed3-9ada-e9b2c74f0fb1 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Lazy-loading 'resources' on Instance uuid 67a48117-6273-46b7-a14b-5cc2e27847c7 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:27:36 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-1dfe497a-a6ce-4ed3-9ada-e9b2c74f0fb1 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:25:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-322704963',display_name='tempest-ServersNegativeTestJSON-server-322704963',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-322704963',id=10,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:25:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94e9d0485eec462990dd029379397962',ramdisk_id='',reservation_id='r-sfpwxr0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1696683961',owner_user_name='tempest-ServersNegativeTestJSON-1696683961-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:25:53Z,user_data=None,user_id='8c82a90fcbed4a38b4f69a18de607f1f',uuid=67a48117-6273-46b7-a14b-5cc2e27847c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01255990-d759-4061-9b3e-967def280d73", "address": "fa:16:3e:5b:48:b4", "network": {"id": "f99cbf0c-7d0c-4ef8-934a-aaac218e9381", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2096188408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94e9d0485eec462990dd029379397962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01255990-d7", "ovs_interfaceid": "01255990-d759-4061-9b3e-967def280d73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:27:36 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-1dfe497a-a6ce-4ed3-9ada-e9b2c74f0fb1 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Converting VIF {"id": "01255990-d759-4061-9b3e-967def280d73", "address": "fa:16:3e:5b:48:b4", "network": {"id": "f99cbf0c-7d0c-4ef8-934a-aaac218e9381", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2096188408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94e9d0485eec462990dd029379397962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01255990-d7", "ovs_interfaceid": "01255990-d759-4061-9b3e-967def280d73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:27:36 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-1dfe497a-a6ce-4ed3-9ada-e9b2c74f0fb1 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:48:b4,bridge_name='br-int',has_traffic_filtering=True,id=01255990-d759-4061-9b3e-967def280d73,network=Network(f99cbf0c-7d0c-4ef8-934a-aaac218e9381),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01255990-d7') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:27:36 user nova-compute[74247]: DEBUG os_vif [None req-1dfe497a-a6ce-4ed3-9ada-e9b2c74f0fb1 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:48:b4,bridge_name='br-int',has_traffic_filtering=True,id=01255990-d759-4061-9b3e-967def280d73,network=Network(f99cbf0c-7d0c-4ef8-934a-aaac218e9381),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01255990-d7') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:27:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01255990-d7, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:27:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:27:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0a3bfc13-b4e1-4f22-8adb-66ec565d53d7) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:27:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:36 user nova-compute[74247]: DEBUG nova.compute.manager [req-2f2da14c-03d4-4516-b034-c436000f6599 req-e26cbc1f-9200-4a86-b22a-73bc442b72b1 service nova] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Received event network-vif-unplugged-01255990-d759-4061-9b3e-967def280d73 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:27:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-2f2da14c-03d4-4516-b034-c436000f6599 req-e26cbc1f-9200-4a86-b22a-73bc442b72b1 service nova] Acquiring lock "67a48117-6273-46b7-a14b-5cc2e27847c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:27:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-2f2da14c-03d4-4516-b034-c436000f6599 req-e26cbc1f-9200-4a86-b22a-73bc442b72b1 service nova] Lock "67a48117-6273-46b7-a14b-5cc2e27847c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:27:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-2f2da14c-03d4-4516-b034-c436000f6599 req-e26cbc1f-9200-4a86-b22a-73bc442b72b1 service nova] Lock "67a48117-6273-46b7-a14b-5cc2e27847c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:27:36 user nova-compute[74247]: DEBUG nova.compute.manager [req-2f2da14c-03d4-4516-b034-c436000f6599 req-e26cbc1f-9200-4a86-b22a-73bc442b72b1 service nova] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] No waiting events found dispatching network-vif-unplugged-01255990-d759-4061-9b3e-967def280d73 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:27:36 user nova-compute[74247]: DEBUG nova.compute.manager [req-2f2da14c-03d4-4516-b034-c436000f6599 req-e26cbc1f-9200-4a86-b22a-73bc442b72b1 service nova] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Received event network-vif-unplugged-01255990-d759-4061-9b3e-967def280d73 for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:27:36 user nova-compute[74247]: INFO os_vif [None req-1dfe497a-a6ce-4ed3-9ada-e9b2c74f0fb1 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:48:b4,bridge_name='br-int',has_traffic_filtering=True,id=01255990-d759-4061-9b3e-967def280d73,network=Network(f99cbf0c-7d0c-4ef8-934a-aaac218e9381),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01255990-d7')
Oct 16 18:27:36 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-1dfe497a-a6ce-4ed3-9ada-e9b2c74f0fb1 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Deleting instance files /opt/stack/data/nova/instances/67a48117-6273-46b7-a14b-5cc2e27847c7_del
Oct 16 18:27:36 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-1dfe497a-a6ce-4ed3-9ada-e9b2c74f0fb1 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Deletion of /opt/stack/data/nova/instances/67a48117-6273-46b7-a14b-5cc2e27847c7_del complete
Oct 16 18:27:36 user nova-compute[74247]: INFO nova.compute.manager [None req-1dfe497a-a6ce-4ed3-9ada-e9b2c74f0fb1 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Took 0.74 seconds to destroy the instance on the hypervisor.
Oct 16 18:27:36 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-1dfe497a-a6ce-4ed3-9ada-e9b2c74f0fb1 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 18:27:36 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 18:27:36 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 18:27:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:37 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:37 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:37 user nova-compute[74247]: DEBUG nova.compute.manager [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] swap_volume: Updating volume be80392d-488c-4d06-8ff0-9e11c788399c BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "XVGFsqem", "auth_password": "SFn0egZidpj5Qc", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "48aab4d3-c6ab-4b02-b87b-874e0f995ddf"}, "status": "reserved", "instance": "ff1e2d26-57c5-4aa1-b66f-3ead29571b7e", "attached_at": "", "detached_at": "", "volume_id": "48aab4d3-c6ab-4b02-b87b-874e0f995ddf", "serial": "48aab4d3-c6ab-4b02-b87b-874e0f995ddf"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '48aab4d3-c6ab-4b02-b87b-874e0f995ddf', 'no_device': None, 'attachment_id': '254c53eb-a3d0-469c-9dc0-9c1a75b0b7e6'} {{(pid=74247) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 16 18:27:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f779d89c-8721-49f9-aab5-ee561001f0bb tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Lock "ff1e2d26-57c5-4aa1-b66f-3ead29571b7e" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 45.502s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:27:38 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:27:38 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Took 1.11 seconds to deallocate network for instance.
Oct 16 18:27:38 user nova-compute[74247]: DEBUG nova.compute.manager [req-906fd0ae-3ee8-44f7-b75a-977907c5452e req-3aa6f2da-abbb-4103-b6e0-00abde7d7a8c service nova] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Received event network-vif-deleted-01255990-d759-4061-9b3e-967def280d73 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:27:38 user nova-compute[74247]: INFO nova.compute.manager [req-906fd0ae-3ee8-44f7-b75a-977907c5452e req-3aa6f2da-abbb-4103-b6e0-00abde7d7a8c service nova] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Neutron deleted interface 01255990-d759-4061-9b3e-967def280d73; detaching it from the instance and deleting it from the info cache
Oct 16 18:27:38 user nova-compute[74247]: DEBUG nova.network.neutron [req-906fd0ae-3ee8-44f7-b75a-977907c5452e req-3aa6f2da-abbb-4103-b6e0-00abde7d7a8c service nova] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:27:38 user nova-compute[74247]: DEBUG nova.compute.manager [req-906fd0ae-3ee8-44f7-b75a-977907c5452e req-3aa6f2da-abbb-4103-b6e0-00abde7d7a8c service nova] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Detach interface failed, port_id=01255990-d759-4061-9b3e-967def280d73, reason: Instance 67a48117-6273-46b7-a14b-5cc2e27847c7 could not be found. {{(pid=74247) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 18:27:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1dfe497a-a6ce-4ed3-9ada-e9b2c74f0fb1 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:27:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1dfe497a-a6ce-4ed3-9ada-e9b2c74f0fb1 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:27:38 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-1dfe497a-a6ce-4ed3-9ada-e9b2c74f0fb1 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:27:38 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-1dfe497a-a6ce-4ed3-9ada-e9b2c74f0fb1 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:27:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1dfe497a-a6ce-4ed3-9ada-e9b2c74f0fb1 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:27:38 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-1dfe497a-a6ce-4ed3-9ada-e9b2c74f0fb1 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Deleted allocations for instance 67a48117-6273-46b7-a14b-5cc2e27847c7
Oct 16 18:27:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1dfe497a-a6ce-4ed3-9ada-e9b2c74f0fb1 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Lock "67a48117-6273-46b7-a14b-5cc2e27847c7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.439s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:27:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Acquiring lock "ff1e2d26-57c5-4aa1-b66f-3ead29571b7e" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:27:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Lock "ff1e2d26-57c5-4aa1-b66f-3ead29571b7e" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:27:38 user nova-compute[74247]: DEBUG os_brick.utils [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:27:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:38 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[644690a5-e1d0-4b4d-8cb8-7189822aab9a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.028s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:38 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d82dbe-887b-44fd-8933-20291a3fd211]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:38 user nova-compute[74247]: DEBUG nova.compute.manager [req-39c80eb1-9a4f-4a83-8532-c8e1674fe950 req-7b769ab8-3525-4f66-adc8-562cbee1b46d service nova] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Received event network-vif-plugged-01255990-d759-4061-9b3e-967def280d73 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:27:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-39c80eb1-9a4f-4a83-8532-c8e1674fe950 req-7b769ab8-3525-4f66-adc8-562cbee1b46d service nova] Acquiring lock "67a48117-6273-46b7-a14b-5cc2e27847c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:27:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-39c80eb1-9a4f-4a83-8532-c8e1674fe950 req-7b769ab8-3525-4f66-adc8-562cbee1b46d service nova] Lock "67a48117-6273-46b7-a14b-5cc2e27847c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:27:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-39c80eb1-9a4f-4a83-8532-c8e1674fe950 req-7b769ab8-3525-4f66-adc8-562cbee1b46d service nova] Lock "67a48117-6273-46b7-a14b-5cc2e27847c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:27:38 user nova-compute[74247]: DEBUG nova.compute.manager [req-39c80eb1-9a4f-4a83-8532-c8e1674fe950 req-7b769ab8-3525-4f66-adc8-562cbee1b46d service nova] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] No waiting events found dispatching network-vif-plugged-01255990-d759-4061-9b3e-967def280d73 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:27:38 user nova-compute[74247]: WARNING nova.compute.manager [req-39c80eb1-9a4f-4a83-8532-c8e1674fe950 req-7b769ab8-3525-4f66-adc8-562cbee1b46d service nova] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Received unexpected event network-vif-plugged-01255990-d759-4061-9b3e-967def280d73 for instance with vm_state deleted and task_state None.
Oct 16 18:27:38 user nova-compute[74247]: DEBUG nova.compute.manager [req-39c80eb1-9a4f-4a83-8532-c8e1674fe950 req-7b769ab8-3525-4f66-adc8-562cbee1b46d service nova] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Received event network-vif-plugged-01255990-d759-4061-9b3e-967def280d73 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:27:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-39c80eb1-9a4f-4a83-8532-c8e1674fe950 req-7b769ab8-3525-4f66-adc8-562cbee1b46d service nova] Acquiring lock "67a48117-6273-46b7-a14b-5cc2e27847c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:27:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-39c80eb1-9a4f-4a83-8532-c8e1674fe950 req-7b769ab8-3525-4f66-adc8-562cbee1b46d service nova] Lock "67a48117-6273-46b7-a14b-5cc2e27847c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:27:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-39c80eb1-9a4f-4a83-8532-c8e1674fe950 req-7b769ab8-3525-4f66-adc8-562cbee1b46d service nova] Lock "67a48117-6273-46b7-a14b-5cc2e27847c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:27:38 user nova-compute[74247]: DEBUG nova.compute.manager [req-39c80eb1-9a4f-4a83-8532-c8e1674fe950 req-7b769ab8-3525-4f66-adc8-562cbee1b46d service nova] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] No waiting events found dispatching network-vif-plugged-01255990-d759-4061-9b3e-967def280d73 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:27:38 user nova-compute[74247]: WARNING nova.compute.manager [req-39c80eb1-9a4f-4a83-8532-c8e1674fe950 req-7b769ab8-3525-4f66-adc8-562cbee1b46d service nova] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Received unexpected event network-vif-plugged-01255990-d759-4061-9b3e-967def280d73 for instance with vm_state deleted and task_state None.
Oct 16 18:27:38 user nova-compute[74247]: DEBUG nova.compute.manager [req-39c80eb1-9a4f-4a83-8532-c8e1674fe950 req-7b769ab8-3525-4f66-adc8-562cbee1b46d service nova] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Received event network-vif-plugged-01255990-d759-4061-9b3e-967def280d73 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:27:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-39c80eb1-9a4f-4a83-8532-c8e1674fe950 req-7b769ab8-3525-4f66-adc8-562cbee1b46d service nova] Acquiring lock "67a48117-6273-46b7-a14b-5cc2e27847c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:27:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-39c80eb1-9a4f-4a83-8532-c8e1674fe950 req-7b769ab8-3525-4f66-adc8-562cbee1b46d service nova] Lock "67a48117-6273-46b7-a14b-5cc2e27847c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:27:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-39c80eb1-9a4f-4a83-8532-c8e1674fe950 req-7b769ab8-3525-4f66-adc8-562cbee1b46d service nova] Lock "67a48117-6273-46b7-a14b-5cc2e27847c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:27:38 user nova-compute[74247]: DEBUG nova.compute.manager [req-39c80eb1-9a4f-4a83-8532-c8e1674fe950 req-7b769ab8-3525-4f66-adc8-562cbee1b46d service nova] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] No waiting events found dispatching network-vif-plugged-01255990-d759-4061-9b3e-967def280d73 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:27:38 user nova-compute[74247]: WARNING nova.compute.manager [req-39c80eb1-9a4f-4a83-8532-c8e1674fe950 req-7b769ab8-3525-4f66-adc8-562cbee1b46d service nova] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Received unexpected event network-vif-plugged-01255990-d759-4061-9b3e-967def280d73 for instance with vm_state deleted and task_state None.
Oct 16 18:27:38 user nova-compute[74247]: DEBUG nova.compute.manager [req-39c80eb1-9a4f-4a83-8532-c8e1674fe950 req-7b769ab8-3525-4f66-adc8-562cbee1b46d service nova] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Received event network-vif-unplugged-01255990-d759-4061-9b3e-967def280d73 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:27:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-39c80eb1-9a4f-4a83-8532-c8e1674fe950 req-7b769ab8-3525-4f66-adc8-562cbee1b46d service nova] Acquiring lock "67a48117-6273-46b7-a14b-5cc2e27847c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:27:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-39c80eb1-9a4f-4a83-8532-c8e1674fe950 req-7b769ab8-3525-4f66-adc8-562cbee1b46d service nova] Lock "67a48117-6273-46b7-a14b-5cc2e27847c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:27:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-39c80eb1-9a4f-4a83-8532-c8e1674fe950 req-7b769ab8-3525-4f66-adc8-562cbee1b46d service nova] Lock "67a48117-6273-46b7-a14b-5cc2e27847c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:27:38 user nova-compute[74247]: DEBUG nova.compute.manager [req-39c80eb1-9a4f-4a83-8532-c8e1674fe950 req-7b769ab8-3525-4f66-adc8-562cbee1b46d service nova] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] No waiting events found dispatching network-vif-unplugged-01255990-d759-4061-9b3e-967def280d73 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:27:38 user nova-compute[74247]: WARNING nova.compute.manager [req-39c80eb1-9a4f-4a83-8532-c8e1674fe950 req-7b769ab8-3525-4f66-adc8-562cbee1b46d service nova] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Received unexpected event network-vif-unplugged-01255990-d759-4061-9b3e-967def280d73 for instance with vm_state deleted and task_state None.
Oct 16 18:27:38 user nova-compute[74247]: DEBUG nova.compute.manager [req-39c80eb1-9a4f-4a83-8532-c8e1674fe950 req-7b769ab8-3525-4f66-adc8-562cbee1b46d service nova] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Received event network-vif-plugged-01255990-d759-4061-9b3e-967def280d73 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:27:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-39c80eb1-9a4f-4a83-8532-c8e1674fe950 req-7b769ab8-3525-4f66-adc8-562cbee1b46d service nova] Acquiring lock "67a48117-6273-46b7-a14b-5cc2e27847c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:27:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-39c80eb1-9a4f-4a83-8532-c8e1674fe950 req-7b769ab8-3525-4f66-adc8-562cbee1b46d service nova] Lock "67a48117-6273-46b7-a14b-5cc2e27847c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:27:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-39c80eb1-9a4f-4a83-8532-c8e1674fe950 req-7b769ab8-3525-4f66-adc8-562cbee1b46d service nova] Lock "67a48117-6273-46b7-a14b-5cc2e27847c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:27:38 user nova-compute[74247]: DEBUG nova.compute.manager [req-39c80eb1-9a4f-4a83-8532-c8e1674fe950 req-7b769ab8-3525-4f66-adc8-562cbee1b46d service nova] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] No waiting events found dispatching network-vif-plugged-01255990-d759-4061-9b3e-967def280d73 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:27:38 user nova-compute[74247]: WARNING nova.compute.manager [req-39c80eb1-9a4f-4a83-8532-c8e1674fe950 req-7b769ab8-3525-4f66-adc8-562cbee1b46d service nova] [instance: 67a48117-6273-46b7-a14b-5cc2e27847c7] Received unexpected event network-vif-plugged-01255990-d759-4061-9b3e-967def280d73 for instance with vm_state deleted and task_state None.
Oct 16 18:27:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:38 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0dbfd4-2cea-4cae-a8cb-7eafc57ccf40]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:38 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa04de33-4fca-4932-a972-89507a7adaed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:39 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:27:39 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 18:27:39 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:39 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:27:39 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 18:27:39 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e596f8ff-b373-4dcd-bcb1-72ca23ee6557]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:39 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 18:27:39 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 18:27:39 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 18:27:39 user nova-compute[74247]: DEBUG os_brick.utils [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:27:39 user nova-compute[74247]: INFO nova.compute.manager [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Swapping volume 48aab4d3-c6ab-4b02-b87b-874e0f995ddf for be80392d-488c-4d06-8ff0-9e11c788399c
Oct 16 18:27:40 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Acquiring lock "16ed0e45-071e-4c56-902d-42eacc97c2c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:27:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lock "16ed0e45-071e-4c56-902d-42eacc97c2c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:27:42 user nova-compute[74247]: DEBUG nova.compute.manager [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 18:27:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:27:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:27:42 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:27:42 user nova-compute[74247]: INFO nova.compute.claims [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Claim successful on node user
Oct 16 18:27:42 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:27:42 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:27:43 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.729s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:27:43 user nova-compute[74247]: DEBUG nova.compute.manager [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 18:27:43 user nova-compute[74247]: DEBUG nova.compute.manager [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 18:27:43 user nova-compute[74247]: DEBUG nova.network.neutron [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 18:27:43 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 18:27:43 user nova-compute[74247]: DEBUG nova.compute.manager [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 18:27:43 user nova-compute[74247]: DEBUG nova.policy [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc992e02d7424d11b144101559cbc8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42df518506b24ac5bedd9d75b15fa9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 18:27:43 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "bbec99d1-82a3-4e4d-a3ae-17e00821bee1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:27:43 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "bbec99d1-82a3-4e4d-a3ae-17e00821bee1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:27:43 user nova-compute[74247]: DEBUG nova.compute.manager [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 18:27:43 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:27:43 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Creating image(s)
Oct 16 18:27:43 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Acquiring lock "/opt/stack/data/nova/instances/16ed0e45-071e-4c56-902d-42eacc97c2c1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:27:43 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lock "/opt/stack/data/nova/instances/16ed0e45-071e-4c56-902d-42eacc97c2c1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:27:43 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lock "/opt/stack/data/nova/instances/16ed0e45-071e-4c56-902d-42eacc97c2c1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:27:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:43 user nova-compute[74247]: DEBUG nova.compute.manager [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 18:27:43 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:27:43 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:27:43 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:27:43 user nova-compute[74247]: INFO nova.compute.claims [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Claim successful on node user
Oct 16 18:27:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.226s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:43 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Acquiring lock "37399febbd18f60b85fd0f833558f6a3539ab231" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:27:43 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:27:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.187s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/16ed0e45-071e-4c56-902d-42eacc97c2c1/disk 1073741824 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/16ed0e45-071e-4c56-902d-42eacc97c2c1/disk 1073741824" returned: 0 in 0.058s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:43 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:27:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:43 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-a41903b2-f36f-46c3-a1c8-a5b2cf6203f9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c048698e-de64-4124-8d72-57fb819bb80e is timed out.
Oct 16 18:27:43 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-a41903b2-f36f-46c3-a1c8-a5b2cf6203f9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Successfully detached device vdb from instance c048698e-de64-4124-8d72-57fb819bb80e from the live domain config.
Oct 16 18:27:43 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a41903b2-f36f-46c3-a1c8-a5b2cf6203f9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 18:27:43 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41903b2-f36f-46c3-a1c8-a5b2cf6203f9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jEbLJQli', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:27:43 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-a41903b2-f36f-46c3-a1c8-a5b2cf6203f9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:27:43 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-a41903b2-f36f-46c3-a1c8-a5b2cf6203f9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:27:43 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-a41903b2-f36f-46c3-a1c8-a5b2cf6203f9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:27:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:43 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8cc682-b696-4cfb-9b7e-d75b347e3d64]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:43 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41903b2-f36f-46c3-a1c8-a5b2cf6203f9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 18:27:43 user nova-compute[74247]: No targets found.
Oct 16 18:27:43 user nova-compute[74247]: iSNS:
Oct 16 18:27:43 user nova-compute[74247]: No targets found.
Oct 16 18:27:43 user nova-compute[74247]: STATIC:
Oct 16 18:27:43 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375
Oct 16 18:27:43 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:27:43 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:27:43 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704
Oct 16 18:27:43 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:27:43 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:27:43 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf
Oct 16 18:27:43 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:27:43 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:27:43 user nova-compute[74247]: FIRMWARE:
Oct 16 18:27:43 user nova-compute[74247]: No targets found.
Oct 16 18:27:43 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:27:43 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41903b2-f36f-46c3-a1c8-a5b2cf6203f9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 18:27:43 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 18:27:43 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 18:27:43 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41903b2-f36f-46c3-a1c8-a5b2cf6203f9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 18:27:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:43 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c283d3-8df4-467c-baa6-5001b3c2aac5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efd4f40-0a48-4444-bd0d-167a8ccf9b74]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41903b2-f36f-46c3-a1c8-a5b2cf6203f9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 (non-flash)
Oct 16 18:27:44 user nova-compute[74247]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375 (non-flash)
Oct 16 18:27:44 user nova-compute[74247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf (non-flash)
Oct 16 18:27:44 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41903b2-f36f-46c3-a1c8-a5b2cf6203f9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 (non-flash)
Oct 16 18:27:44 user nova-compute[74247]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375 (non-flash)
Oct 16 18:27:44 user nova-compute[74247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf (non-flash)
Oct 16 18:27:44 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41903b2-f36f-46c3-a1c8-a5b2cf6203f9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe0682e08b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704'): ({'sde'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-a41903b2-f36f-46c3-a1c8-a5b2cf6203f9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Removing single pathed devices sde {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4943f702-58cb-478f-9d7d-9a7640e0408b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.230s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Checking if we can resize image /opt/stack/data/nova/instances/16ed0e45-071e-4c56-902d-42eacc97c2c1/disk. size=1073741824 {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed0e45-071e-4c56-902d-42eacc97c2c1/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44ce35f-fcc2-4bb0-bf9c-b5128034de9f]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-a41903b2-f36f-46c3-a1c8-a5b2cf6203f9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Flushing IO for device /dev/sde {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG nova.network.neutron [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Successfully created port: 6a65c68a-defd-43f5-86d4-885e9f05d19e {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e82811c-6728-4e71-b8b5-f1606db264b1]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-a41903b2-f36f-46c3-a1c8-a5b2cf6203f9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.032s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[93152c92-217d-4b12-ac90-178885848e1f]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-a41903b2-f36f-46c3-a1c8-a5b2cf6203f9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-a41903b2-f36f-46c3-a1c8-a5b2cf6203f9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] SCSI volumes sde have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41903b2-f36f-46c3-a1c8-a5b2cf6203f9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb1184e-d3ae-41a7-a781-f8795f991cf3]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41903b2-f36f-46c3-a1c8-a5b2cf6203f9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae86dd0e-999f-4da0-a0f5-862ef7654d97]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41903b2-f36f-46c3-a1c8-a5b2cf6203f9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704, portal: 172.16.0.220,3260]
Oct 16 18:27:44 user nova-compute[74247]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704, portal: 172.16.0.220,3260] successful.
Oct 16 18:27:44 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed0e45-071e-4c56-902d-42eacc97c2c1/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Cannot resize image /opt/stack/data/nova/instances/16ed0e45-071e-4c56-902d-42eacc97c2c1/disk to a smaller size. {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Ensure instance console log exists: /opt/stack/data/nova/instances/16ed0e45-071e-4c56-902d-42eacc97c2c1/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.774s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG nova.compute.manager [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a55b52d4-4e00-49e8-85a8-4dc2a00fc704 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fd3bc9-ae15-4309-bf86-4a7eb8ecd8c2]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41903b2-f36f-46c3-a1c8-a5b2cf6203f9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-a41903b2-f36f-46c3-a1c8-a5b2cf6203f9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.416s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41903b2-f36f-46c3-a1c8-a5b2cf6203f9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] <== disconnect_volume: return (418ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a41903b2-f36f-46c3-a1c8-a5b2cf6203f9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG nova.compute.manager [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG nova.network.neutron [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 18:27:44 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 18:27:44 user nova-compute[74247]: DEBUG nova.compute.manager [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG nova.policy [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3635a30f06234f0d9a8e0604c25f1208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd3eb752f04fd48dfe0623fdf2fe9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG nova.compute.manager [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:27:44 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Creating image(s)
Oct 16 18:27:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "/opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "/opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "/opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.189s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "37399febbd18f60b85fd0f833558f6a3539ab231" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG nova.network.neutron [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Successfully updated port: 6a65c68a-defd-43f5-86d4-885e9f05d19e {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Acquiring lock "refresh_cache-16ed0e45-071e-4c56-902d-42eacc97c2c1" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Acquired lock "refresh_cache-16ed0e45-071e-4c56-902d-42eacc97c2c1" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG nova.network.neutron [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG nova.compute.manager [req-77247d58-51ce-4973-8347-aff35b01efeb req-ee4e404b-99d6-4b75-9482-b88abf04cbdd service nova] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Received event network-changed-6a65c68a-defd-43f5-86d4-885e9f05d19e {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG nova.compute.manager [req-77247d58-51ce-4973-8347-aff35b01efeb req-ee4e404b-99d6-4b75-9482-b88abf04cbdd service nova] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Refreshing instance network info cache due to event network-changed-6a65c68a-defd-43f5-86d4-885e9f05d19e. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-77247d58-51ce-4973-8347-aff35b01efeb req-ee4e404b-99d6-4b75-9482-b88abf04cbdd service nova] Acquiring lock "refresh_cache-16ed0e45-071e-4c56-902d-42eacc97c2c1" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:27:44 user nova-compute[74247]: DEBUG nova.network.neutron [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.241s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/disk 1073741824 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/disk 1073741824" returned: 0 in 0.060s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.307s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG nova.network.neutron [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Updating instance_info_cache with network_info: [{"id": "6a65c68a-defd-43f5-86d4-885e9f05d19e", "address": "fa:16:3e:ff:38:ab", "network": {"id": "8451dc81-ded8-462e-a394-f5cd774f684b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1470365086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42df518506b24ac5bedd9d75b15fa9b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a65c68a-de", "ovs_interfaceid": "6a65c68a-defd-43f5-86d4-885e9f05d19e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.226s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/disk. size=1073741824 {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Releasing lock "refresh_cache-16ed0e45-071e-4c56-902d-42eacc97c2c1" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG nova.compute.manager [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Instance network_info: |[{"id": "6a65c68a-defd-43f5-86d4-885e9f05d19e", "address": "fa:16:3e:ff:38:ab", "network": {"id": "8451dc81-ded8-462e-a394-f5cd774f684b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1470365086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42df518506b24ac5bedd9d75b15fa9b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a65c68a-de", "ovs_interfaceid": "6a65c68a-defd-43f5-86d4-885e9f05d19e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-77247d58-51ce-4973-8347-aff35b01efeb req-ee4e404b-99d6-4b75-9482-b88abf04cbdd service nova] Acquired lock "refresh_cache-16ed0e45-071e-4c56-902d-42eacc97c2c1" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG nova.network.neutron [req-77247d58-51ce-4973-8347-aff35b01efeb req-ee4e404b-99d6-4b75-9482-b88abf04cbdd service nova] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Refreshing network info cache for port 6a65c68a-defd-43f5-86d4-885e9f05d19e {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Start _get_guest_xml network_info=[{"id": "6a65c68a-defd-43f5-86d4-885e9f05d19e", "address": "fa:16:3e:ff:38:ab", "network": {"id": "8451dc81-ded8-462e-a394-f5cd774f684b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1470365086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42df518506b24ac5bedd9d75b15fa9b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a65c68a-de", "ovs_interfaceid": "6a65c68a-defd-43f5-86d4-885e9f05d19e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': '83126bb1-29f5-42fe-8620-72ab0797f776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:27:45 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:27:45 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:27:45 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:27:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1671619588',display_name='tempest-VolumesAdminNegativeTest-server-1671619588',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1671619588',id=12,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42df518506b24ac5bedd9d75b15fa9b7',ramdisk_id='',reservation_id='r-jgc85m50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1972822081',owner_user_name='tempest-VolumesAdminNegativeTest-1972822081-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:27:43Z,user_data=None,user_id='fc992e02d7424d11b144101559cbc8ef',uuid=16ed0e45-071e-4c56-902d-42eacc97c2c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a65c68a-defd-43f5-86d4-885e9f05d19e", "address": "fa:16:3e:ff:38:ab", "network": {"id": "8451dc81-ded8-462e-a394-f5cd774f684b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1470365086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42df518506b24ac5bedd9d75b15fa9b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a65c68a-de", "ovs_interfaceid": "6a65c68a-defd-43f5-86d4-885e9f05d19e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Converting VIF {"id": "6a65c68a-defd-43f5-86d4-885e9f05d19e", "address": "fa:16:3e:ff:38:ab", "network": {"id": "8451dc81-ded8-462e-a394-f5cd774f684b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1470365086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42df518506b24ac5bedd9d75b15fa9b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a65c68a-de", "ovs_interfaceid": "6a65c68a-defd-43f5-86d4-885e9f05d19e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:38:ab,bridge_name='br-int',has_traffic_filtering=True,id=6a65c68a-defd-43f5-86d4-885e9f05d19e,network=Network(8451dc81-ded8-462e-a394-f5cd774f684b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a65c68a-de') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG nova.objects.instance [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lazy-loading 'pci_devices' on Instance uuid 16ed0e45-071e-4c56-902d-42eacc97c2c1 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:27:45 user nova-compute[74247]:   <uuid>16ed0e45-071e-4c56-902d-42eacc97c2c1</uuid>
Oct 16 18:27:45 user nova-compute[74247]:   <name>instance-0000000c</name>
Oct 16 18:27:45 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:27:45 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:27:45 user nova-compute[74247]:   <metadata>
Oct 16 18:27:45 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:27:45 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:27:45 user nova-compute[74247]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1671619588</nova:name>
Oct 16 18:27:45 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:27:45</nova:creationTime>
Oct 16 18:27:45 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:27:45 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:27:45 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:27:45 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:27:45 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:27:45 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:27:45 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:27:45 user nova-compute[74247]:       <nova:owner>
Oct 16 18:27:45 user nova-compute[74247]:         <nova:user uuid="fc992e02d7424d11b144101559cbc8ef">tempest-VolumesAdminNegativeTest-1972822081-project-member</nova:user>
Oct 16 18:27:45 user nova-compute[74247]:         <nova:project uuid="42df518506b24ac5bedd9d75b15fa9b7">tempest-VolumesAdminNegativeTest-1972822081</nova:project>
Oct 16 18:27:45 user nova-compute[74247]:       </nova:owner>
Oct 16 18:27:45 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:27:45 user nova-compute[74247]:       <nova:ports>
Oct 16 18:27:45 user nova-compute[74247]:         <nova:port uuid="6a65c68a-defd-43f5-86d4-885e9f05d19e">
Oct 16 18:27:45 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 16 18:27:45 user nova-compute[74247]:         </nova:port>
Oct 16 18:27:45 user nova-compute[74247]:       </nova:ports>
Oct 16 18:27:45 user nova-compute[74247]:     </nova:instance>
Oct 16 18:27:45 user nova-compute[74247]:   </metadata>
Oct 16 18:27:45 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:27:45 user nova-compute[74247]:     <system>
Oct 16 18:27:45 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:27:45 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:27:45 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:27:45 user nova-compute[74247]:       <entry name="serial">16ed0e45-071e-4c56-902d-42eacc97c2c1</entry>
Oct 16 18:27:45 user nova-compute[74247]:       <entry name="uuid">16ed0e45-071e-4c56-902d-42eacc97c2c1</entry>
Oct 16 18:27:45 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:27:45 user nova-compute[74247]:     </system>
Oct 16 18:27:45 user nova-compute[74247]:   </sysinfo>
Oct 16 18:27:45 user nova-compute[74247]:   <os>
Oct 16 18:27:45 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:27:45 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:27:45 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:27:45 user nova-compute[74247]:   </os>
Oct 16 18:27:45 user nova-compute[74247]:   <features>
Oct 16 18:27:45 user nova-compute[74247]:     <acpi/>
Oct 16 18:27:45 user nova-compute[74247]:     <apic/>
Oct 16 18:27:45 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:27:45 user nova-compute[74247]:   </features>
Oct 16 18:27:45 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:27:45 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:27:45 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:27:45 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:27:45 user nova-compute[74247]:   </clock>
Oct 16 18:27:45 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:27:45 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:27:45 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:27:45 user nova-compute[74247]:   </cpu>
Oct 16 18:27:45 user nova-compute[74247]:   <devices>
Oct 16 18:27:45 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:27:45 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:27:45 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/16ed0e45-071e-4c56-902d-42eacc97c2c1/disk"/>
Oct 16 18:27:45 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:27:45 user nova-compute[74247]:     </disk>
Oct 16 18:27:45 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:27:45 user nova-compute[74247]:       <mac address="fa:16:3e:ff:38:ab"/>
Oct 16 18:27:45 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:27:45 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:27:45 user nova-compute[74247]:       <target dev="tap6a65c68a-de"/>
Oct 16 18:27:45 user nova-compute[74247]:     </interface>
Oct 16 18:27:45 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:27:45 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/16ed0e45-071e-4c56-902d-42eacc97c2c1/console.log" append="off"/>
Oct 16 18:27:45 user nova-compute[74247]:     </serial>
Oct 16 18:27:45 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:27:45 user nova-compute[74247]:     <video>
Oct 16 18:27:45 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:27:45 user nova-compute[74247]:     </video>
Oct 16 18:27:45 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:27:45 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:27:45 user nova-compute[74247]:     </rng>
Oct 16 18:27:45 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:27:45 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:27:45 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:27:45 user nova-compute[74247]:     </memballoon>
Oct 16 18:27:45 user nova-compute[74247]:   </devices>
Oct 16 18:27:45 user nova-compute[74247]: </domain>
Oct 16 18:27:45 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:27:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1671619588',display_name='tempest-VolumesAdminNegativeTest-server-1671619588',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1671619588',id=12,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42df518506b24ac5bedd9d75b15fa9b7',ramdisk_id='',reservation_id='r-jgc85m50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1972822081',owner_user_name='tempest-VolumesAdminNegativeTest-1972822081-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:27:43Z,user_data=None,user_id='fc992e02d7424d11b144101559cbc8ef',uuid=16ed0e45-071e-4c56-902d-42eacc97c2c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a65c68a-defd-43f5-86d4-885e9f05d19e", "address": "fa:16:3e:ff:38:ab", "network": {"id": "8451dc81-ded8-462e-a394-f5cd774f684b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1470365086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42df518506b24ac5bedd9d75b15fa9b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a65c68a-de", "ovs_interfaceid": "6a65c68a-defd-43f5-86d4-885e9f05d19e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Converting VIF {"id": "6a65c68a-defd-43f5-86d4-885e9f05d19e", "address": "fa:16:3e:ff:38:ab", "network": {"id": "8451dc81-ded8-462e-a394-f5cd774f684b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1470365086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42df518506b24ac5bedd9d75b15fa9b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a65c68a-de", "ovs_interfaceid": "6a65c68a-defd-43f5-86d4-885e9f05d19e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:38:ab,bridge_name='br-int',has_traffic_filtering=True,id=6a65c68a-defd-43f5-86d4-885e9f05d19e,network=Network(8451dc81-ded8-462e-a394-f5cd774f684b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a65c68a-de') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG os_vif [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:38:ab,bridge_name='br-int',has_traffic_filtering=True,id=6a65c68a-defd-43f5-86d4-885e9f05d19e,network=Network(8451dc81-ded8-462e-a394-f5cd774f684b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a65c68a-de') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9872645a-a930-53cd-ab16-48084ce05650', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a65c68a-de, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6a65c68a-de, col_values=(('qos', UUID('f23bf741-ab2b-4f77-a1f4-88098f0a42d8')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6a65c68a-de, col_values=(('external_ids', {'iface-id': '6a65c68a-defd-43f5-86d4-885e9f05d19e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:38:ab', 'vm-uuid': '16ed0e45-071e-4c56-902d-42eacc97c2c1'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:45 user nova-compute[74247]: INFO os_vif [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:38:ab,bridge_name='br-int',has_traffic_filtering=True,id=6a65c68a-defd-43f5-86d4-885e9f05d19e,network=Network(8451dc81-ded8-462e-a394-f5cd774f684b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a65c68a-de')
Oct 16 18:27:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Cannot resize image /opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/disk to a smaller size. {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Ensure instance console log exists: /opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] No VIF found with MAC fa:16:3e:ff:38:ab, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:27:45 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-c7c3f67c-2049-44a5-9aa6-438b0e6cd5ce tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c868ea1c-0c1c-4470-b125-0a7a76d96c4d is timed out.
Oct 16 18:27:45 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-c7c3f67c-2049-44a5-9aa6-438b0e6cd5ce tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] Successfully detached device vdb from instance c868ea1c-0c1c-4470-b125-0a7a76d96c4d from the live domain config.
Oct 16 18:27:45 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7c3f67c-2049-44a5-9aa6-438b0e6cd5ce tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c3f67c-2049-44a5-9aa6-438b0e6cd5ce tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fNVOvGET', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:27:45 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-c7c3f67c-2049-44a5-9aa6-438b0e6cd5ce tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:27:45 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-c7c3f67c-2049-44a5-9aa6-438b0e6cd5ce tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-c7c3f67c-2049-44a5-9aa6-438b0e6cd5ce tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e758118b-29b5-4562-8a33-cf00c865f59c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c3f67c-2049-44a5-9aa6-438b0e6cd5ce tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 18:27:45 user nova-compute[74247]: No targets found.
Oct 16 18:27:45 user nova-compute[74247]: iSNS:
Oct 16 18:27:45 user nova-compute[74247]: No targets found.
Oct 16 18:27:45 user nova-compute[74247]: STATIC:
Oct 16 18:27:45 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375
Oct 16 18:27:45 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:27:45 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:27:45 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf
Oct 16 18:27:45 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:27:45 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:27:45 user nova-compute[74247]: FIRMWARE:
Oct 16 18:27:45 user nova-compute[74247]: No targets found.
Oct 16 18:27:45 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c3f67c-2049-44a5-9aa6-438b0e6cd5ce tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 18:27:45 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 18:27:45 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c3f67c-2049-44a5-9aa6-438b0e6cd5ce tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2205bce3-5c7d-4062-b8b3-ca807c761aaf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2262cb-d10a-4d01-afa9-01650f75ace8]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c3f67c-2049-44a5-9aa6-438b0e6cd5ce tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375 (non-flash)
Oct 16 18:27:45 user nova-compute[74247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf (non-flash)
Oct 16 18:27:45 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c3f67c-2049-44a5-9aa6-438b0e6cd5ce tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375 (non-flash)
Oct 16 18:27:45 user nova-compute[74247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf (non-flash)
Oct 16 18:27:45 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c3f67c-2049-44a5-9aa6-438b0e6cd5ce tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe07815c700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375'): ({'sdb'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-c7c3f67c-2049-44a5-9aa6-438b0e6cd5ce tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] Removing single pathed devices sdb {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4de3c0-73d5-42c7-be70-c1ee62a7d036]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3bbd41-06e2-4fa3-9a5a-7e057a15f9af]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-c7c3f67c-2049-44a5-9aa6-438b0e6cd5ce tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] Flushing IO for device /dev/sdb {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5ca33c-1a3f-4155-9878-0ed1e010663b]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-c7c3f67c-2049-44a5-9aa6-438b0e6cd5ce tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.072s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[843435d0-17f3-4b57-b894-51a9c42c7c19]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-c7c3f67c-2049-44a5-9aa6-438b0e6cd5ce tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-c7c3f67c-2049-44a5-9aa6-438b0e6cd5ce tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] SCSI volumes sdb have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c3f67c-2049-44a5-9aa6-438b0e6cd5ce tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 18:27:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.057s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:46 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85d241e-3c98-4632-b0bc-58dd383376a9]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c3f67c-2049-44a5-9aa6-438b0e6cd5ce tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:27:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375 -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:46 user nova-compute[74247]: DEBUG nova.network.neutron [req-77247d58-51ce-4973-8347-aff35b01efeb req-ee4e404b-99d6-4b75-9482-b88abf04cbdd service nova] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Updated VIF entry in instance network info cache for port 6a65c68a-defd-43f5-86d4-885e9f05d19e. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:27:46 user nova-compute[74247]: DEBUG nova.network.neutron [req-77247d58-51ce-4973-8347-aff35b01efeb req-ee4e404b-99d6-4b75-9482-b88abf04cbdd service nova] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Updating instance_info_cache with network_info: [{"id": "6a65c68a-defd-43f5-86d4-885e9f05d19e", "address": "fa:16:3e:ff:38:ab", "network": {"id": "8451dc81-ded8-462e-a394-f5cd774f684b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1470365086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42df518506b24ac5bedd9d75b15fa9b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a65c68a-de", "ovs_interfaceid": "6a65c68a-defd-43f5-86d4-885e9f05d19e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:27:46 user nova-compute[74247]: DEBUG nova.network.neutron [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Successfully created port: db973a04-4ef6-40c2-a694-c7a12631bc59 {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:27:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-77247d58-51ce-4973-8347-aff35b01efeb req-ee4e404b-99d6-4b75-9482-b88abf04cbdd service nova] Releasing lock "refresh_cache-16ed0e45-071e-4c56-902d-42eacc97c2c1" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:27:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375 -p 172.16.0.220:3260 --logout" returned: 0 in 0.112s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:46 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ea7cae-5da0-41d8-b02c-114056ac5ee0]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c3f67c-2049-44a5-9aa6-438b0e6cd5ce tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375, portal: 172.16.0.220,3260]
Oct 16 18:27:46 user nova-compute[74247]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375, portal: 172.16.0.220,3260] successful.
Oct 16 18:27:46 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:27:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375 -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bce2e5f4-efe4-40fe-8f76-67eed6c6c375 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:46 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a60136-c01f-40f3-b85d-e0b618011aae]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c3f67c-2049-44a5-9aa6-438b0e6cd5ce tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:27:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-c7c3f67c-2049-44a5-9aa6-438b0e6cd5ce tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.518s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:27:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c3f67c-2049-44a5-9aa6-438b0e6cd5ce tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] <== disconnect_volume: return (520ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:27:46 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7c3f67c-2049-44a5-9aa6-438b0e6cd5ce tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 18:27:46 user nova-compute[74247]: DEBUG nova.objects.instance [None req-a41903b2-f36f-46c3-a1c8-a5b2cf6203f9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Lazy-loading 'flavor' on Instance uuid c048698e-de64-4124-8d72-57fb819bb80e {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:27:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a41903b2-f36f-46c3-a1c8-a5b2cf6203f9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Lock "c048698e-de64-4124-8d72-57fb819bb80e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.411s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:27:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-2d9f3112-82a6-4d6d-a874-0fbf9436e7a9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Acquiring lock "interface-c048698e-de64-4124-8d72-57fb819bb80e-246d0c9d-bed7-460d-bbfd-0cb2ebe16dda" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:27:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-2d9f3112-82a6-4d6d-a874-0fbf9436e7a9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Lock "interface-c048698e-de64-4124-8d72-57fb819bb80e-246d0c9d-bed7-460d-bbfd-0cb2ebe16dda" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:27:47 user nova-compute[74247]: DEBUG nova.objects.instance [None req-2d9f3112-82a6-4d6d-a874-0fbf9436e7a9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Lazy-loading 'flavor' on Instance uuid c048698e-de64-4124-8d72-57fb819bb80e {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:27:47 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-2d9f3112-82a6-4d6d-a874-0fbf9436e7a9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T18:24:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1708908380',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1708908380',id=6,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4t5/HxarVjAIcPE9zeByR72HYnWO4eclBUfo863abS/M64e1Oj/mYiR12Cs6HtPrtMLyPaTm6rvsRa3pNGaznOooPgv/HGuQCekMNKw81O1jY6NY8zkFrvxeZV5v6ZKw==',key_name='tempest-keypair-1905579868',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:24:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ab4b3ccbd914164a2d5b38c7b89777b',ramdisk_id='',reservation_id='r-jcqqfx36',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1522926684',owner_user_name='tempest-TaggedAttachmentsTest-1522926684-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:24:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2000726f45b45feb6c3c5cedcbd40e2',uuid=c048698e-de64-4124-8d72-57fb819bb80e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "246d0c9d-bed7-460d-bbfd-0cb2ebe16dda", "address": "fa:16:3e:bc:93:6e", "network": {"id": "d0a8c577-68e9-4fc9-bb48-78cf1feb05a5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1663196803", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4ab4b3ccbd914164a2d5b38c7b89777b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap246d0c9d-be", "ovs_interfaceid": "246d0c9d-bed7-460d-bbfd-0cb2ebe16dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:27:47 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-2d9f3112-82a6-4d6d-a874-0fbf9436e7a9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Converting VIF {"id": "246d0c9d-bed7-460d-bbfd-0cb2ebe16dda", "address": "fa:16:3e:bc:93:6e", "network": {"id": "d0a8c577-68e9-4fc9-bb48-78cf1feb05a5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1663196803", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4ab4b3ccbd914164a2d5b38c7b89777b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap246d0c9d-be", "ovs_interfaceid": "246d0c9d-bed7-460d-bbfd-0cb2ebe16dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:27:47 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-2d9f3112-82a6-4d6d-a874-0fbf9436e7a9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:93:6e,bridge_name='br-int',has_traffic_filtering=True,id=246d0c9d-bed7-460d-bbfd-0cb2ebe16dda,network=Network(d0a8c577-68e9-4fc9-bb48-78cf1feb05a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap246d0c9d-be') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:27:47 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-2d9f3112-82a6-4d6d-a874-0fbf9436e7a9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:bc:93:6e"/><model type="virtio"/><mtu size="1442"/><target dev="tap246d0c9d-be"/></interface> {{(pid=74247) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 16 18:27:47 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-2d9f3112-82a6-4d6d-a874-0fbf9436e7a9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:bc:93:6e"/><model type="virtio"/><mtu size="1442"/><target dev="tap246d0c9d-be"/></interface> {{(pid=74247) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 16 18:27:47 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-2d9f3112-82a6-4d6d-a874-0fbf9436e7a9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Attempting to detach device tap246d0c9d-be from instance c048698e-de64-4124-8d72-57fb819bb80e from the persistent domain config. {{(pid=74247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 18:27:47 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-2d9f3112-82a6-4d6d-a874-0fbf9436e7a9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] detach device xml: <interface type="ethernet">
Oct 16 18:27:47 user nova-compute[74247]:   <mac address="fa:16:3e:bc:93:6e"/>
Oct 16 18:27:47 user nova-compute[74247]:   <model type="virtio"/>
Oct 16 18:27:47 user nova-compute[74247]:   <mtu size="1442"/>
Oct 16 18:27:47 user nova-compute[74247]:   <target dev="tap246d0c9d-be"/>
Oct 16 18:27:47 user nova-compute[74247]: </interface>
Oct 16 18:27:47 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:27:47 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-2d9f3112-82a6-4d6d-a874-0fbf9436e7a9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:bc:93:6e"/><model type="virtio"/><mtu size="1442"/><target dev="tap246d0c9d-be"/></interface> {{(pid=74247) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 16 18:27:47 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-2d9f3112-82a6-4d6d-a874-0fbf9436e7a9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:bc:93:6e"/><model type="virtio"/><mtu size="1442"/><target dev="tap246d0c9d-be"/></interface>not found in domain: <domain type='kvm' id='6'>
Oct 16 18:27:47 user nova-compute[74247]:   <name>instance-00000006</name>
Oct 16 18:27:47 user nova-compute[74247]:   <uuid>c048698e-de64-4124-8d72-57fb819bb80e</uuid>
Oct 16 18:27:47 user nova-compute[74247]:   <metadata>
Oct 16 18:27:47 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:27:47 user nova-compute[74247]:   <nova:package version="0.0.0"/>
Oct 16 18:27:47 user nova-compute[74247]:   <nova:name>tempest-device-tagging-server-1708908380</nova:name>
Oct 16 18:27:47 user nova-compute[74247]:   <nova:creationTime>2023-10-16 18:26:24</nova:creationTime>
Oct 16 18:27:47 user nova-compute[74247]:   <nova:flavor name="m1.tiny">
Oct 16 18:27:47 user nova-compute[74247]:     <nova:memory>512</nova:memory>
Oct 16 18:27:47 user nova-compute[74247]:     <nova:disk>1</nova:disk>
Oct 16 18:27:47 user nova-compute[74247]:     <nova:swap>0</nova:swap>
Oct 16 18:27:47 user nova-compute[74247]:     <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:27:47 user nova-compute[74247]:     <nova:vcpus>1</nova:vcpus>
Oct 16 18:27:47 user nova-compute[74247]:   </nova:flavor>
Oct 16 18:27:47 user nova-compute[74247]:   <nova:owner>
Oct 16 18:27:47 user nova-compute[74247]:     <nova:user uuid="b2000726f45b45feb6c3c5cedcbd40e2">tempest-TaggedAttachmentsTest-1522926684-project-member</nova:user>
Oct 16 18:27:47 user nova-compute[74247]:     <nova:project uuid="4ab4b3ccbd914164a2d5b38c7b89777b">tempest-TaggedAttachmentsTest-1522926684</nova:project>
Oct 16 18:27:47 user nova-compute[74247]:   </nova:owner>
Oct 16 18:27:47 user nova-compute[74247]:   <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:27:47 user nova-compute[74247]:   <nova:ports>
Oct 16 18:27:47 user nova-compute[74247]:     <nova:port uuid="59256fa7-ebbd-4cde-80c4-012340d7aea0">
Oct 16 18:27:47 user nova-compute[74247]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 16 18:27:47 user nova-compute[74247]:     </nova:port>
Oct 16 18:27:47 user nova-compute[74247]:     <nova:port uuid="246d0c9d-bed7-460d-bbfd-0cb2ebe16dda">
Oct 16 18:27:47 user nova-compute[74247]:       <nova:ip type="fixed" address="10.10.10.162" ipVersion="4"/>
Oct 16 18:27:47 user nova-compute[74247]:     </nova:port>
Oct 16 18:27:47 user nova-compute[74247]:   </nova:ports>
Oct 16 18:27:47 user nova-compute[74247]: </nova:instance>
Oct 16 18:27:47 user nova-compute[74247]:   </metadata>
Oct 16 18:27:47 user nova-compute[74247]:   <memory unit='KiB'>524288</memory>
Oct 16 18:27:47 user nova-compute[74247]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 16 18:27:47 user nova-compute[74247]:   <vcpu placement='static'>1</vcpu>
Oct 16 18:27:47 user nova-compute[74247]:   <resource>
Oct 16 18:27:47 user nova-compute[74247]:     <partition>/machine</partition>
Oct 16 18:27:47 user nova-compute[74247]:   </resource>
Oct 16 18:27:47 user nova-compute[74247]:   <sysinfo type='smbios'>
Oct 16 18:27:47 user nova-compute[74247]:     <system>
Oct 16 18:27:47 user nova-compute[74247]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 16 18:27:47 user nova-compute[74247]:       <entry name='product'>OpenStack Nova</entry>
Oct 16 18:27:47 user nova-compute[74247]:       <entry name='version'>0.0.0</entry>
Oct 16 18:27:47 user nova-compute[74247]:       <entry name='serial'>c048698e-de64-4124-8d72-57fb819bb80e</entry>
Oct 16 18:27:47 user nova-compute[74247]:       <entry name='uuid'>c048698e-de64-4124-8d72-57fb819bb80e</entry>
Oct 16 18:27:47 user nova-compute[74247]:       <entry name='family'>Virtual Machine</entry>
Oct 16 18:27:47 user nova-compute[74247]:     </system>
Oct 16 18:27:47 user nova-compute[74247]:   </sysinfo>
Oct 16 18:27:47 user nova-compute[74247]:   <os>
Oct 16 18:27:47 user nova-compute[74247]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 16 18:27:47 user nova-compute[74247]:     <boot dev='hd'/>
Oct 16 18:27:47 user nova-compute[74247]:     <smbios mode='sysinfo'/>
Oct 16 18:27:47 user nova-compute[74247]:   </os>
Oct 16 18:27:47 user nova-compute[74247]:   <features>
Oct 16 18:27:47 user nova-compute[74247]:     <acpi/>
Oct 16 18:27:47 user nova-compute[74247]:     <apic/>
Oct 16 18:27:47 user nova-compute[74247]:     <vmcoreinfo state='on'/>
Oct 16 18:27:47 user nova-compute[74247]:   </features>
Oct 16 18:27:47 user nova-compute[74247]:   <cpu mode='custom' match='exact' check='full'>
Oct 16 18:27:47 user nova-compute[74247]:     <model fallback='forbid'>Nehalem</model>
Oct 16 18:27:47 user nova-compute[74247]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 16 18:27:47 user nova-compute[74247]:     <feature policy='require' name='vme'/>
Oct 16 18:27:47 user nova-compute[74247]:     <feature policy='require' name='x2apic'/>
Oct 16 18:27:47 user nova-compute[74247]:     <feature policy='require' name='hypervisor'/>
Oct 16 18:27:47 user nova-compute[74247]:   </cpu>
Oct 16 18:27:47 user nova-compute[74247]:   <clock offset='utc'>
Oct 16 18:27:47 user nova-compute[74247]:     <timer name='pit' tickpolicy='delay'/>
Oct 16 18:27:47 user nova-compute[74247]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 16 18:27:47 user nova-compute[74247]:     <timer name='hpet' present='no'/>
Oct 16 18:27:47 user nova-compute[74247]:   </clock>
Oct 16 18:27:47 user nova-compute[74247]:   <on_poweroff>destroy</on_poweroff>
Oct 16 18:27:47 user nova-compute[74247]:   <on_reboot>restart</on_reboot>
Oct 16 18:27:47 user nova-compute[74247]:   <on_crash>destroy</on_crash>
Oct 16 18:27:47 user nova-compute[74247]:   <devices>
Oct 16 18:27:47 user nova-compute[74247]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 16 18:27:47 user nova-compute[74247]:     <disk type='file' device='disk'>
Oct 16 18:27:47 user nova-compute[74247]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 16 18:27:47 user nova-compute[74247]:       <source file='/opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/disk' index='2'/>
Oct 16 18:27:47 user nova-compute[74247]:       <backingStore type='file' index='3'>
Oct 16 18:27:47 user nova-compute[74247]:         <format type='raw'/>
Oct 16 18:27:47 user nova-compute[74247]:         <source file='/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231'/>
Oct 16 18:27:47 user nova-compute[74247]:         <backingStore/>
Oct 16 18:27:47 user nova-compute[74247]:       </backingStore>
Oct 16 18:27:47 user nova-compute[74247]:       <target dev='vda' bus='virtio'/>
Oct 16 18:27:47 user nova-compute[74247]:       <alias name='virtio-disk0'/>
Oct 16 18:27:47 user nova-compute[74247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 16 18:27:47 user nova-compute[74247]:     </disk>
Oct 16 18:27:47 user nova-compute[74247]:     <disk type='file' device='cdrom'>
Oct 16 18:27:47 user nova-compute[74247]:       <driver name='qemu' type='raw' cache='none'/>
Oct 16 18:27:47 user nova-compute[74247]:       <source file='/opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/disk.config' index='1'/>
Oct 16 18:27:47 user nova-compute[74247]:       <backingStore/>
Oct 16 18:27:47 user nova-compute[74247]:       <target dev='hda' bus='ide'/>
Oct 16 18:27:47 user nova-compute[74247]:       <readonly/>
Oct 16 18:27:47 user nova-compute[74247]:       <alias name='ide0-0-0'/>
Oct 16 18:27:47 user nova-compute[74247]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 16 18:27:47 user nova-compute[74247]:     </disk>
Oct 16 18:27:47 user nova-compute[74247]:     <controller type='usb' index='0' model='none'>
Oct 16 18:27:47 user nova-compute[74247]:       <alias name='usb'/>
Oct 16 18:27:47 user nova-compute[74247]:     </controller>
Oct 16 18:27:47 user nova-compute[74247]:     <controller type='pci' index='0' model='pci-root'>
Oct 16 18:27:47 user nova-compute[74247]:       <alias name='pci.0'/>
Oct 16 18:27:47 user nova-compute[74247]:     </controller>
Oct 16 18:27:47 user nova-compute[74247]:     <controller type='ide' index='0'>
Oct 16 18:27:47 user nova-compute[74247]:       <alias name='ide'/>
Oct 16 18:27:47 user nova-compute[74247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 16 18:27:47 user nova-compute[74247]:     </controller>
Oct 16 18:27:47 user nova-compute[74247]:     <interface type='ethernet'>
Oct 16 18:27:47 user nova-compute[74247]:       <mac address='fa:16:3e:ff:27:0b'/>
Oct 16 18:27:47 user nova-compute[74247]:       <target dev='tap59256fa7-eb'/>
Oct 16 18:27:47 user nova-compute[74247]:       <model type='virtio'/>
Oct 16 18:27:47 user nova-compute[74247]:       <mtu size='1442'/>
Oct 16 18:27:47 user nova-compute[74247]:       <alias name='net0'/>
Oct 16 18:27:47 user nova-compute[74247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 16 18:27:47 user nova-compute[74247]:     </interface>
Oct 16 18:27:47 user nova-compute[74247]:     <interface type='ethernet'>
Oct 16 18:27:47 user nova-compute[74247]:       <mac address='fa:16:3e:bc:93:6e'/>
Oct 16 18:27:47 user nova-compute[74247]:       <target dev='tap246d0c9d-be'/>
Oct 16 18:27:47 user nova-compute[74247]:       <model type='virtio'/>
Oct 16 18:27:47 user nova-compute[74247]:       <mtu size='1442'/>
Oct 16 18:27:47 user nova-compute[74247]:       <alias name='net1'/>
Oct 16 18:27:47 user nova-compute[74247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Oct 16 18:27:47 user nova-compute[74247]:     </interface>
Oct 16 18:27:47 user nova-compute[74247]:     <serial type='pty'>
Oct 16 18:27:47 user nova-compute[74247]:       <source path='/dev/pts/5'/>
Oct 16 18:27:47 user nova-compute[74247]:       <log file='/opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/console.log' append='off'/>
Oct 16 18:27:47 user nova-compute[74247]:       <target type='isa-serial' port='0'>
Oct 16 18:27:47 user nova-compute[74247]:         <model name='isa-serial'/>
Oct 16 18:27:47 user nova-compute[74247]:       </target>
Oct 16 18:27:47 user nova-compute[74247]:       <alias name='serial0'/>
Oct 16 18:27:47 user nova-compute[74247]:     </serial>
Oct 16 18:27:47 user nova-compute[74247]:     <console type='pty' tty='/dev/pts/5'>
Oct 16 18:27:47 user nova-compute[74247]:       <source path='/dev/pts/5'/>
Oct 16 18:27:47 user nova-compute[74247]:       <log file='/opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/console.log' append='off'/>
Oct 16 18:27:47 user nova-compute[74247]:       <target type='serial' port='0'/>
Oct 16 18:27:47 user nova-compute[74247]:       <alias name='serial0'/>
Oct 16 18:27:47 user nova-compute[74247]:     </console>
Oct 16 18:27:47 user nova-compute[74247]:     <input type='mouse' bus='ps2'>
Oct 16 18:27:47 user nova-compute[74247]:       <alias name='input0'/>
Oct 16 18:27:47 user nova-compute[74247]:     </input>
Oct 16 18:27:47 user nova-compute[74247]:     <input type='keyboard' bus='ps2'>
Oct 16 18:27:47 user nova-compute[74247]:       <alias name='input1'/>
Oct 16 18:27:47 user nova-compute[74247]:     </input>
Oct 16 18:27:47 user nova-compute[74247]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Oct 16 18:27:47 user nova-compute[74247]:       <listen type='address' address='0.0.0.0'/>
Oct 16 18:27:47 user nova-compute[74247]:     </graphics>
Oct 16 18:27:47 user nova-compute[74247]:     <audio id='1' type='none'/>
Oct 16 18:27:47 user nova-compute[74247]:     <video>
Oct 16 18:27:47 user nova-compute[74247]:       <model type='virtio' heads='1' primary='yes'/>
Oct 16 18:27:47 user nova-compute[74247]:       <alias name='video0'/>
Oct 16 18:27:47 user nova-compute[74247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 16 18:27:47 user nova-compute[74247]:     </video>
Oct 16 18:27:47 user nova-compute[74247]:     <memballoon model='virtio'>
Oct 16 18:27:47 user nova-compute[74247]:       <stats period='10'/>
Oct 16 18:27:47 user nova-compute[74247]:       <alias name='balloon0'/>
Oct 16 18:27:47 user nova-compute[74247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 16 18:27:47 user nova-compute[74247]:     </memballoon>
Oct 16 18:27:47 user nova-compute[74247]:     <rng model='virtio'>
Oct 16 18:27:47 user nova-compute[74247]:       <backend model='random'>/dev/urandom</backend>
Oct 16 18:27:47 user nova-compute[74247]:       <alias name='rng0'/>
Oct 16 18:27:47 user nova-compute[74247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 16 18:27:47 user nova-compute[74247]:     </rng>
Oct 16 18:27:47 user nova-compute[74247]:   </devices>
Oct 16 18:27:47 user nova-compute[74247]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 16 18:27:47 user nova-compute[74247]:     <label>libvirt-c048698e-de64-4124-8d72-57fb819bb80e</label>
Oct 16 18:27:47 user nova-compute[74247]:     <imagelabel>libvirt-c048698e-de64-4124-8d72-57fb819bb80e</imagelabel>
Oct 16 18:27:47 user nova-compute[74247]:   </seclabel>
Oct 16 18:27:47 user nova-compute[74247]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 16 18:27:47 user nova-compute[74247]:     <label>+64055:+108</label>
Oct 16 18:27:47 user nova-compute[74247]:     <imagelabel>+64055:+108</imagelabel>
Oct 16 18:27:47 user nova-compute[74247]:   </seclabel>
Oct 16 18:27:47 user nova-compute[74247]: </domain>
Oct 16 18:27:47 user nova-compute[74247]:  {{(pid=74247) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 16 18:27:47 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-2d9f3112-82a6-4d6d-a874-0fbf9436e7a9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Successfully detached device tap246d0c9d-be from instance c048698e-de64-4124-8d72-57fb819bb80e from the persistent domain config.
Oct 16 18:27:47 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-2d9f3112-82a6-4d6d-a874-0fbf9436e7a9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] (1/8): Attempting to detach device tap246d0c9d-be with device alias net1 from instance c048698e-de64-4124-8d72-57fb819bb80e from the live domain config. {{(pid=74247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 18:27:47 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-2d9f3112-82a6-4d6d-a874-0fbf9436e7a9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] detach device xml: <interface type="ethernet">
Oct 16 18:27:47 user nova-compute[74247]:   <mac address="fa:16:3e:bc:93:6e"/>
Oct 16 18:27:47 user nova-compute[74247]:   <model type="virtio"/>
Oct 16 18:27:47 user nova-compute[74247]:   <mtu size="1442"/>
Oct 16 18:27:47 user nova-compute[74247]:   <target dev="tap246d0c9d-be"/>
Oct 16 18:27:47 user nova-compute[74247]: </interface>
Oct 16 18:27:47 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:27:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:47 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-2d9f3112-82a6-4d6d-a874-0fbf9436e7a9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Start waiting for the detach event from libvirt for device tap246d0c9d-be with device alias net1 for instance c048698e-de64-4124-8d72-57fb819bb80e {{(pid=74247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 18:27:47 user nova-compute[74247]: DEBUG nova.compute.manager [req-70282ccb-a6a3-4cea-b8dc-dbb3411a40c1 req-41bd0fa2-ca70-467a-9575-2d35ed766572 service nova] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Received event network-vif-plugged-6a65c68a-defd-43f5-86d4-885e9f05d19e {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:27:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-70282ccb-a6a3-4cea-b8dc-dbb3411a40c1 req-41bd0fa2-ca70-467a-9575-2d35ed766572 service nova] Acquiring lock "16ed0e45-071e-4c56-902d-42eacc97c2c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:27:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-70282ccb-a6a3-4cea-b8dc-dbb3411a40c1 req-41bd0fa2-ca70-467a-9575-2d35ed766572 service nova] Lock "16ed0e45-071e-4c56-902d-42eacc97c2c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:27:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-70282ccb-a6a3-4cea-b8dc-dbb3411a40c1 req-41bd0fa2-ca70-467a-9575-2d35ed766572 service nova] Lock "16ed0e45-071e-4c56-902d-42eacc97c2c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:27:47 user nova-compute[74247]: DEBUG nova.compute.manager [req-70282ccb-a6a3-4cea-b8dc-dbb3411a40c1 req-41bd0fa2-ca70-467a-9575-2d35ed766572 service nova] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] No waiting events found dispatching network-vif-plugged-6a65c68a-defd-43f5-86d4-885e9f05d19e {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:27:47 user nova-compute[74247]: WARNING nova.compute.manager [req-70282ccb-a6a3-4cea-b8dc-dbb3411a40c1 req-41bd0fa2-ca70-467a-9575-2d35ed766572 service nova] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Received unexpected event network-vif-plugged-6a65c68a-defd-43f5-86d4-885e9f05d19e for instance with vm_state building and task_state spawning.
Oct 16 18:27:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:48 user nova-compute[74247]: DEBUG nova.compute.manager [req-f9d1975d-163d-469e-8f14-1a43b7e07589 req-bf815a94-21e4-483f-8fff-f91d11ea61da service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Received event network-vif-unplugged-246d0c9d-bed7-460d-bbfd-0cb2ebe16dda {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:27:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f9d1975d-163d-469e-8f14-1a43b7e07589 req-bf815a94-21e4-483f-8fff-f91d11ea61da service nova] Acquiring lock "c048698e-de64-4124-8d72-57fb819bb80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:27:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f9d1975d-163d-469e-8f14-1a43b7e07589 req-bf815a94-21e4-483f-8fff-f91d11ea61da service nova] Lock "c048698e-de64-4124-8d72-57fb819bb80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:27:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f9d1975d-163d-469e-8f14-1a43b7e07589 req-bf815a94-21e4-483f-8fff-f91d11ea61da service nova] Lock "c048698e-de64-4124-8d72-57fb819bb80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:27:48 user nova-compute[74247]: DEBUG nova.compute.manager [req-f9d1975d-163d-469e-8f14-1a43b7e07589 req-bf815a94-21e4-483f-8fff-f91d11ea61da service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] No waiting events found dispatching network-vif-unplugged-246d0c9d-bed7-460d-bbfd-0cb2ebe16dda {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:27:48 user nova-compute[74247]: WARNING nova.compute.manager [req-f9d1975d-163d-469e-8f14-1a43b7e07589 req-bf815a94-21e4-483f-8fff-f91d11ea61da service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Received unexpected event network-vif-unplugged-246d0c9d-bed7-460d-bbfd-0cb2ebe16dda for instance with vm_state active and task_state None.
Oct 16 18:27:48 user nova-compute[74247]: DEBUG nova.network.neutron [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Successfully updated port: db973a04-4ef6-40c2-a694-c7a12631bc59 {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:27:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "refresh_cache-bbec99d1-82a3-4e4d-a3ae-17e00821bee1" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:27:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquired lock "refresh_cache-bbec99d1-82a3-4e4d-a3ae-17e00821bee1" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:27:48 user nova-compute[74247]: DEBUG nova.network.neutron [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:27:48 user nova-compute[74247]: DEBUG nova.network.neutron [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG nova.network.neutron [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Updating instance_info_cache with network_info: [{"id": "db973a04-4ef6-40c2-a694-c7a12631bc59", "address": "fa:16:3e:d4:26:c0", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb973a04-4e", "ovs_interfaceid": "db973a04-4ef6-40c2-a694-c7a12631bc59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Releasing lock "refresh_cache-bbec99d1-82a3-4e4d-a3ae-17e00821bee1" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG nova.compute.manager [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Instance network_info: |[{"id": "db973a04-4ef6-40c2-a694-c7a12631bc59", "address": "fa:16:3e:d4:26:c0", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb973a04-4e", "ovs_interfaceid": "db973a04-4ef6-40c2-a694-c7a12631bc59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Start _get_guest_xml network_info=[{"id": "db973a04-4ef6-40c2-a694-c7a12631bc59", "address": "fa:16:3e:d4:26:c0", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb973a04-4e", "ovs_interfaceid": "db973a04-4ef6-40c2-a694-c7a12631bc59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': '83126bb1-29f5-42fe-8620-72ab0797f776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:27:49 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:27:49 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:27:49 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:27:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1420825392',display_name='tempest-tempest.common.compute-instance-1420825392',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1420825392',id=13,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/3EvcYxSkv6EajRRkIzaFJ7f6uQhbqAKTds5ThHn386Pv+2tTgzyep551R0scho5zPYioOvrd00bJSB88s5K62otshFm+0x2KfMMxvYgCDs49Lx6Y3dzbzd3EgGqdZmw==',key_name='tempest-keypair-461314413',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42bd3eb752f04fd48dfe0623fdf2fe9f',ramdisk_id='',reservation_id='r-vea0fn6c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-291765974',owner_user_name='tempest-ServerActionsTestOtherA-291765974-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:27:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3635a30f06234f0d9a8e0604c25f1208',uuid=bbec99d1-82a3-4e4d-a3ae-17e00821bee1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db973a04-4ef6-40c2-a694-c7a12631bc59", "address": "fa:16:3e:d4:26:c0", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb973a04-4e", "ovs_interfaceid": "db973a04-4ef6-40c2-a694-c7a12631bc59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Converting VIF {"id": "db973a04-4ef6-40c2-a694-c7a12631bc59", "address": "fa:16:3e:d4:26:c0", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb973a04-4e", "ovs_interfaceid": "db973a04-4ef6-40c2-a694-c7a12631bc59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:26:c0,bridge_name='br-int',has_traffic_filtering=True,id=db973a04-4ef6-40c2-a694-c7a12631bc59,network=Network(0a61bae1-2607-4e42-b573-e74ac3edf09a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb973a04-4e') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG nova.objects.instance [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lazy-loading 'pci_devices' on Instance uuid bbec99d1-82a3-4e4d-a3ae-17e00821bee1 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:27:49 user nova-compute[74247]:   <uuid>bbec99d1-82a3-4e4d-a3ae-17e00821bee1</uuid>
Oct 16 18:27:49 user nova-compute[74247]:   <name>instance-0000000d</name>
Oct 16 18:27:49 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:27:49 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:27:49 user nova-compute[74247]:   <metadata>
Oct 16 18:27:49 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:27:49 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:27:49 user nova-compute[74247]:       <nova:name>tempest-tempest.common.compute-instance-1420825392</nova:name>
Oct 16 18:27:49 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:27:49</nova:creationTime>
Oct 16 18:27:49 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:27:49 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:27:49 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:27:49 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:27:49 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:27:49 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:27:49 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:27:49 user nova-compute[74247]:       <nova:owner>
Oct 16 18:27:49 user nova-compute[74247]:         <nova:user uuid="3635a30f06234f0d9a8e0604c25f1208">tempest-ServerActionsTestOtherA-291765974-project-member</nova:user>
Oct 16 18:27:49 user nova-compute[74247]:         <nova:project uuid="42bd3eb752f04fd48dfe0623fdf2fe9f">tempest-ServerActionsTestOtherA-291765974</nova:project>
Oct 16 18:27:49 user nova-compute[74247]:       </nova:owner>
Oct 16 18:27:49 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:27:49 user nova-compute[74247]:       <nova:ports>
Oct 16 18:27:49 user nova-compute[74247]:         <nova:port uuid="db973a04-4ef6-40c2-a694-c7a12631bc59">
Oct 16 18:27:49 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 16 18:27:49 user nova-compute[74247]:         </nova:port>
Oct 16 18:27:49 user nova-compute[74247]:       </nova:ports>
Oct 16 18:27:49 user nova-compute[74247]:     </nova:instance>
Oct 16 18:27:49 user nova-compute[74247]:   </metadata>
Oct 16 18:27:49 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:27:49 user nova-compute[74247]:     <system>
Oct 16 18:27:49 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:27:49 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:27:49 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:27:49 user nova-compute[74247]:       <entry name="serial">bbec99d1-82a3-4e4d-a3ae-17e00821bee1</entry>
Oct 16 18:27:49 user nova-compute[74247]:       <entry name="uuid">bbec99d1-82a3-4e4d-a3ae-17e00821bee1</entry>
Oct 16 18:27:49 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:27:49 user nova-compute[74247]:     </system>
Oct 16 18:27:49 user nova-compute[74247]:   </sysinfo>
Oct 16 18:27:49 user nova-compute[74247]:   <os>
Oct 16 18:27:49 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:27:49 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:27:49 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:27:49 user nova-compute[74247]:   </os>
Oct 16 18:27:49 user nova-compute[74247]:   <features>
Oct 16 18:27:49 user nova-compute[74247]:     <acpi/>
Oct 16 18:27:49 user nova-compute[74247]:     <apic/>
Oct 16 18:27:49 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:27:49 user nova-compute[74247]:   </features>
Oct 16 18:27:49 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:27:49 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:27:49 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:27:49 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:27:49 user nova-compute[74247]:   </clock>
Oct 16 18:27:49 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:27:49 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:27:49 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:27:49 user nova-compute[74247]:   </cpu>
Oct 16 18:27:49 user nova-compute[74247]:   <devices>
Oct 16 18:27:49 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:27:49 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:27:49 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/disk"/>
Oct 16 18:27:49 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:27:49 user nova-compute[74247]:     </disk>
Oct 16 18:27:49 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:27:49 user nova-compute[74247]:       <mac address="fa:16:3e:d4:26:c0"/>
Oct 16 18:27:49 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:27:49 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:27:49 user nova-compute[74247]:       <target dev="tapdb973a04-4e"/>
Oct 16 18:27:49 user nova-compute[74247]:     </interface>
Oct 16 18:27:49 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:27:49 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/console.log" append="off"/>
Oct 16 18:27:49 user nova-compute[74247]:     </serial>
Oct 16 18:27:49 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:27:49 user nova-compute[74247]:     <video>
Oct 16 18:27:49 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:27:49 user nova-compute[74247]:     </video>
Oct 16 18:27:49 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:27:49 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:27:49 user nova-compute[74247]:     </rng>
Oct 16 18:27:49 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:27:49 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:27:49 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:27:49 user nova-compute[74247]:     </memballoon>
Oct 16 18:27:49 user nova-compute[74247]:   </devices>
Oct 16 18:27:49 user nova-compute[74247]: </domain>
Oct 16 18:27:49 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:27:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1420825392',display_name='tempest-tempest.common.compute-instance-1420825392',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1420825392',id=13,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/3EvcYxSkv6EajRRkIzaFJ7f6uQhbqAKTds5ThHn386Pv+2tTgzyep551R0scho5zPYioOvrd00bJSB88s5K62otshFm+0x2KfMMxvYgCDs49Lx6Y3dzbzd3EgGqdZmw==',key_name='tempest-keypair-461314413',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42bd3eb752f04fd48dfe0623fdf2fe9f',ramdisk_id='',reservation_id='r-vea0fn6c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-291765974',owner_user_name='tempest-ServerActionsTestOtherA-291765974-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:27:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3635a30f06234f0d9a8e0604c25f1208',uuid=bbec99d1-82a3-4e4d-a3ae-17e00821bee1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db973a04-4ef6-40c2-a694-c7a12631bc59", "address": "fa:16:3e:d4:26:c0", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb973a04-4e", "ovs_interfaceid": "db973a04-4ef6-40c2-a694-c7a12631bc59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Converting VIF {"id": "db973a04-4ef6-40c2-a694-c7a12631bc59", "address": "fa:16:3e:d4:26:c0", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb973a04-4e", "ovs_interfaceid": "db973a04-4ef6-40c2-a694-c7a12631bc59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:26:c0,bridge_name='br-int',has_traffic_filtering=True,id=db973a04-4ef6-40c2-a694-c7a12631bc59,network=Network(0a61bae1-2607-4e42-b573-e74ac3edf09a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb973a04-4e') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG os_vif [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:26:c0,bridge_name='br-int',has_traffic_filtering=True,id=db973a04-4ef6-40c2-a694-c7a12631bc59,network=Network(0a61bae1-2607-4e42-b573-e74ac3edf09a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb973a04-4e') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dfd79c7b-9294-5f6e-9568-19298ce85084', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb973a04-4e, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdb973a04-4e, col_values=(('qos', UUID('6dfae2e1-599d-4000-bf4b-6aa7b1c574c7')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdb973a04-4e, col_values=(('external_ids', {'iface-id': 'db973a04-4ef6-40c2-a694-c7a12631bc59', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:26:c0', 'vm-uuid': 'bbec99d1-82a3-4e4d-a3ae-17e00821bee1'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:49 user nova-compute[74247]: INFO os_vif [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:26:c0,bridge_name='br-int',has_traffic_filtering=True,id=db973a04-4ef6-40c2-a694-c7a12631bc59,network=Network(0a61bae1-2607-4e42-b573-e74ac3edf09a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb973a04-4e')
Oct 16 18:27:49 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] No VIF found with MAC fa:16:3e:d4:26:c0, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG nova.compute.manager [req-99253479-5677-42b9-8319-defafaa718f7 req-8f33e003-72d8-4d1f-80db-94b8c2c31640 service nova] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Received event network-vif-plugged-6a65c68a-defd-43f5-86d4-885e9f05d19e {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-99253479-5677-42b9-8319-defafaa718f7 req-8f33e003-72d8-4d1f-80db-94b8c2c31640 service nova] Acquiring lock "16ed0e45-071e-4c56-902d-42eacc97c2c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-99253479-5677-42b9-8319-defafaa718f7 req-8f33e003-72d8-4d1f-80db-94b8c2c31640 service nova] Lock "16ed0e45-071e-4c56-902d-42eacc97c2c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-99253479-5677-42b9-8319-defafaa718f7 req-8f33e003-72d8-4d1f-80db-94b8c2c31640 service nova] Lock "16ed0e45-071e-4c56-902d-42eacc97c2c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:27:49 user nova-compute[74247]: DEBUG nova.compute.manager [req-99253479-5677-42b9-8319-defafaa718f7 req-8f33e003-72d8-4d1f-80db-94b8c2c31640 service nova] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] No waiting events found dispatching network-vif-plugged-6a65c68a-defd-43f5-86d4-885e9f05d19e {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:27:49 user nova-compute[74247]: WARNING nova.compute.manager [req-99253479-5677-42b9-8319-defafaa718f7 req-8f33e003-72d8-4d1f-80db-94b8c2c31640 service nova] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Received unexpected event network-vif-plugged-6a65c68a-defd-43f5-86d4-885e9f05d19e for instance with vm_state building and task_state spawning.
Oct 16 18:27:50 user nova-compute[74247]: DEBUG nova.compute.manager [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:27:50 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:27:50 user nova-compute[74247]: DEBUG nova.compute.manager [req-0ee1ad5b-077e-4198-872f-db704099e4ad req-c498eff7-8c29-45f1-b16b-9c7610162c5f service nova] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Received event network-changed-db973a04-4ef6-40c2-a694-c7a12631bc59 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:27:50 user nova-compute[74247]: DEBUG nova.compute.manager [req-0ee1ad5b-077e-4198-872f-db704099e4ad req-c498eff7-8c29-45f1-b16b-9c7610162c5f service nova] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Refreshing instance network info cache due to event network-changed-db973a04-4ef6-40c2-a694-c7a12631bc59. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:27:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0ee1ad5b-077e-4198-872f-db704099e4ad req-c498eff7-8c29-45f1-b16b-9c7610162c5f service nova] Acquiring lock "refresh_cache-bbec99d1-82a3-4e4d-a3ae-17e00821bee1" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:27:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0ee1ad5b-077e-4198-872f-db704099e4ad req-c498eff7-8c29-45f1-b16b-9c7610162c5f service nova] Acquired lock "refresh_cache-bbec99d1-82a3-4e4d-a3ae-17e00821bee1" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:27:50 user nova-compute[74247]: DEBUG nova.network.neutron [req-0ee1ad5b-077e-4198-872f-db704099e4ad req-c498eff7-8c29-45f1-b16b-9c7610162c5f service nova] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Refreshing network info cache for port db973a04-4ef6-40c2-a694-c7a12631bc59 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:27:50 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Instance spawned successfully.
Oct 16 18:27:50 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 18:27:50 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:27:50 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:27:50 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:27:50 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:27:50 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:27:50 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:27:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:50 user nova-compute[74247]: INFO nova.compute.manager [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Took 7.56 seconds to spawn the instance on the hypervisor.
Oct 16 18:27:50 user nova-compute[74247]: DEBUG nova.compute.manager [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:27:51 user nova-compute[74247]: INFO nova.compute.manager [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Took 8.76 seconds to build instance.
Oct 16 18:27:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5d7457c8-4c80-4ed9-a4a8-6b83c63b0441 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lock "16ed0e45-071e-4c56-902d-42eacc97c2c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.880s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:27:51 user nova-compute[74247]: DEBUG nova.network.neutron [req-0ee1ad5b-077e-4198-872f-db704099e4ad req-c498eff7-8c29-45f1-b16b-9c7610162c5f service nova] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Updated VIF entry in instance network info cache for port db973a04-4ef6-40c2-a694-c7a12631bc59. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:27:51 user nova-compute[74247]: DEBUG nova.network.neutron [req-0ee1ad5b-077e-4198-872f-db704099e4ad req-c498eff7-8c29-45f1-b16b-9c7610162c5f service nova] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Updating instance_info_cache with network_info: [{"id": "db973a04-4ef6-40c2-a694-c7a12631bc59", "address": "fa:16:3e:d4:26:c0", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb973a04-4e", "ovs_interfaceid": "db973a04-4ef6-40c2-a694-c7a12631bc59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:27:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0ee1ad5b-077e-4198-872f-db704099e4ad req-c498eff7-8c29-45f1-b16b-9c7610162c5f service nova] Releasing lock "refresh_cache-bbec99d1-82a3-4e4d-a3ae-17e00821bee1" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:27:51 user nova-compute[74247]: DEBUG nova.compute.manager [req-0ee1ad5b-077e-4198-872f-db704099e4ad req-c498eff7-8c29-45f1-b16b-9c7610162c5f service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Received event network-vif-plugged-246d0c9d-bed7-460d-bbfd-0cb2ebe16dda {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:27:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0ee1ad5b-077e-4198-872f-db704099e4ad req-c498eff7-8c29-45f1-b16b-9c7610162c5f service nova] Acquiring lock "c048698e-de64-4124-8d72-57fb819bb80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:27:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0ee1ad5b-077e-4198-872f-db704099e4ad req-c498eff7-8c29-45f1-b16b-9c7610162c5f service nova] Lock "c048698e-de64-4124-8d72-57fb819bb80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:27:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0ee1ad5b-077e-4198-872f-db704099e4ad req-c498eff7-8c29-45f1-b16b-9c7610162c5f service nova] Lock "c048698e-de64-4124-8d72-57fb819bb80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:27:51 user nova-compute[74247]: DEBUG nova.compute.manager [req-0ee1ad5b-077e-4198-872f-db704099e4ad req-c498eff7-8c29-45f1-b16b-9c7610162c5f service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] No waiting events found dispatching network-vif-plugged-246d0c9d-bed7-460d-bbfd-0cb2ebe16dda {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:27:51 user nova-compute[74247]: WARNING nova.compute.manager [req-0ee1ad5b-077e-4198-872f-db704099e4ad req-c498eff7-8c29-45f1-b16b-9c7610162c5f service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Received unexpected event network-vif-plugged-246d0c9d-bed7-460d-bbfd-0cb2ebe16dda for instance with vm_state active and task_state None.
Oct 16 18:27:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:52 user nova-compute[74247]: DEBUG nova.compute.manager [req-3b9d9ef9-75d9-4210-a344-d71658cb8fd4 req-cb49f1d4-53e4-4fe4-8766-a0b29c5277b6 service nova] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Received event network-vif-plugged-db973a04-4ef6-40c2-a694-c7a12631bc59 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:27:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3b9d9ef9-75d9-4210-a344-d71658cb8fd4 req-cb49f1d4-53e4-4fe4-8766-a0b29c5277b6 service nova] Acquiring lock "bbec99d1-82a3-4e4d-a3ae-17e00821bee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:27:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3b9d9ef9-75d9-4210-a344-d71658cb8fd4 req-cb49f1d4-53e4-4fe4-8766-a0b29c5277b6 service nova] Lock "bbec99d1-82a3-4e4d-a3ae-17e00821bee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:27:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3b9d9ef9-75d9-4210-a344-d71658cb8fd4 req-cb49f1d4-53e4-4fe4-8766-a0b29c5277b6 service nova] Lock "bbec99d1-82a3-4e4d-a3ae-17e00821bee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:27:52 user nova-compute[74247]: DEBUG nova.compute.manager [req-3b9d9ef9-75d9-4210-a344-d71658cb8fd4 req-cb49f1d4-53e4-4fe4-8766-a0b29c5277b6 service nova] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] No waiting events found dispatching network-vif-plugged-db973a04-4ef6-40c2-a694-c7a12631bc59 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:27:52 user nova-compute[74247]: WARNING nova.compute.manager [req-3b9d9ef9-75d9-4210-a344-d71658cb8fd4 req-cb49f1d4-53e4-4fe4-8766-a0b29c5277b6 service nova] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Received unexpected event network-vif-plugged-db973a04-4ef6-40c2-a694-c7a12631bc59 for instance with vm_state building and task_state spawning.
Oct 16 18:27:52 user nova-compute[74247]: DEBUG nova.compute.manager [req-3b9d9ef9-75d9-4210-a344-d71658cb8fd4 req-cb49f1d4-53e4-4fe4-8766-a0b29c5277b6 service nova] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Received event network-vif-plugged-db973a04-4ef6-40c2-a694-c7a12631bc59 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:27:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3b9d9ef9-75d9-4210-a344-d71658cb8fd4 req-cb49f1d4-53e4-4fe4-8766-a0b29c5277b6 service nova] Acquiring lock "bbec99d1-82a3-4e4d-a3ae-17e00821bee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:27:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3b9d9ef9-75d9-4210-a344-d71658cb8fd4 req-cb49f1d4-53e4-4fe4-8766-a0b29c5277b6 service nova] Lock "bbec99d1-82a3-4e4d-a3ae-17e00821bee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:27:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3b9d9ef9-75d9-4210-a344-d71658cb8fd4 req-cb49f1d4-53e4-4fe4-8766-a0b29c5277b6 service nova] Lock "bbec99d1-82a3-4e4d-a3ae-17e00821bee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:27:52 user nova-compute[74247]: DEBUG nova.compute.manager [req-3b9d9ef9-75d9-4210-a344-d71658cb8fd4 req-cb49f1d4-53e4-4fe4-8766-a0b29c5277b6 service nova] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] No waiting events found dispatching network-vif-plugged-db973a04-4ef6-40c2-a694-c7a12631bc59 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:27:52 user nova-compute[74247]: WARNING nova.compute.manager [req-3b9d9ef9-75d9-4210-a344-d71658cb8fd4 req-cb49f1d4-53e4-4fe4-8766-a0b29c5277b6 service nova] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Received unexpected event network-vif-plugged-db973a04-4ef6-40c2-a694-c7a12631bc59 for instance with vm_state building and task_state spawning.
Oct 16 18:27:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Acquiring lock "a686ee86-272c-47be-8801-9c1500af272f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:27:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lock "a686ee86-272c-47be-8801-9c1500af272f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:27:53 user nova-compute[74247]: DEBUG nova.objects.instance [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lazy-loading 'flavor' on Instance uuid a686ee86-272c-47be-8801-9c1500af272f {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:27:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lock "a686ee86-272c-47be-8801-9c1500af272f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.109s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:27:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Acquiring lock "a686ee86-272c-47be-8801-9c1500af272f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:27:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lock "a686ee86-272c-47be-8801-9c1500af272f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:27:53 user nova-compute[74247]: INFO nova.compute.manager [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Attaching volume 8223babc-be85-42b1-899b-b21e077ad7c6 to /dev/vdb
Oct 16 18:27:53 user nova-compute[74247]: DEBUG os_brick.utils [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:27:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:53 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea00e6a9-d3f6-4186-8efb-a1885ae3f6f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.030s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:53 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac6b6f3-68a2-40e8-a142-b350ba429e0d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:53 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18f1840-d30c-48f8-a25a-a8e76ba8d347]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:53 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cfaebbe-b093-43af-9118-a185987f9ee9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:27:53 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 18:27:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:27:53 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 18:27:53 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[333d51cf-46ae-4f90-a3bf-0e06f31856a3]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:27:53 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 18:27:53 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 18:27:53 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 18:27:53 user nova-compute[74247]: DEBUG os_brick.utils [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] <== get_connector_properties: return (194ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:27:53 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Updating existing volume attachment record: 22fd8982-443a-4304-9cd2-e1800c017bb2 {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 18:27:54 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Acquiring lock "7c17a25b-6818-48fa-b406-638dbf1845d4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:27:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lock "7c17a25b-6818-48fa-b406-638dbf1845d4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:27:54 user nova-compute[74247]: DEBUG nova.compute.manager [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:27:54 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:27:54 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Instance spawned successfully.
Oct 16 18:27:54 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 18:27:54 user nova-compute[74247]: DEBUG nova.compute.manager [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 18:27:54 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:27:54 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:27:54 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:27:54 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:27:54 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:27:54 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:27:54 user nova-compute[74247]: INFO nova.compute.manager [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Took 10.20 seconds to spawn the instance on the hypervisor.
Oct 16 18:27:54 user nova-compute[74247]: DEBUG nova.compute.manager [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:27:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:27:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:27:54 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:27:54 user nova-compute[74247]: INFO nova.compute.claims [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Claim successful on node user
Oct 16 18:27:54 user nova-compute[74247]: INFO nova.compute.manager [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Took 11.49 seconds to build instance.
Oct 16 18:27:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-dc4152ce-6718-4bc3-a7af-c6337bd1d78c tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "bbec99d1-82a3-4e4d-a3ae-17e00821bee1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.672s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:27:55 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:27:55 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:27:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.703s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:27:55 user nova-compute[74247]: DEBUG nova.compute.manager [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 18:27:55 user nova-compute[74247]: DEBUG nova.compute.manager [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 18:27:55 user nova-compute[74247]: DEBUG nova.network.neutron [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 18:27:55 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 18:27:55 user nova-compute[74247]: DEBUG nova.compute.manager [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 18:27:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:55 user nova-compute[74247]: DEBUG nova.policy [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7601cab932f74be396a6d8a59568dc9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021c1d91069e4798af2caae2c29694ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 18:27:55 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:27:55 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:27:55 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:27:55 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 18:27:55 user nova-compute[74247]: DEBUG nova.compute.manager [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 18:27:55 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:27:55 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Creating image(s)
Oct 16 18:27:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Acquiring lock "/opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:27:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lock "/opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:27:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lock "/opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:27:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "refresh_cache-4daa6370-2cdf-4668-b66b-e10196377c9c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:27:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquired lock "refresh_cache-4daa6370-2cdf-4668-b66b-e10196377c9c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:27:55 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Forcefully refreshing network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 18:27:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.232s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Acquiring lock "37399febbd18f60b85fd0f833558f6a3539ab231" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:27:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:27:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.288s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk 1073741824 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk 1073741824" returned: 0 in 0.089s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.385s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:27:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:56 user nova-compute[74247]: DEBUG nova.network.neutron [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Successfully created port: 5f5253f2-6e79-44f0-a4aa-167f273e7c6a {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:27:56 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Updating instance_info_cache with network_info: [{"id": "4d30f22d-4337-41a7-965d-f9c172049b00", "address": "fa:16:3e:5c:05:1d", "network": {"id": "8451dc81-ded8-462e-a394-f5cd774f684b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1470365086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42df518506b24ac5bedd9d75b15fa9b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d30f22d-43", "ovs_interfaceid": "4d30f22d-4337-41a7-965d-f9c172049b00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:27:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Releasing lock "refresh_cache-4daa6370-2cdf-4668-b66b-e10196377c9c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:27:56 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Updated the network info_cache for instance {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 18:27:56 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:27:56 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:27:56 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:27:56 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:27:56 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:27:56 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:27:56 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 18:27:56 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:27:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.264s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:56 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk. size=1073741824 {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 18:27:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:27:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:27:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:27:56 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 18:27:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:56 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Cannot resize image /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk to a smaller size. {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 18:27:56 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 18:27:56 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Ensure instance console log exists: /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:27:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:27:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:27:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:27:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:57 user nova-compute[74247]: DEBUG nova.network.neutron [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Successfully updated port: 5f5253f2-6e79-44f0-a4aa-167f273e7c6a {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:27:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Acquiring lock "refresh_cache-7c17a25b-6818-48fa-b406-638dbf1845d4" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:27:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Acquired lock "refresh_cache-7c17a25b-6818-48fa-b406-638dbf1845d4" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:27:57 user nova-compute[74247]: DEBUG nova.network.neutron [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:27:57 user nova-compute[74247]: DEBUG nova.compute.manager [req-79bf9555-eee0-41be-a6f3-10957276e336 req-2d269ef2-645c-43b5-bafb-edc620d8dd12 service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Received event network-changed-5f5253f2-6e79-44f0-a4aa-167f273e7c6a {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:27:57 user nova-compute[74247]: DEBUG nova.compute.manager [req-79bf9555-eee0-41be-a6f3-10957276e336 req-2d269ef2-645c-43b5-bafb-edc620d8dd12 service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Refreshing instance network info cache due to event network-changed-5f5253f2-6e79-44f0-a4aa-167f273e7c6a. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:27:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-79bf9555-eee0-41be-a6f3-10957276e336 req-2d269ef2-645c-43b5-bafb-edc620d8dd12 service nova] Acquiring lock "refresh_cache-7c17a25b-6818-48fa-b406-638dbf1845d4" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:27:57 user nova-compute[74247]: DEBUG nova.network.neutron [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:27:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:57 user nova-compute[74247]: DEBUG nova.compute.manager [req-4bf61dc4-578e-4224-bf81-68d41f46863f req-a16747e5-4960-40da-b377-1de9afc05e73 service nova] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Received event volume-reimaged-3ab08fda-c4e7-456c-8003-24c8bfb6c688 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:27:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4bf61dc4-578e-4224-bf81-68d41f46863f req-a16747e5-4960-40da-b377-1de9afc05e73 service nova] Acquiring lock "73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:27:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4bf61dc4-578e-4224-bf81-68d41f46863f req-a16747e5-4960-40da-b377-1de9afc05e73 service nova] Lock "73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:27:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4bf61dc4-578e-4224-bf81-68d41f46863f req-a16747e5-4960-40da-b377-1de9afc05e73 service nova] Lock "73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:27:57 user nova-compute[74247]: DEBUG nova.compute.manager [req-4bf61dc4-578e-4224-bf81-68d41f46863f req-a16747e5-4960-40da-b377-1de9afc05e73 service nova] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Processing event volume-reimaged-3ab08fda-c4e7-456c-8003-24c8bfb6c688 {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10871}}
Oct 16 18:27:57 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Instance event wait completed in 31 seconds for volume-reimaged {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:27:57 user nova-compute[74247]: DEBUG nova.network.neutron [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Updating instance_info_cache with network_info: [{"id": "5f5253f2-6e79-44f0-a4aa-167f273e7c6a", "address": "fa:16:3e:f9:f6:64", "network": {"id": "b8a52a8d-7eca-40b7-b94b-820a4ab8687b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1308054402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "021c1d91069e4798af2caae2c29694ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5253f2-6e", "ovs_interfaceid": "5f5253f2-6e79-44f0-a4aa-167f273e7c6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Releasing lock "refresh_cache-7c17a25b-6818-48fa-b406-638dbf1845d4" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG nova.compute.manager [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Instance network_info: |[{"id": "5f5253f2-6e79-44f0-a4aa-167f273e7c6a", "address": "fa:16:3e:f9:f6:64", "network": {"id": "b8a52a8d-7eca-40b7-b94b-820a4ab8687b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1308054402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "021c1d91069e4798af2caae2c29694ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5253f2-6e", "ovs_interfaceid": "5f5253f2-6e79-44f0-a4aa-167f273e7c6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-79bf9555-eee0-41be-a6f3-10957276e336 req-2d269ef2-645c-43b5-bafb-edc620d8dd12 service nova] Acquired lock "refresh_cache-7c17a25b-6818-48fa-b406-638dbf1845d4" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG nova.network.neutron [req-79bf9555-eee0-41be-a6f3-10957276e336 req-2d269ef2-645c-43b5-bafb-edc620d8dd12 service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Refreshing network info cache for port 5f5253f2-6e79-44f0-a4aa-167f273e7c6a {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Start _get_guest_xml network_info=[{"id": "5f5253f2-6e79-44f0-a4aa-167f273e7c6a", "address": "fa:16:3e:f9:f6:64", "network": {"id": "b8a52a8d-7eca-40b7-b94b-820a4ab8687b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1308054402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "021c1d91069e4798af2caae2c29694ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5253f2-6e", "ovs_interfaceid": "5f5253f2-6e79-44f0-a4aa-167f273e7c6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': '83126bb1-29f5-42fe-8620-72ab0797f776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:27:58 user nova-compute[74247]: INFO nova.virt.block_device [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Booting with volume 3ab08fda-c4e7-456c-8003-24c8bfb6c688 at /dev/vda
Oct 16 18:27:58 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:27:58 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:27:58 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:27:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2056095538',display_name='tempest-ServerStableDeviceRescueTest-server-2056095538',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2056095538',id=14,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNw4l9zlgXNO30XsKe4Vj/du/OZkqc9heI+vCPA/3reIdMuWdthuZZGAOiDNP07hjzSUKEhxbgz+Vel73d0eDePuZLQtInh8vruuIgwyafEohXs7W0XS/37cHW8FQVpNBg==',key_name='tempest-keypair-1094775864',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='021c1d91069e4798af2caae2c29694ba',ramdisk_id='',reservation_id='r-oa4qirax',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1208025923',owner_user_name='tempest-ServerStableDeviceRescueTest-1208025923-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:27:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7601cab932f74be396a6d8a59568dc9f',uuid=7c17a25b-6818-48fa-b406-638dbf1845d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f5253f2-6e79-44f0-a4aa-167f273e7c6a", "address": "fa:16:3e:f9:f6:64", "network": {"id": "b8a52a8d-7eca-40b7-b94b-820a4ab8687b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1308054402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "021c1d91069e4798af2caae2c29694ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5253f2-6e", "ovs_interfaceid": "5f5253f2-6e79-44f0-a4aa-167f273e7c6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Converting VIF {"id": "5f5253f2-6e79-44f0-a4aa-167f273e7c6a", "address": "fa:16:3e:f9:f6:64", "network": {"id": "b8a52a8d-7eca-40b7-b94b-820a4ab8687b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1308054402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "021c1d91069e4798af2caae2c29694ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5253f2-6e", "ovs_interfaceid": "5f5253f2-6e79-44f0-a4aa-167f273e7c6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:f6:64,bridge_name='br-int',has_traffic_filtering=True,id=5f5253f2-6e79-44f0-a4aa-167f273e7c6a,network=Network(b8a52a8d-7eca-40b7-b94b-820a4ab8687b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5253f2-6e') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG nova.objects.instance [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c17a25b-6818-48fa-b406-638dbf1845d4 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk --force-share --output=json" returned: 0 in 0.339s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:27:58 user nova-compute[74247]:   <uuid>7c17a25b-6818-48fa-b406-638dbf1845d4</uuid>
Oct 16 18:27:58 user nova-compute[74247]:   <name>instance-0000000e</name>
Oct 16 18:27:58 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:27:58 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:27:58 user nova-compute[74247]:   <metadata>
Oct 16 18:27:58 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:27:58 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:27:58 user nova-compute[74247]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-2056095538</nova:name>
Oct 16 18:27:58 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:27:58</nova:creationTime>
Oct 16 18:27:58 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:27:58 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:27:58 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:27:58 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:27:58 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:27:58 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:27:58 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:27:58 user nova-compute[74247]:       <nova:owner>
Oct 16 18:27:58 user nova-compute[74247]:         <nova:user uuid="7601cab932f74be396a6d8a59568dc9f">tempest-ServerStableDeviceRescueTest-1208025923-project-member</nova:user>
Oct 16 18:27:58 user nova-compute[74247]:         <nova:project uuid="021c1d91069e4798af2caae2c29694ba">tempest-ServerStableDeviceRescueTest-1208025923</nova:project>
Oct 16 18:27:58 user nova-compute[74247]:       </nova:owner>
Oct 16 18:27:58 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:27:58 user nova-compute[74247]:       <nova:ports>
Oct 16 18:27:58 user nova-compute[74247]:         <nova:port uuid="5f5253f2-6e79-44f0-a4aa-167f273e7c6a">
Oct 16 18:27:58 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 16 18:27:58 user nova-compute[74247]:         </nova:port>
Oct 16 18:27:58 user nova-compute[74247]:       </nova:ports>
Oct 16 18:27:58 user nova-compute[74247]:     </nova:instance>
Oct 16 18:27:58 user nova-compute[74247]:   </metadata>
Oct 16 18:27:58 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:27:58 user nova-compute[74247]:     <system>
Oct 16 18:27:58 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:27:58 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:27:58 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:27:58 user nova-compute[74247]:       <entry name="serial">7c17a25b-6818-48fa-b406-638dbf1845d4</entry>
Oct 16 18:27:58 user nova-compute[74247]:       <entry name="uuid">7c17a25b-6818-48fa-b406-638dbf1845d4</entry>
Oct 16 18:27:58 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:27:58 user nova-compute[74247]:     </system>
Oct 16 18:27:58 user nova-compute[74247]:   </sysinfo>
Oct 16 18:27:58 user nova-compute[74247]:   <os>
Oct 16 18:27:58 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:27:58 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:27:58 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:27:58 user nova-compute[74247]:   </os>
Oct 16 18:27:58 user nova-compute[74247]:   <features>
Oct 16 18:27:58 user nova-compute[74247]:     <acpi/>
Oct 16 18:27:58 user nova-compute[74247]:     <apic/>
Oct 16 18:27:58 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:27:58 user nova-compute[74247]:   </features>
Oct 16 18:27:58 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:27:58 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:27:58 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:27:58 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:27:58 user nova-compute[74247]:   </clock>
Oct 16 18:27:58 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:27:58 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:27:58 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:27:58 user nova-compute[74247]:   </cpu>
Oct 16 18:27:58 user nova-compute[74247]:   <devices>
Oct 16 18:27:58 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:27:58 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:27:58 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk"/>
Oct 16 18:27:58 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:27:58 user nova-compute[74247]:     </disk>
Oct 16 18:27:58 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:27:58 user nova-compute[74247]:       <mac address="fa:16:3e:f9:f6:64"/>
Oct 16 18:27:58 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:27:58 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:27:58 user nova-compute[74247]:       <target dev="tap5f5253f2-6e"/>
Oct 16 18:27:58 user nova-compute[74247]:     </interface>
Oct 16 18:27:58 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:27:58 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/console.log" append="off"/>
Oct 16 18:27:58 user nova-compute[74247]:     </serial>
Oct 16 18:27:58 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:27:58 user nova-compute[74247]:     <video>
Oct 16 18:27:58 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:27:58 user nova-compute[74247]:     </video>
Oct 16 18:27:58 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:27:58 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:27:58 user nova-compute[74247]:     </rng>
Oct 16 18:27:58 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:27:58 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:27:58 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:27:58 user nova-compute[74247]:     </memballoon>
Oct 16 18:27:58 user nova-compute[74247]:   </devices>
Oct 16 18:27:58 user nova-compute[74247]: </domain>
Oct 16 18:27:58 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:27:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2056095538',display_name='tempest-ServerStableDeviceRescueTest-server-2056095538',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2056095538',id=14,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNw4l9zlgXNO30XsKe4Vj/du/OZkqc9heI+vCPA/3reIdMuWdthuZZGAOiDNP07hjzSUKEhxbgz+Vel73d0eDePuZLQtInh8vruuIgwyafEohXs7W0XS/37cHW8FQVpNBg==',key_name='tempest-keypair-1094775864',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='021c1d91069e4798af2caae2c29694ba',ramdisk_id='',reservation_id='r-oa4qirax',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1208025923',owner_user_name='tempest-ServerStableDeviceRescueTest-1208025923-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:27:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7601cab932f74be396a6d8a59568dc9f',uuid=7c17a25b-6818-48fa-b406-638dbf1845d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f5253f2-6e79-44f0-a4aa-167f273e7c6a", "address": "fa:16:3e:f9:f6:64", "network": {"id": "b8a52a8d-7eca-40b7-b94b-820a4ab8687b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1308054402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "021c1d91069e4798af2caae2c29694ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5253f2-6e", "ovs_interfaceid": "5f5253f2-6e79-44f0-a4aa-167f273e7c6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Converting VIF {"id": "5f5253f2-6e79-44f0-a4aa-167f273e7c6a", "address": "fa:16:3e:f9:f6:64", "network": {"id": "b8a52a8d-7eca-40b7-b94b-820a4ab8687b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1308054402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "021c1d91069e4798af2caae2c29694ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5253f2-6e", "ovs_interfaceid": "5f5253f2-6e79-44f0-a4aa-167f273e7c6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:f6:64,bridge_name='br-int',has_traffic_filtering=True,id=5f5253f2-6e79-44f0-a4aa-167f273e7c6a,network=Network(b8a52a8d-7eca-40b7-b94b-820a4ab8687b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5253f2-6e') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG os_vif [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:f6:64,bridge_name='br-int',has_traffic_filtering=True,id=5f5253f2-6e79-44f0-a4aa-167f273e7c6a,network=Network(b8a52a8d-7eca-40b7-b94b-820a4ab8687b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5253f2-6e') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f344c1a3-16eb-52fd-9a92-85e23aaf0d8d', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c868ea1c-0c1c-4470-b125-0a7a76d96c4d/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f5253f2-6e, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5f5253f2-6e, col_values=(('qos', UUID('2e0e6440-9e7e-4a35-adae-b7b212fa5881')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5f5253f2-6e, col_values=(('external_ids', {'iface-id': '5f5253f2-6e79-44f0-a4aa-167f273e7c6a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:f6:64', 'vm-uuid': '7c17a25b-6818-48fa-b406-638dbf1845d4'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:58 user nova-compute[74247]: INFO os_vif [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:f6:64,bridge_name='br-int',has_traffic_filtering=True,id=5f5253f2-6e79-44f0-a4aa-167f273e7c6a,network=Network(b8a52a8d-7eca-40b7-b94b-820a4ab8687b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5253f2-6e')
Oct 16 18:27:58 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] No VIF found with MAC fa:16:3e:f9:f6:64, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c868ea1c-0c1c-4470-b125-0a7a76d96c4d/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c868ea1c-0c1c-4470-b125-0a7a76d96c4d/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c868ea1c-0c1c-4470-b125-0a7a76d96c4d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1e2d26-57c5-4aa1-b66f-3ead29571b7e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1e2d26-57c5-4aa1-b66f-3ead29571b7e/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1e2d26-57c5-4aa1-b66f-3ead29571b7e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG nova.network.neutron [req-79bf9555-eee0-41be-a6f3-10957276e336 req-2d269ef2-645c-43b5-bafb-edc620d8dd12 service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Updated VIF entry in instance network info cache for port 5f5253f2-6e79-44f0-a4aa-167f273e7c6a. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG nova.network.neutron [req-79bf9555-eee0-41be-a6f3-10957276e336 req-2d269ef2-645c-43b5-bafb-edc620d8dd12 service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Updating instance_info_cache with network_info: [{"id": "5f5253f2-6e79-44f0-a4aa-167f273e7c6a", "address": "fa:16:3e:f9:f6:64", "network": {"id": "b8a52a8d-7eca-40b7-b94b-820a4ab8687b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1308054402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "021c1d91069e4798af2caae2c29694ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5253f2-6e", "ovs_interfaceid": "5f5253f2-6e79-44f0-a4aa-167f273e7c6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:27:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-79bf9555-eee0-41be-a6f3-10957276e336 req-2d269ef2-645c-43b5-bafb-edc620d8dd12 service nova] Releasing lock "refresh_cache-7c17a25b-6818-48fa-b406-638dbf1845d4" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:27:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1e2d26-57c5-4aa1-b66f-3ead29571b7e/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:27:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4daa6370-2cdf-4668-b66b-e10196377c9c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4daa6370-2cdf-4668-b66b-e10196377c9c/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:27:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4daa6370-2cdf-4668-b66b-e10196377c9c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:27:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:27:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4daa6370-2cdf-4668-b66b-e10196377c9c/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:00 user nova-compute[74247]: DEBUG nova.compute.manager [req-1762dc3b-44f8-41f3-92af-8baf9e78d804 req-dae2e814-c440-4b91-a26c-64d7adc5cd5b service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Received event network-vif-plugged-5f5253f2-6e79-44f0-a4aa-167f273e7c6a {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:28:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1762dc3b-44f8-41f3-92af-8baf9e78d804 req-dae2e814-c440-4b91-a26c-64d7adc5cd5b service nova] Acquiring lock "7c17a25b-6818-48fa-b406-638dbf1845d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:28:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1762dc3b-44f8-41f3-92af-8baf9e78d804 req-dae2e814-c440-4b91-a26c-64d7adc5cd5b service nova] Lock "7c17a25b-6818-48fa-b406-638dbf1845d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:28:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1762dc3b-44f8-41f3-92af-8baf9e78d804 req-dae2e814-c440-4b91-a26c-64d7adc5cd5b service nova] Lock "7c17a25b-6818-48fa-b406-638dbf1845d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:28:00 user nova-compute[74247]: DEBUG nova.compute.manager [req-1762dc3b-44f8-41f3-92af-8baf9e78d804 req-dae2e814-c440-4b91-a26c-64d7adc5cd5b service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] No waiting events found dispatching network-vif-plugged-5f5253f2-6e79-44f0-a4aa-167f273e7c6a {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:28:00 user nova-compute[74247]: WARNING nova.compute.manager [req-1762dc3b-44f8-41f3-92af-8baf9e78d804 req-dae2e814-c440-4b91-a26c-64d7adc5cd5b service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Received unexpected event network-vif-plugged-5f5253f2-6e79-44f0-a4aa-167f273e7c6a for instance with vm_state building and task_state spawning.
Oct 16 18:28:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed0e45-071e-4c56-902d-42eacc97c2c1/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed0e45-071e-4c56-902d-42eacc97c2c1/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed0e45-071e-4c56-902d-42eacc97c2c1/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:01 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed0e45-071e-4c56-902d-42eacc97c2c1/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:01 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:01 user nova-compute[74247]: DEBUG nova.objects.instance [None req-c7c3f67c-2049-44a5-9aa6-438b0e6cd5ce tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] Lazy-loading 'flavor' on Instance uuid c868ea1c-0c1c-4470-b125-0a7a76d96c4d {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:28:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c7c3f67c-2049-44a5-9aa6-438b0e6cd5ce tempest-VolumesAssistedSnapshotsTest-1459557216 tempest-VolumesAssistedSnapshotsTest-1459557216-project-admin] Lock "c868ea1c-0c1c-4470-b125-0a7a76d96c4d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 36.450s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:28:01 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:01 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:01 user nova-compute[74247]: DEBUG os_brick.utils [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:28:01 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:01 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:01 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0229255-22c8-4a1c-8c73-1e016592f8e7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:01 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:01 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:01 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f976ed-c5c8-49c7-8fb8-f4863f923f28]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:01 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:01 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:01 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfa474b-8871-48f7-9874-1a232d4ce910]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:01 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:01 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa1e418-c73f-4f46-a9f6-5212089a1f55]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:01 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:01 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:28:01 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 18:28:01 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:01 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:28:01 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 18:28:01 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89dc082-8b65-4743-a927-68a5545a6632]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:01 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 18:28:01 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 18:28:01 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 18:28:01 user nova-compute[74247]: DEBUG os_brick.utils [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:28:01 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Updating existing volume attachment record: b6a12a6b-b282-4a83-9a3d-e69140417d9b {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG nova.compute.manager [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aBIGibKX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ff1e2d26-57c5-4aa1-b66f-3ead29571b7e', 'attached_at': '', 'detached_at': '', 'volume_id': 'be80392d-488c-4d06-8ff0-9e11c788399c', 'serial': 'be80392d-488c-4d06-8ff0-9e11c788399c'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XVGFsqem', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '48aab4d3-c6ab-4b02-b87b-874e0f995ddf'}, 'status': 'reserved', 'instance': 'ff1e2d26-57c5-4aa1-b66f-3ead29571b7e', 'attached_at': '', 'detached_at': '', 'volume_id': '48aab4d3-c6ab-4b02-b87b-874e0f995ddf', 'serial'} {{(pid=74247) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG nova.compute.manager [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG nova.compute.manager [req-413157d0-99d0-48b2-9011-53793364bdb5 req-041cf7f6-ef9f-4416-bc83-4054bbacea11 service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Received event network-vif-plugged-5f5253f2-6e79-44f0-a4aa-167f273e7c6a {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-413157d0-99d0-48b2-9011-53793364bdb5 req-041cf7f6-ef9f-4416-bc83-4054bbacea11 service nova] Acquiring lock "7c17a25b-6818-48fa-b406-638dbf1845d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-413157d0-99d0-48b2-9011-53793364bdb5 req-041cf7f6-ef9f-4416-bc83-4054bbacea11 service nova] Lock "7c17a25b-6818-48fa-b406-638dbf1845d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-413157d0-99d0-48b2-9011-53793364bdb5 req-041cf7f6-ef9f-4416-bc83-4054bbacea11 service nova] Lock "7c17a25b-6818-48fa-b406-638dbf1845d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG nova.compute.manager [req-413157d0-99d0-48b2-9011-53793364bdb5 req-041cf7f6-ef9f-4416-bc83-4054bbacea11 service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] No waiting events found dispatching network-vif-plugged-5f5253f2-6e79-44f0-a4aa-167f273e7c6a {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:28:03 user nova-compute[74247]: WARNING nova.compute.manager [req-413157d0-99d0-48b2-9011-53793364bdb5 req-041cf7f6-ef9f-4416-bc83-4054bbacea11 service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Received unexpected event network-vif-plugged-5f5253f2-6e79-44f0-a4aa-167f273e7c6a for instance with vm_state building and task_state spawning.
Oct 16 18:28:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aBIGibKX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:28:03 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:28:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:28:03 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:28:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:28:03 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:28:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:03 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:28:03 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:28:03 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=7989MB free_disk=25.426361083984375GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:28:03 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Instance spawned successfully.
Oct 16 18:28:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[77483b32-b05e-441b-bbbb-2d8826344ebd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 18:28:03 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac1e97e-0a64-49ec-8c89-015e7b5c64f1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c] added
Oct 16 18:28:03 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb885c0-ac94-4e4c-95f9-7376fd97af20]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bb6947-6ea1-430d-880d-037fb59f8a98]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aBIGibKX {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aBIGibKX" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97f4d5b-71fa-45de-87b1-cb52028ca49e]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aBIGibKX'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:03 user nova-compute[74247]: INFO nova.compute.manager [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Took 7.40 seconds to spawn the instance on the hypervisor.
Oct 16 18:28:03 user nova-compute[74247]: DEBUG nova.compute.manager [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0b64dc-911f-4275-91cc-736fc3c1c7fe]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8079c7-7c44-4b32-b642-84a4512b7b1a]: (4, ('tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf (non-flash)
Oct 16 18:28:03 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] iscsi session list stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf (non-flash)
Oct 16 18:28:03 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance e37fbc27-3404-479a-be08-4d590391cf30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance a686ee86-272c-47be-8801-9c1500af272f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 4daa6370-2cdf-4668-b66b-e10196377c9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance c048698e-de64-4124-8d72-57fb819bb80e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance ff1e2d26-57c5-4aa1-b66f-3ead29571b7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance c868ea1c-0c1c-4470-b125-0a7a76d96c4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 16ed0e45-071e-4c56-902d-42eacc97c2c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance bbec99d1-82a3-4e4d-a3ae-17e00821bee1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 7c17a25b-6818-48fa-b406-638dbf1845d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c -p 172.16.0.220:3260 --login" returned: 0 in 0.106s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c975a250-499c-4b72-bb5a-40846caa22e2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c, portal: 172.16.0.220,3260]
Oct 16 18:28:03 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c, portal: 172.16.0.220,3260] successful.
Oct 16 18:28:03 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:03 user nova-compute[74247]: INFO nova.compute.manager [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Took 8.77 seconds to build instance.
Oct 16 18:28:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.041s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[12759b29-efcb-47de-9734-f2aa2d152245]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-cea6727f-8a18-4909-a0cb-e68bd7fdf7c4 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lock "7c17a25b-6818-48fa-b406-638dbf1845d4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.947s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3521ffb-6d32-4e66-a0c5-882290039e86]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)
Oct 16 18:28:03 user nova-compute[74247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf (non-flash)
Oct 16 18:28:03 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)
Oct 16 18:28:03 user nova-compute[74247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf (non-flash)
Oct 16 18:28:03 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.437s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] HCTL ('33', '-', '-', 0) found on session 10 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c6acdf-8531-410d-bddb-02a724202b48]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:03 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Searching for a device in session 10 and hctl ['33', '*', '*', 0] yield: None {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:28:04 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:28:04 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:28:04 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 18:28:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:28:04 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Searching for a device in session 10 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:28:04 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aBIGibKX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:28:04 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.483s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:28:04 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] <== connect_volume: return (1484ms) {'type': 'block', 'scsi_wwn': '23863336232613133', 'path': '/dev/sdb'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:28:04 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863336232613133', 'path': '/dev/sdb'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:28:04 user nova-compute[74247]: DEBUG nova.objects.instance [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Lazy-loading 'flavor' on Instance uuid ff1e2d26-57c5-4aa1-b66f-3ead29571b7e {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:28:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 18:28:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] COPY block job progress, current cursor: 123731968 final cursor: 1073741824 {{(pid=74247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 18:28:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] COPY block job progress, current cursor: 251658240 final cursor: 1073741824 {{(pid=74247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 18:28:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] COPY block job progress, current cursor: 357564416 final cursor: 1073741824 {{(pid=74247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 18:28:07 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] COPY block job progress, current cursor: 458227712 final cursor: 1073741824 {{(pid=74247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 18:28:07 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-2d9f3112-82a6-4d6d-a874-0fbf9436e7a9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Waiting for libvirt event about the detach of device tap246d0c9d-be with device alias net1 from instance c048698e-de64-4124-8d72-57fb819bb80e is timed out.
Oct 16 18:28:07 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-2d9f3112-82a6-4d6d-a874-0fbf9436e7a9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:bc:93:6e"/><model type="virtio"/><mtu size="1442"/><target dev="tap246d0c9d-be"/></interface> {{(pid=74247) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 16 18:28:07 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-2d9f3112-82a6-4d6d-a874-0fbf9436e7a9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:bc:93:6e"/><model type="virtio"/><mtu size="1442"/><target dev="tap246d0c9d-be"/></interface>not found in domain: <domain type='kvm' id='6'>
Oct 16 18:28:07 user nova-compute[74247]:   <name>instance-00000006</name>
Oct 16 18:28:07 user nova-compute[74247]:   <uuid>c048698e-de64-4124-8d72-57fb819bb80e</uuid>
Oct 16 18:28:07 user nova-compute[74247]:   <metadata>
Oct 16 18:28:07 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:28:07 user nova-compute[74247]:   <nova:package version="0.0.0"/>
Oct 16 18:28:07 user nova-compute[74247]:   <nova:name>tempest-device-tagging-server-1708908380</nova:name>
Oct 16 18:28:07 user nova-compute[74247]:   <nova:creationTime>2023-10-16 18:26:24</nova:creationTime>
Oct 16 18:28:07 user nova-compute[74247]:   <nova:flavor name="m1.tiny">
Oct 16 18:28:07 user nova-compute[74247]:     <nova:memory>512</nova:memory>
Oct 16 18:28:07 user nova-compute[74247]:     <nova:disk>1</nova:disk>
Oct 16 18:28:07 user nova-compute[74247]:     <nova:swap>0</nova:swap>
Oct 16 18:28:07 user nova-compute[74247]:     <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:28:07 user nova-compute[74247]:     <nova:vcpus>1</nova:vcpus>
Oct 16 18:28:07 user nova-compute[74247]:   </nova:flavor>
Oct 16 18:28:07 user nova-compute[74247]:   <nova:owner>
Oct 16 18:28:07 user nova-compute[74247]:     <nova:user uuid="b2000726f45b45feb6c3c5cedcbd40e2">tempest-TaggedAttachmentsTest-1522926684-project-member</nova:user>
Oct 16 18:28:07 user nova-compute[74247]:     <nova:project uuid="4ab4b3ccbd914164a2d5b38c7b89777b">tempest-TaggedAttachmentsTest-1522926684</nova:project>
Oct 16 18:28:07 user nova-compute[74247]:   </nova:owner>
Oct 16 18:28:07 user nova-compute[74247]:   <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:28:07 user nova-compute[74247]:   <nova:ports>
Oct 16 18:28:07 user nova-compute[74247]:     <nova:port uuid="59256fa7-ebbd-4cde-80c4-012340d7aea0">
Oct 16 18:28:07 user nova-compute[74247]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 16 18:28:07 user nova-compute[74247]:     </nova:port>
Oct 16 18:28:07 user nova-compute[74247]:     <nova:port uuid="246d0c9d-bed7-460d-bbfd-0cb2ebe16dda">
Oct 16 18:28:07 user nova-compute[74247]:       <nova:ip type="fixed" address="10.10.10.162" ipVersion="4"/>
Oct 16 18:28:07 user nova-compute[74247]:     </nova:port>
Oct 16 18:28:07 user nova-compute[74247]:   </nova:ports>
Oct 16 18:28:07 user nova-compute[74247]: </nova:instance>
Oct 16 18:28:07 user nova-compute[74247]:   </metadata>
Oct 16 18:28:07 user nova-compute[74247]:   <memory unit='KiB'>524288</memory>
Oct 16 18:28:07 user nova-compute[74247]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 16 18:28:07 user nova-compute[74247]:   <vcpu placement='static'>1</vcpu>
Oct 16 18:28:07 user nova-compute[74247]:   <resource>
Oct 16 18:28:07 user nova-compute[74247]:     <partition>/machine</partition>
Oct 16 18:28:07 user nova-compute[74247]:   </resource>
Oct 16 18:28:07 user nova-compute[74247]:   <sysinfo type='smbios'>
Oct 16 18:28:07 user nova-compute[74247]:     <system>
Oct 16 18:28:07 user nova-compute[74247]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 16 18:28:07 user nova-compute[74247]:       <entry name='product'>OpenStack Nova</entry>
Oct 16 18:28:07 user nova-compute[74247]:       <entry name='version'>0.0.0</entry>
Oct 16 18:28:07 user nova-compute[74247]:       <entry name='serial'>c048698e-de64-4124-8d72-57fb819bb80e</entry>
Oct 16 18:28:07 user nova-compute[74247]:       <entry name='uuid'>c048698e-de64-4124-8d72-57fb819bb80e</entry>
Oct 16 18:28:07 user nova-compute[74247]:       <entry name='family'>Virtual Machine</entry>
Oct 16 18:28:07 user nova-compute[74247]:     </system>
Oct 16 18:28:07 user nova-compute[74247]:   </sysinfo>
Oct 16 18:28:07 user nova-compute[74247]:   <os>
Oct 16 18:28:07 user nova-compute[74247]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 16 18:28:07 user nova-compute[74247]:     <boot dev='hd'/>
Oct 16 18:28:07 user nova-compute[74247]:     <smbios mode='sysinfo'/>
Oct 16 18:28:07 user nova-compute[74247]:   </os>
Oct 16 18:28:07 user nova-compute[74247]:   <features>
Oct 16 18:28:07 user nova-compute[74247]:     <acpi/>
Oct 16 18:28:07 user nova-compute[74247]:     <apic/>
Oct 16 18:28:07 user nova-compute[74247]:     <vmcoreinfo state='on'/>
Oct 16 18:28:07 user nova-compute[74247]:   </features>
Oct 16 18:28:07 user nova-compute[74247]:   <cpu mode='custom' match='exact' check='full'>
Oct 16 18:28:07 user nova-compute[74247]:     <model fallback='forbid'>Nehalem</model>
Oct 16 18:28:07 user nova-compute[74247]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 16 18:28:07 user nova-compute[74247]:     <feature policy='require' name='vme'/>
Oct 16 18:28:07 user nova-compute[74247]:     <feature policy='require' name='x2apic'/>
Oct 16 18:28:07 user nova-compute[74247]:     <feature policy='require' name='hypervisor'/>
Oct 16 18:28:07 user nova-compute[74247]:   </cpu>
Oct 16 18:28:07 user nova-compute[74247]:   <clock offset='utc'>
Oct 16 18:28:07 user nova-compute[74247]:     <timer name='pit' tickpolicy='delay'/>
Oct 16 18:28:07 user nova-compute[74247]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 16 18:28:07 user nova-compute[74247]:     <timer name='hpet' present='no'/>
Oct 16 18:28:07 user nova-compute[74247]:   </clock>
Oct 16 18:28:07 user nova-compute[74247]:   <on_poweroff>destroy</on_poweroff>
Oct 16 18:28:07 user nova-compute[74247]:   <on_reboot>restart</on_reboot>
Oct 16 18:28:07 user nova-compute[74247]:   <on_crash>destroy</on_crash>
Oct 16 18:28:07 user nova-compute[74247]:   <devices>
Oct 16 18:28:07 user nova-compute[74247]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 16 18:28:07 user nova-compute[74247]:     <disk type='file' device='disk'>
Oct 16 18:28:07 user nova-compute[74247]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 16 18:28:07 user nova-compute[74247]:       <source file='/opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/disk' index='2'/>
Oct 16 18:28:07 user nova-compute[74247]:       <backingStore type='file' index='3'>
Oct 16 18:28:07 user nova-compute[74247]:         <format type='raw'/>
Oct 16 18:28:07 user nova-compute[74247]:         <source file='/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231'/>
Oct 16 18:28:07 user nova-compute[74247]:         <backingStore/>
Oct 16 18:28:07 user nova-compute[74247]:       </backingStore>
Oct 16 18:28:07 user nova-compute[74247]:       <target dev='vda' bus='virtio'/>
Oct 16 18:28:07 user nova-compute[74247]:       <alias name='virtio-disk0'/>
Oct 16 18:28:07 user nova-compute[74247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 16 18:28:07 user nova-compute[74247]:     </disk>
Oct 16 18:28:07 user nova-compute[74247]:     <disk type='file' device='cdrom'>
Oct 16 18:28:07 user nova-compute[74247]:       <driver name='qemu' type='raw' cache='none'/>
Oct 16 18:28:07 user nova-compute[74247]:       <source file='/opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/disk.config' index='1'/>
Oct 16 18:28:07 user nova-compute[74247]:       <backingStore/>
Oct 16 18:28:07 user nova-compute[74247]:       <target dev='hda' bus='ide'/>
Oct 16 18:28:07 user nova-compute[74247]:       <readonly/>
Oct 16 18:28:07 user nova-compute[74247]:       <alias name='ide0-0-0'/>
Oct 16 18:28:07 user nova-compute[74247]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 16 18:28:07 user nova-compute[74247]:     </disk>
Oct 16 18:28:07 user nova-compute[74247]:     <controller type='usb' index='0' model='none'>
Oct 16 18:28:07 user nova-compute[74247]:       <alias name='usb'/>
Oct 16 18:28:07 user nova-compute[74247]:     </controller>
Oct 16 18:28:07 user nova-compute[74247]:     <controller type='pci' index='0' model='pci-root'>
Oct 16 18:28:07 user nova-compute[74247]:       <alias name='pci.0'/>
Oct 16 18:28:07 user nova-compute[74247]:     </controller>
Oct 16 18:28:07 user nova-compute[74247]:     <controller type='ide' index='0'>
Oct 16 18:28:07 user nova-compute[74247]:       <alias name='ide'/>
Oct 16 18:28:07 user nova-compute[74247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 16 18:28:07 user nova-compute[74247]:     </controller>
Oct 16 18:28:07 user nova-compute[74247]:     <interface type='ethernet'>
Oct 16 18:28:07 user nova-compute[74247]:       <mac address='fa:16:3e:ff:27:0b'/>
Oct 16 18:28:07 user nova-compute[74247]:       <target dev='tap59256fa7-eb'/>
Oct 16 18:28:07 user nova-compute[74247]:       <model type='virtio'/>
Oct 16 18:28:07 user nova-compute[74247]:       <mtu size='1442'/>
Oct 16 18:28:07 user nova-compute[74247]:       <alias name='net0'/>
Oct 16 18:28:07 user nova-compute[74247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 16 18:28:07 user nova-compute[74247]:     </interface>
Oct 16 18:28:07 user nova-compute[74247]:     <serial type='pty'>
Oct 16 18:28:07 user nova-compute[74247]:       <source path='/dev/pts/5'/>
Oct 16 18:28:07 user nova-compute[74247]:       <log file='/opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/console.log' append='off'/>
Oct 16 18:28:07 user nova-compute[74247]:       <target type='isa-serial' port='0'>
Oct 16 18:28:07 user nova-compute[74247]:         <model name='isa-serial'/>
Oct 16 18:28:07 user nova-compute[74247]:       </target>
Oct 16 18:28:07 user nova-compute[74247]:       <alias name='serial0'/>
Oct 16 18:28:07 user nova-compute[74247]:     </serial>
Oct 16 18:28:07 user nova-compute[74247]:     <console type='pty' tty='/dev/pts/5'>
Oct 16 18:28:07 user nova-compute[74247]:       <source path='/dev/pts/5'/>
Oct 16 18:28:07 user nova-compute[74247]:       <log file='/opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/console.log' append='off'/>
Oct 16 18:28:07 user nova-compute[74247]:       <target type='serial' port='0'/>
Oct 16 18:28:07 user nova-compute[74247]:       <alias name='serial0'/>
Oct 16 18:28:07 user nova-compute[74247]:     </console>
Oct 16 18:28:07 user nova-compute[74247]:     <input type='mouse' bus='ps2'>
Oct 16 18:28:07 user nova-compute[74247]:       <alias name='input0'/>
Oct 16 18:28:07 user nova-compute[74247]:     </input>
Oct 16 18:28:07 user nova-compute[74247]:     <input type='keyboard' bus='ps2'>
Oct 16 18:28:07 user nova-compute[74247]:       <alias name='input1'/>
Oct 16 18:28:07 user nova-compute[74247]:     </input>
Oct 16 18:28:07 user nova-compute[74247]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Oct 16 18:28:07 user nova-compute[74247]:       <listen type='address' address='0.0.0.0'/>
Oct 16 18:28:07 user nova-compute[74247]:     </graphics>
Oct 16 18:28:07 user nova-compute[74247]:     <audio id='1' type='none'/>
Oct 16 18:28:07 user nova-compute[74247]:     <video>
Oct 16 18:28:07 user nova-compute[74247]:       <model type='virtio' heads='1' primary='yes'/>
Oct 16 18:28:07 user nova-compute[74247]:       <alias name='video0'/>
Oct 16 18:28:07 user nova-compute[74247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 16 18:28:07 user nova-compute[74247]:     </video>
Oct 16 18:28:07 user nova-compute[74247]:     <memballoon model='virtio'>
Oct 16 18:28:07 user nova-compute[74247]:       <stats period='10'/>
Oct 16 18:28:07 user nova-compute[74247]:       <alias name='balloon0'/>
Oct 16 18:28:07 user nova-compute[74247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 16 18:28:07 user nova-compute[74247]:     </memballoon>
Oct 16 18:28:07 user nova-compute[74247]:     <rng model='virtio'>
Oct 16 18:28:07 user nova-compute[74247]:       <backend model='random'>/dev/urandom</backend>
Oct 16 18:28:07 user nova-compute[74247]:       <alias name='rng0'/>
Oct 16 18:28:07 user nova-compute[74247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 16 18:28:07 user nova-compute[74247]:     </rng>
Oct 16 18:28:07 user nova-compute[74247]:   </devices>
Oct 16 18:28:07 user nova-compute[74247]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 16 18:28:07 user nova-compute[74247]:     <label>libvirt-c048698e-de64-4124-8d72-57fb819bb80e</label>
Oct 16 18:28:07 user nova-compute[74247]:     <imagelabel>libvirt-c048698e-de64-4124-8d72-57fb819bb80e</imagelabel>
Oct 16 18:28:07 user nova-compute[74247]:   </seclabel>
Oct 16 18:28:07 user nova-compute[74247]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 16 18:28:07 user nova-compute[74247]:     <label>+64055:+108</label>
Oct 16 18:28:07 user nova-compute[74247]:     <imagelabel>+64055:+108</imagelabel>
Oct 16 18:28:07 user nova-compute[74247]:   </seclabel>
Oct 16 18:28:07 user nova-compute[74247]: </domain>
Oct 16 18:28:07 user nova-compute[74247]:  {{(pid=74247) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 16 18:28:07 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-2d9f3112-82a6-4d6d-a874-0fbf9436e7a9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Successfully detached device tap246d0c9d-be from instance c048698e-de64-4124-8d72-57fb819bb80e from the live domain config.
Oct 16 18:28:07 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-2d9f3112-82a6-4d6d-a874-0fbf9436e7a9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T18:24:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1708908380',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1708908380',id=6,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4t5/HxarVjAIcPE9zeByR72HYnWO4eclBUfo863abS/M64e1Oj/mYiR12Cs6HtPrtMLyPaTm6rvsRa3pNGaznOooPgv/HGuQCekMNKw81O1jY6NY8zkFrvxeZV5v6ZKw==',key_name='tempest-keypair-1905579868',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:24:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ab4b3ccbd914164a2d5b38c7b89777b',ramdisk_id='',reservation_id='r-jcqqfx36',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1522926684',owner_user_name='tempest-TaggedAttachmentsTest-1522926684-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:24:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2000726f45b45feb6c3c5cedcbd40e2',uuid=c048698e-de64-4124-8d72-57fb819bb80e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "246d0c9d-bed7-460d-bbfd-0cb2ebe16dda", "address": "fa:16:3e:bc:93:6e", "network": {"id": "d0a8c577-68e9-4fc9-bb48-78cf1feb05a5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1663196803", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4ab4b3ccbd914164a2d5b38c7b89777b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap246d0c9d-be", "ovs_interfaceid": "246d0c9d-bed7-460d-bbfd-0cb2ebe16dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:28:07 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-2d9f3112-82a6-4d6d-a874-0fbf9436e7a9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Converting VIF {"id": "246d0c9d-bed7-460d-bbfd-0cb2ebe16dda", "address": "fa:16:3e:bc:93:6e", "network": {"id": "d0a8c577-68e9-4fc9-bb48-78cf1feb05a5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1663196803", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4ab4b3ccbd914164a2d5b38c7b89777b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap246d0c9d-be", "ovs_interfaceid": "246d0c9d-bed7-460d-bbfd-0cb2ebe16dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:28:07 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-2d9f3112-82a6-4d6d-a874-0fbf9436e7a9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:93:6e,bridge_name='br-int',has_traffic_filtering=True,id=246d0c9d-bed7-460d-bbfd-0cb2ebe16dda,network=Network(d0a8c577-68e9-4fc9-bb48-78cf1feb05a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap246d0c9d-be') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:28:07 user nova-compute[74247]: DEBUG os_vif [None req-2d9f3112-82a6-4d6d-a874-0fbf9436e7a9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:93:6e,bridge_name='br-int',has_traffic_filtering=True,id=246d0c9d-bed7-460d-bbfd-0cb2ebe16dda,network=Network(d0a8c577-68e9-4fc9-bb48-78cf1feb05a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap246d0c9d-be') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:28:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap246d0c9d-be, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:28:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=61030170-22af-44db-a911-d256451a9f44) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:28:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:28:07 user nova-compute[74247]: INFO os_vif [None req-2d9f3112-82a6-4d6d-a874-0fbf9436e7a9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:93:6e,bridge_name='br-int',has_traffic_filtering=True,id=246d0c9d-bed7-460d-bbfd-0cb2ebe16dda,network=Network(d0a8c577-68e9-4fc9-bb48-78cf1feb05a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap246d0c9d-be')
Oct 16 18:28:07 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-2d9f3112-82a6-4d6d-a874-0fbf9436e7a9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:28:07 user nova-compute[74247]:   <nova:package version="0.0.0"/>
Oct 16 18:28:07 user nova-compute[74247]:   <nova:name>tempest-device-tagging-server-1708908380</nova:name>
Oct 16 18:28:07 user nova-compute[74247]:   <nova:creationTime>2023-10-16 18:28:07</nova:creationTime>
Oct 16 18:28:07 user nova-compute[74247]:   <nova:flavor name="m1.tiny">
Oct 16 18:28:07 user nova-compute[74247]:     <nova:memory>512</nova:memory>
Oct 16 18:28:07 user nova-compute[74247]:     <nova:disk>1</nova:disk>
Oct 16 18:28:07 user nova-compute[74247]:     <nova:swap>0</nova:swap>
Oct 16 18:28:07 user nova-compute[74247]:     <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:28:07 user nova-compute[74247]:     <nova:vcpus>1</nova:vcpus>
Oct 16 18:28:07 user nova-compute[74247]:   </nova:flavor>
Oct 16 18:28:07 user nova-compute[74247]:   <nova:owner>
Oct 16 18:28:07 user nova-compute[74247]:     <nova:user uuid="b2000726f45b45feb6c3c5cedcbd40e2">tempest-TaggedAttachmentsTest-1522926684-project-member</nova:user>
Oct 16 18:28:07 user nova-compute[74247]:     <nova:project uuid="4ab4b3ccbd914164a2d5b38c7b89777b">tempest-TaggedAttachmentsTest-1522926684</nova:project>
Oct 16 18:28:07 user nova-compute[74247]:   </nova:owner>
Oct 16 18:28:07 user nova-compute[74247]:   <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:28:07 user nova-compute[74247]:   <nova:ports>
Oct 16 18:28:07 user nova-compute[74247]:     <nova:port uuid="59256fa7-ebbd-4cde-80c4-012340d7aea0">
Oct 16 18:28:07 user nova-compute[74247]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 16 18:28:07 user nova-compute[74247]:     </nova:port>
Oct 16 18:28:07 user nova-compute[74247]:   </nova:ports>
Oct 16 18:28:07 user nova-compute[74247]: </nova:instance>
Oct 16 18:28:07 user nova-compute[74247]:  {{(pid=74247) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 16 18:28:07 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] COPY block job progress, current cursor: 555745280 final cursor: 1073741824 {{(pid=74247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 18:28:08 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] COPY block job progress, current cursor: 655360000 final cursor: 1073741824 {{(pid=74247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 18:28:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-2d9f3112-82a6-4d6d-a874-0fbf9436e7a9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Acquiring lock "refresh_cache-c048698e-de64-4124-8d72-57fb819bb80e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:28:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-2d9f3112-82a6-4d6d-a874-0fbf9436e7a9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Acquired lock "refresh_cache-c048698e-de64-4124-8d72-57fb819bb80e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:28:08 user nova-compute[74247]: DEBUG nova.network.neutron [None req-2d9f3112-82a6-4d6d-a874-0fbf9436e7a9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:28:08 user nova-compute[74247]: DEBUG nova.compute.manager [req-bfc95c30-a0ba-4441-9268-017790a72f1d req-dba44e2d-7924-40d7-951d-00df0aca2675 service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Received event network-vif-deleted-246d0c9d-bed7-460d-bbfd-0cb2ebe16dda {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:28:08 user nova-compute[74247]: INFO nova.compute.manager [req-bfc95c30-a0ba-4441-9268-017790a72f1d req-dba44e2d-7924-40d7-951d-00df0aca2675 service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Neutron deleted interface 246d0c9d-bed7-460d-bbfd-0cb2ebe16dda; detaching it from the instance and deleting it from the info cache
Oct 16 18:28:08 user nova-compute[74247]: DEBUG nova.network.neutron [req-bfc95c30-a0ba-4441-9268-017790a72f1d req-dba44e2d-7924-40d7-951d-00df0aca2675 service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Updating instance_info_cache with network_info: [{"id": "59256fa7-ebbd-4cde-80c4-012340d7aea0", "address": "fa:16:3e:ff:27:0b", "network": {"id": "f35ee734-1070-4c5a-84f5-c76501c1b6cb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1676802825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ab4b3ccbd914164a2d5b38c7b89777b", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59256fa7-eb", "ovs_interfaceid": "59256fa7-ebbd-4cde-80c4-012340d7aea0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:28:08 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] COPY block job progress, current cursor: 744488960 final cursor: 1073741824 {{(pid=74247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 18:28:08 user nova-compute[74247]: DEBUG nova.objects.instance [req-bfc95c30-a0ba-4441-9268-017790a72f1d req-dba44e2d-7924-40d7-951d-00df0aca2675 service nova] Lazy-loading 'system_metadata' on Instance uuid c048698e-de64-4124-8d72-57fb819bb80e {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:28:08 user nova-compute[74247]: DEBUG nova.objects.instance [req-bfc95c30-a0ba-4441-9268-017790a72f1d req-dba44e2d-7924-40d7-951d-00df0aca2675 service nova] Lazy-loading 'flavor' on Instance uuid c048698e-de64-4124-8d72-57fb819bb80e {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:28:08 user nova-compute[74247]: DEBUG nova.objects.base [req-bfc95c30-a0ba-4441-9268-017790a72f1d req-dba44e2d-7924-40d7-951d-00df0aca2675 service nova] Object Instance<c048698e-de64-4124-8d72-57fb819bb80e> lazy-loaded attributes: system_metadata,flavor {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:28:08 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [req-bfc95c30-a0ba-4441-9268-017790a72f1d req-dba44e2d-7924-40d7-951d-00df0aca2675 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T18:24:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1708908380',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1708908380',id=6,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4t5/HxarVjAIcPE9zeByR72HYnWO4eclBUfo863abS/M64e1Oj/mYiR12Cs6HtPrtMLyPaTm6rvsRa3pNGaznOooPgv/HGuQCekMNKw81O1jY6NY8zkFrvxeZV5v6ZKw==',key_name='tempest-keypair-1905579868',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:24:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ab4b3ccbd914164a2d5b38c7b89777b',ramdisk_id='',reservation_id='r-jcqqfx36',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1522926684',owner_user_name='tempest-TaggedAttachmentsTest-1522926684-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:24:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2000726f45b45feb6c3c5cedcbd40e2',uuid=c048698e-de64-4124-8d72-57fb819bb80e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "246d0c9d-bed7-460d-bbfd-0cb2ebe16dda", "address": "fa:16:3e:bc:93:6e", "network": {"id": "d0a8c577-68e9-4fc9-bb48-78cf1feb05a5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1663196803", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4ab4b3ccbd914164a2d5b38c7b89777b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap246d0c9d-be", "ovs_interfaceid": "246d0c9d-bed7-460d-bbfd-0cb2ebe16dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:28:08 user nova-compute[74247]: DEBUG nova.network.os_vif_util [req-bfc95c30-a0ba-4441-9268-017790a72f1d req-dba44e2d-7924-40d7-951d-00df0aca2675 service nova] Converting VIF {"id": "246d0c9d-bed7-460d-bbfd-0cb2ebe16dda", "address": "fa:16:3e:bc:93:6e", "network": {"id": "d0a8c577-68e9-4fc9-bb48-78cf1feb05a5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1663196803", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4ab4b3ccbd914164a2d5b38c7b89777b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap246d0c9d-be", "ovs_interfaceid": "246d0c9d-bed7-460d-bbfd-0cb2ebe16dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:28:08 user nova-compute[74247]: DEBUG nova.network.os_vif_util [req-bfc95c30-a0ba-4441-9268-017790a72f1d req-dba44e2d-7924-40d7-951d-00df0aca2675 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:93:6e,bridge_name='br-int',has_traffic_filtering=True,id=246d0c9d-bed7-460d-bbfd-0cb2ebe16dda,network=Network(d0a8c577-68e9-4fc9-bb48-78cf1feb05a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap246d0c9d-be') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:28:08 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [req-bfc95c30-a0ba-4441-9268-017790a72f1d req-dba44e2d-7924-40d7-951d-00df0aca2675 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:bc:93:6e"/><model type="virtio"/><mtu size="1442"/><target dev="tap246d0c9d-be"/></interface> {{(pid=74247) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 16 18:28:08 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [req-bfc95c30-a0ba-4441-9268-017790a72f1d req-dba44e2d-7924-40d7-951d-00df0aca2675 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:bc:93:6e"/><model type="virtio"/><mtu size="1442"/><target dev="tap246d0c9d-be"/></interface>not found in domain: <domain type='kvm' id='6'>
Oct 16 18:28:08 user nova-compute[74247]:   <name>instance-00000006</name>
Oct 16 18:28:08 user nova-compute[74247]:   <uuid>c048698e-de64-4124-8d72-57fb819bb80e</uuid>
Oct 16 18:28:08 user nova-compute[74247]:   <metadata>
Oct 16 18:28:08 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:28:08 user nova-compute[74247]:   <nova:package version="0.0.0"/>
Oct 16 18:28:08 user nova-compute[74247]:   <nova:name>tempest-device-tagging-server-1708908380</nova:name>
Oct 16 18:28:08 user nova-compute[74247]:   <nova:creationTime>2023-10-16 18:28:07</nova:creationTime>
Oct 16 18:28:08 user nova-compute[74247]:   <nova:flavor name="m1.tiny">
Oct 16 18:28:08 user nova-compute[74247]:     <nova:memory>512</nova:memory>
Oct 16 18:28:08 user nova-compute[74247]:     <nova:disk>1</nova:disk>
Oct 16 18:28:08 user nova-compute[74247]:     <nova:swap>0</nova:swap>
Oct 16 18:28:08 user nova-compute[74247]:     <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:28:08 user nova-compute[74247]:     <nova:vcpus>1</nova:vcpus>
Oct 16 18:28:08 user nova-compute[74247]:   </nova:flavor>
Oct 16 18:28:08 user nova-compute[74247]:   <nova:owner>
Oct 16 18:28:08 user nova-compute[74247]:     <nova:user uuid="b2000726f45b45feb6c3c5cedcbd40e2">tempest-TaggedAttachmentsTest-1522926684-project-member</nova:user>
Oct 16 18:28:08 user nova-compute[74247]:     <nova:project uuid="4ab4b3ccbd914164a2d5b38c7b89777b">tempest-TaggedAttachmentsTest-1522926684</nova:project>
Oct 16 18:28:08 user nova-compute[74247]:   </nova:owner>
Oct 16 18:28:08 user nova-compute[74247]:   <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:28:08 user nova-compute[74247]:   <nova:ports>
Oct 16 18:28:08 user nova-compute[74247]:     <nova:port uuid="59256fa7-ebbd-4cde-80c4-012340d7aea0">
Oct 16 18:28:08 user nova-compute[74247]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 16 18:28:08 user nova-compute[74247]:     </nova:port>
Oct 16 18:28:08 user nova-compute[74247]:   </nova:ports>
Oct 16 18:28:08 user nova-compute[74247]: </nova:instance>
Oct 16 18:28:08 user nova-compute[74247]:   </metadata>
Oct 16 18:28:08 user nova-compute[74247]:   <memory unit='KiB'>524288</memory>
Oct 16 18:28:08 user nova-compute[74247]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 16 18:28:08 user nova-compute[74247]:   <vcpu placement='static'>1</vcpu>
Oct 16 18:28:08 user nova-compute[74247]:   <resource>
Oct 16 18:28:08 user nova-compute[74247]:     <partition>/machine</partition>
Oct 16 18:28:08 user nova-compute[74247]:   </resource>
Oct 16 18:28:08 user nova-compute[74247]:   <sysinfo type='smbios'>
Oct 16 18:28:08 user nova-compute[74247]:     <system>
Oct 16 18:28:08 user nova-compute[74247]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 16 18:28:08 user nova-compute[74247]:       <entry name='product'>OpenStack Nova</entry>
Oct 16 18:28:08 user nova-compute[74247]:       <entry name='version'>0.0.0</entry>
Oct 16 18:28:08 user nova-compute[74247]:       <entry name='serial'>c048698e-de64-4124-8d72-57fb819bb80e</entry>
Oct 16 18:28:08 user nova-compute[74247]:       <entry name='uuid'>c048698e-de64-4124-8d72-57fb819bb80e</entry>
Oct 16 18:28:08 user nova-compute[74247]:       <entry name='family'>Virtual Machine</entry>
Oct 16 18:28:08 user nova-compute[74247]:     </system>
Oct 16 18:28:08 user nova-compute[74247]:   </sysinfo>
Oct 16 18:28:08 user nova-compute[74247]:   <os>
Oct 16 18:28:08 user nova-compute[74247]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 16 18:28:08 user nova-compute[74247]:     <boot dev='hd'/>
Oct 16 18:28:08 user nova-compute[74247]:     <smbios mode='sysinfo'/>
Oct 16 18:28:08 user nova-compute[74247]:   </os>
Oct 16 18:28:08 user nova-compute[74247]:   <features>
Oct 16 18:28:08 user nova-compute[74247]:     <acpi/>
Oct 16 18:28:08 user nova-compute[74247]:     <apic/>
Oct 16 18:28:08 user nova-compute[74247]:     <vmcoreinfo state='on'/>
Oct 16 18:28:08 user nova-compute[74247]:   </features>
Oct 16 18:28:08 user nova-compute[74247]:   <cpu mode='custom' match='exact' check='full'>
Oct 16 18:28:08 user nova-compute[74247]:     <model fallback='forbid'>Nehalem</model>
Oct 16 18:28:08 user nova-compute[74247]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 16 18:28:08 user nova-compute[74247]:     <feature policy='require' name='vme'/>
Oct 16 18:28:08 user nova-compute[74247]:     <feature policy='require' name='x2apic'/>
Oct 16 18:28:08 user nova-compute[74247]:     <feature policy='require' name='hypervisor'/>
Oct 16 18:28:08 user nova-compute[74247]:   </cpu>
Oct 16 18:28:08 user nova-compute[74247]:   <clock offset='utc'>
Oct 16 18:28:08 user nova-compute[74247]:     <timer name='pit' tickpolicy='delay'/>
Oct 16 18:28:08 user nova-compute[74247]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 16 18:28:08 user nova-compute[74247]:     <timer name='hpet' present='no'/>
Oct 16 18:28:08 user nova-compute[74247]:   </clock>
Oct 16 18:28:08 user nova-compute[74247]:   <on_poweroff>destroy</on_poweroff>
Oct 16 18:28:08 user nova-compute[74247]:   <on_reboot>restart</on_reboot>
Oct 16 18:28:08 user nova-compute[74247]:   <on_crash>destroy</on_crash>
Oct 16 18:28:08 user nova-compute[74247]:   <devices>
Oct 16 18:28:08 user nova-compute[74247]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 16 18:28:08 user nova-compute[74247]:     <disk type='file' device='disk'>
Oct 16 18:28:08 user nova-compute[74247]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 16 18:28:08 user nova-compute[74247]:       <source file='/opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/disk' index='2'/>
Oct 16 18:28:08 user nova-compute[74247]:       <backingStore type='file' index='3'>
Oct 16 18:28:08 user nova-compute[74247]:         <format type='raw'/>
Oct 16 18:28:08 user nova-compute[74247]:         <source file='/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231'/>
Oct 16 18:28:08 user nova-compute[74247]:         <backingStore/>
Oct 16 18:28:08 user nova-compute[74247]:       </backingStore>
Oct 16 18:28:08 user nova-compute[74247]:       <target dev='vda' bus='virtio'/>
Oct 16 18:28:08 user nova-compute[74247]:       <alias name='virtio-disk0'/>
Oct 16 18:28:08 user nova-compute[74247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 16 18:28:08 user nova-compute[74247]:     </disk>
Oct 16 18:28:08 user nova-compute[74247]:     <disk type='file' device='cdrom'>
Oct 16 18:28:08 user nova-compute[74247]:       <driver name='qemu' type='raw' cache='none'/>
Oct 16 18:28:08 user nova-compute[74247]:       <source file='/opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/disk.config' index='1'/>
Oct 16 18:28:08 user nova-compute[74247]:       <backingStore/>
Oct 16 18:28:08 user nova-compute[74247]:       <target dev='hda' bus='ide'/>
Oct 16 18:28:08 user nova-compute[74247]:       <readonly/>
Oct 16 18:28:08 user nova-compute[74247]:       <alias name='ide0-0-0'/>
Oct 16 18:28:08 user nova-compute[74247]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 16 18:28:08 user nova-compute[74247]:     </disk>
Oct 16 18:28:08 user nova-compute[74247]:     <controller type='usb' index='0' model='none'>
Oct 16 18:28:08 user nova-compute[74247]:       <alias name='usb'/>
Oct 16 18:28:08 user nova-compute[74247]:     </controller>
Oct 16 18:28:08 user nova-compute[74247]:     <controller type='pci' index='0' model='pci-root'>
Oct 16 18:28:08 user nova-compute[74247]:       <alias name='pci.0'/>
Oct 16 18:28:08 user nova-compute[74247]:     </controller>
Oct 16 18:28:08 user nova-compute[74247]:     <controller type='ide' index='0'>
Oct 16 18:28:08 user nova-compute[74247]:       <alias name='ide'/>
Oct 16 18:28:08 user nova-compute[74247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 16 18:28:08 user nova-compute[74247]:     </controller>
Oct 16 18:28:08 user nova-compute[74247]:     <interface type='ethernet'>
Oct 16 18:28:08 user nova-compute[74247]:       <mac address='fa:16:3e:ff:27:0b'/>
Oct 16 18:28:08 user nova-compute[74247]:       <target dev='tap59256fa7-eb'/>
Oct 16 18:28:08 user nova-compute[74247]:       <model type='virtio'/>
Oct 16 18:28:08 user nova-compute[74247]:       <mtu size='1442'/>
Oct 16 18:28:08 user nova-compute[74247]:       <alias name='net0'/>
Oct 16 18:28:08 user nova-compute[74247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 16 18:28:08 user nova-compute[74247]:     </interface>
Oct 16 18:28:08 user nova-compute[74247]:     <serial type='pty'>
Oct 16 18:28:08 user nova-compute[74247]:       <source path='/dev/pts/5'/>
Oct 16 18:28:08 user nova-compute[74247]:       <log file='/opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/console.log' append='off'/>
Oct 16 18:28:08 user nova-compute[74247]:       <target type='isa-serial' port='0'>
Oct 16 18:28:08 user nova-compute[74247]:         <model name='isa-serial'/>
Oct 16 18:28:08 user nova-compute[74247]:       </target>
Oct 16 18:28:08 user nova-compute[74247]:       <alias name='serial0'/>
Oct 16 18:28:08 user nova-compute[74247]:     </serial>
Oct 16 18:28:08 user nova-compute[74247]:     <console type='pty' tty='/dev/pts/5'>
Oct 16 18:28:08 user nova-compute[74247]:       <source path='/dev/pts/5'/>
Oct 16 18:28:08 user nova-compute[74247]:       <log file='/opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/console.log' append='off'/>
Oct 16 18:28:08 user nova-compute[74247]:       <target type='serial' port='0'/>
Oct 16 18:28:08 user nova-compute[74247]:       <alias name='serial0'/>
Oct 16 18:28:08 user nova-compute[74247]:     </console>
Oct 16 18:28:08 user nova-compute[74247]:     <input type='mouse' bus='ps2'>
Oct 16 18:28:08 user nova-compute[74247]:       <alias name='input0'/>
Oct 16 18:28:08 user nova-compute[74247]:     </input>
Oct 16 18:28:08 user nova-compute[74247]:     <input type='keyboard' bus='ps2'>
Oct 16 18:28:08 user nova-compute[74247]:       <alias name='input1'/>
Oct 16 18:28:08 user nova-compute[74247]:     </input>
Oct 16 18:28:08 user nova-compute[74247]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Oct 16 18:28:08 user nova-compute[74247]:       <listen type='address' address='0.0.0.0'/>
Oct 16 18:28:08 user nova-compute[74247]:     </graphics>
Oct 16 18:28:08 user nova-compute[74247]:     <audio id='1' type='none'/>
Oct 16 18:28:08 user nova-compute[74247]:     <video>
Oct 16 18:28:08 user nova-compute[74247]:       <model type='virtio' heads='1' primary='yes'/>
Oct 16 18:28:08 user nova-compute[74247]:       <alias name='video0'/>
Oct 16 18:28:08 user nova-compute[74247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 16 18:28:08 user nova-compute[74247]:     </video>
Oct 16 18:28:08 user nova-compute[74247]:     <memballoon model='virtio'>
Oct 16 18:28:08 user nova-compute[74247]:       <stats period='10'/>
Oct 16 18:28:08 user nova-compute[74247]:       <alias name='balloon0'/>
Oct 16 18:28:08 user nova-compute[74247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 16 18:28:08 user nova-compute[74247]:     </memballoon>
Oct 16 18:28:08 user nova-compute[74247]:     <rng model='virtio'>
Oct 16 18:28:08 user nova-compute[74247]:       <backend model='random'>/dev/urandom</backend>
Oct 16 18:28:08 user nova-compute[74247]:       <alias name='rng0'/>
Oct 16 18:28:08 user nova-compute[74247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 16 18:28:08 user nova-compute[74247]:     </rng>
Oct 16 18:28:08 user nova-compute[74247]:   </devices>
Oct 16 18:28:08 user nova-compute[74247]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 16 18:28:08 user nova-compute[74247]:     <label>libvirt-c048698e-de64-4124-8d72-57fb819bb80e</label>
Oct 16 18:28:08 user nova-compute[74247]:     <imagelabel>libvirt-c048698e-de64-4124-8d72-57fb819bb80e</imagelabel>
Oct 16 18:28:08 user nova-compute[74247]:   </seclabel>
Oct 16 18:28:08 user nova-compute[74247]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 16 18:28:08 user nova-compute[74247]:     <label>+64055:+108</label>
Oct 16 18:28:08 user nova-compute[74247]:     <imagelabel>+64055:+108</imagelabel>
Oct 16 18:28:08 user nova-compute[74247]:   </seclabel>
Oct 16 18:28:08 user nova-compute[74247]: </domain>
Oct 16 18:28:08 user nova-compute[74247]:  {{(pid=74247) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 16 18:28:08 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [req-bfc95c30-a0ba-4441-9268-017790a72f1d req-dba44e2d-7924-40d7-951d-00df0aca2675 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:bc:93:6e"/><model type="virtio"/><mtu size="1442"/><target dev="tap246d0c9d-be"/></interface> {{(pid=74247) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 16 18:28:08 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [req-bfc95c30-a0ba-4441-9268-017790a72f1d req-dba44e2d-7924-40d7-951d-00df0aca2675 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:bc:93:6e"/><model type="virtio"/><mtu size="1442"/><target dev="tap246d0c9d-be"/></interface>not found in domain: <domain type='kvm' id='6'>
Oct 16 18:28:08 user nova-compute[74247]:   <name>instance-00000006</name>
Oct 16 18:28:08 user nova-compute[74247]:   <uuid>c048698e-de64-4124-8d72-57fb819bb80e</uuid>
Oct 16 18:28:08 user nova-compute[74247]:   <metadata>
Oct 16 18:28:08 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:28:08 user nova-compute[74247]:   <nova:package version="0.0.0"/>
Oct 16 18:28:08 user nova-compute[74247]:   <nova:name>tempest-device-tagging-server-1708908380</nova:name>
Oct 16 18:28:08 user nova-compute[74247]:   <nova:creationTime>2023-10-16 18:28:07</nova:creationTime>
Oct 16 18:28:08 user nova-compute[74247]:   <nova:flavor name="m1.tiny">
Oct 16 18:28:08 user nova-compute[74247]:     <nova:memory>512</nova:memory>
Oct 16 18:28:08 user nova-compute[74247]:     <nova:disk>1</nova:disk>
Oct 16 18:28:08 user nova-compute[74247]:     <nova:swap>0</nova:swap>
Oct 16 18:28:08 user nova-compute[74247]:     <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:28:08 user nova-compute[74247]:     <nova:vcpus>1</nova:vcpus>
Oct 16 18:28:08 user nova-compute[74247]:   </nova:flavor>
Oct 16 18:28:08 user nova-compute[74247]:   <nova:owner>
Oct 16 18:28:08 user nova-compute[74247]:     <nova:user uuid="b2000726f45b45feb6c3c5cedcbd40e2">tempest-TaggedAttachmentsTest-1522926684-project-member</nova:user>
Oct 16 18:28:08 user nova-compute[74247]:     <nova:project uuid="4ab4b3ccbd914164a2d5b38c7b89777b">tempest-TaggedAttachmentsTest-1522926684</nova:project>
Oct 16 18:28:08 user nova-compute[74247]:   </nova:owner>
Oct 16 18:28:08 user nova-compute[74247]:   <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:28:08 user nova-compute[74247]:   <nova:ports>
Oct 16 18:28:08 user nova-compute[74247]:     <nova:port uuid="59256fa7-ebbd-4cde-80c4-012340d7aea0">
Oct 16 18:28:08 user nova-compute[74247]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 16 18:28:08 user nova-compute[74247]:     </nova:port>
Oct 16 18:28:08 user nova-compute[74247]:   </nova:ports>
Oct 16 18:28:08 user nova-compute[74247]: </nova:instance>
Oct 16 18:28:08 user nova-compute[74247]:   </metadata>
Oct 16 18:28:08 user nova-compute[74247]:   <memory unit='KiB'>524288</memory>
Oct 16 18:28:08 user nova-compute[74247]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 16 18:28:08 user nova-compute[74247]:   <vcpu placement='static'>1</vcpu>
Oct 16 18:28:08 user nova-compute[74247]:   <resource>
Oct 16 18:28:08 user nova-compute[74247]:     <partition>/machine</partition>
Oct 16 18:28:08 user nova-compute[74247]:   </resource>
Oct 16 18:28:08 user nova-compute[74247]:   <sysinfo type='smbios'>
Oct 16 18:28:08 user nova-compute[74247]:     <system>
Oct 16 18:28:08 user nova-compute[74247]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 16 18:28:08 user nova-compute[74247]:       <entry name='product'>OpenStack Nova</entry>
Oct 16 18:28:08 user nova-compute[74247]:       <entry name='version'>0.0.0</entry>
Oct 16 18:28:08 user nova-compute[74247]:       <entry name='serial'>c048698e-de64-4124-8d72-57fb819bb80e</entry>
Oct 16 18:28:08 user nova-compute[74247]:       <entry name='uuid'>c048698e-de64-4124-8d72-57fb819bb80e</entry>
Oct 16 18:28:08 user nova-compute[74247]:       <entry name='family'>Virtual Machine</entry>
Oct 16 18:28:08 user nova-compute[74247]:     </system>
Oct 16 18:28:08 user nova-compute[74247]:   </sysinfo>
Oct 16 18:28:08 user nova-compute[74247]:   <os>
Oct 16 18:28:08 user nova-compute[74247]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 16 18:28:08 user nova-compute[74247]:     <boot dev='hd'/>
Oct 16 18:28:08 user nova-compute[74247]:     <smbios mode='sysinfo'/>
Oct 16 18:28:08 user nova-compute[74247]:   </os>
Oct 16 18:28:08 user nova-compute[74247]:   <features>
Oct 16 18:28:08 user nova-compute[74247]:     <acpi/>
Oct 16 18:28:08 user nova-compute[74247]:     <apic/>
Oct 16 18:28:08 user nova-compute[74247]:     <vmcoreinfo state='on'/>
Oct 16 18:28:08 user nova-compute[74247]:   </features>
Oct 16 18:28:08 user nova-compute[74247]:   <cpu mode='custom' match='exact' check='full'>
Oct 16 18:28:08 user nova-compute[74247]:     <model fallback='forbid'>Nehalem</model>
Oct 16 18:28:08 user nova-compute[74247]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 16 18:28:08 user nova-compute[74247]:     <feature policy='require' name='vme'/>
Oct 16 18:28:08 user nova-compute[74247]:     <feature policy='require' name='x2apic'/>
Oct 16 18:28:08 user nova-compute[74247]:     <feature policy='require' name='hypervisor'/>
Oct 16 18:28:08 user nova-compute[74247]:   </cpu>
Oct 16 18:28:08 user nova-compute[74247]:   <clock offset='utc'>
Oct 16 18:28:08 user nova-compute[74247]:     <timer name='pit' tickpolicy='delay'/>
Oct 16 18:28:08 user nova-compute[74247]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 16 18:28:08 user nova-compute[74247]:     <timer name='hpet' present='no'/>
Oct 16 18:28:08 user nova-compute[74247]:   </clock>
Oct 16 18:28:08 user nova-compute[74247]:   <on_poweroff>destroy</on_poweroff>
Oct 16 18:28:08 user nova-compute[74247]:   <on_reboot>restart</on_reboot>
Oct 16 18:28:08 user nova-compute[74247]:   <on_crash>destroy</on_crash>
Oct 16 18:28:08 user nova-compute[74247]:   <devices>
Oct 16 18:28:08 user nova-compute[74247]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 16 18:28:08 user nova-compute[74247]:     <disk type='file' device='disk'>
Oct 16 18:28:08 user nova-compute[74247]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 16 18:28:08 user nova-compute[74247]:       <source file='/opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/disk' index='2'/>
Oct 16 18:28:08 user nova-compute[74247]:       <backingStore type='file' index='3'>
Oct 16 18:28:08 user nova-compute[74247]:         <format type='raw'/>
Oct 16 18:28:08 user nova-compute[74247]:         <source file='/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231'/>
Oct 16 18:28:08 user nova-compute[74247]:         <backingStore/>
Oct 16 18:28:08 user nova-compute[74247]:       </backingStore>
Oct 16 18:28:08 user nova-compute[74247]:       <target dev='vda' bus='virtio'/>
Oct 16 18:28:08 user nova-compute[74247]:       <alias name='virtio-disk0'/>
Oct 16 18:28:08 user nova-compute[74247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 16 18:28:08 user nova-compute[74247]:     </disk>
Oct 16 18:28:08 user nova-compute[74247]:     <disk type='file' device='cdrom'>
Oct 16 18:28:08 user nova-compute[74247]:       <driver name='qemu' type='raw' cache='none'/>
Oct 16 18:28:08 user nova-compute[74247]:       <source file='/opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/disk.config' index='1'/>
Oct 16 18:28:08 user nova-compute[74247]:       <backingStore/>
Oct 16 18:28:08 user nova-compute[74247]:       <target dev='hda' bus='ide'/>
Oct 16 18:28:08 user nova-compute[74247]:       <readonly/>
Oct 16 18:28:08 user nova-compute[74247]:       <alias name='ide0-0-0'/>
Oct 16 18:28:08 user nova-compute[74247]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 16 18:28:08 user nova-compute[74247]:     </disk>
Oct 16 18:28:08 user nova-compute[74247]:     <controller type='usb' index='0' model='none'>
Oct 16 18:28:08 user nova-compute[74247]:       <alias name='usb'/>
Oct 16 18:28:08 user nova-compute[74247]:     </controller>
Oct 16 18:28:08 user nova-compute[74247]:     <controller type='pci' index='0' model='pci-root'>
Oct 16 18:28:08 user nova-compute[74247]:       <alias name='pci.0'/>
Oct 16 18:28:08 user nova-compute[74247]:     </controller>
Oct 16 18:28:08 user nova-compute[74247]:     <controller type='ide' index='0'>
Oct 16 18:28:08 user nova-compute[74247]:       <alias name='ide'/>
Oct 16 18:28:08 user nova-compute[74247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 16 18:28:08 user nova-compute[74247]:     </controller>
Oct 16 18:28:08 user nova-compute[74247]:     <interface type='ethernet'>
Oct 16 18:28:08 user nova-compute[74247]:       <mac address='fa:16:3e:ff:27:0b'/>
Oct 16 18:28:08 user nova-compute[74247]:       <target dev='tap59256fa7-eb'/>
Oct 16 18:28:08 user nova-compute[74247]:       <model type='virtio'/>
Oct 16 18:28:08 user nova-compute[74247]:       <mtu size='1442'/>
Oct 16 18:28:08 user nova-compute[74247]:       <alias name='net0'/>
Oct 16 18:28:08 user nova-compute[74247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 16 18:28:08 user nova-compute[74247]:     </interface>
Oct 16 18:28:08 user nova-compute[74247]:     <serial type='pty'>
Oct 16 18:28:08 user nova-compute[74247]:       <source path='/dev/pts/5'/>
Oct 16 18:28:08 user nova-compute[74247]:       <log file='/opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/console.log' append='off'/>
Oct 16 18:28:08 user nova-compute[74247]:       <target type='isa-serial' port='0'>
Oct 16 18:28:08 user nova-compute[74247]:         <model name='isa-serial'/>
Oct 16 18:28:08 user nova-compute[74247]:       </target>
Oct 16 18:28:08 user nova-compute[74247]:       <alias name='serial0'/>
Oct 16 18:28:08 user nova-compute[74247]:     </serial>
Oct 16 18:28:08 user nova-compute[74247]:     <console type='pty' tty='/dev/pts/5'>
Oct 16 18:28:08 user nova-compute[74247]:       <source path='/dev/pts/5'/>
Oct 16 18:28:08 user nova-compute[74247]:       <log file='/opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e/console.log' append='off'/>
Oct 16 18:28:08 user nova-compute[74247]:       <target type='serial' port='0'/>
Oct 16 18:28:08 user nova-compute[74247]:       <alias name='serial0'/>
Oct 16 18:28:08 user nova-compute[74247]:     </console>
Oct 16 18:28:08 user nova-compute[74247]:     <input type='mouse' bus='ps2'>
Oct 16 18:28:08 user nova-compute[74247]:       <alias name='input0'/>
Oct 16 18:28:08 user nova-compute[74247]:     </input>
Oct 16 18:28:08 user nova-compute[74247]:     <input type='keyboard' bus='ps2'>
Oct 16 18:28:08 user nova-compute[74247]:       <alias name='input1'/>
Oct 16 18:28:08 user nova-compute[74247]:     </input>
Oct 16 18:28:08 user nova-compute[74247]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Oct 16 18:28:08 user nova-compute[74247]:       <listen type='address' address='0.0.0.0'/>
Oct 16 18:28:08 user nova-compute[74247]:     </graphics>
Oct 16 18:28:08 user nova-compute[74247]:     <audio id='1' type='none'/>
Oct 16 18:28:08 user nova-compute[74247]:     <video>
Oct 16 18:28:08 user nova-compute[74247]:       <model type='virtio' heads='1' primary='yes'/>
Oct 16 18:28:08 user nova-compute[74247]:       <alias name='video0'/>
Oct 16 18:28:08 user nova-compute[74247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 16 18:28:08 user nova-compute[74247]:     </video>
Oct 16 18:28:08 user nova-compute[74247]:     <memballoon model='virtio'>
Oct 16 18:28:08 user nova-compute[74247]:       <stats period='10'/>
Oct 16 18:28:08 user nova-compute[74247]:       <alias name='balloon0'/>
Oct 16 18:28:08 user nova-compute[74247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 16 18:28:08 user nova-compute[74247]:     </memballoon>
Oct 16 18:28:08 user nova-compute[74247]:     <rng model='virtio'>
Oct 16 18:28:08 user nova-compute[74247]:       <backend model='random'>/dev/urandom</backend>
Oct 16 18:28:08 user nova-compute[74247]:       <alias name='rng0'/>
Oct 16 18:28:08 user nova-compute[74247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 16 18:28:08 user nova-compute[74247]:     </rng>
Oct 16 18:28:08 user nova-compute[74247]:   </devices>
Oct 16 18:28:08 user nova-compute[74247]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 16 18:28:08 user nova-compute[74247]:     <label>libvirt-c048698e-de64-4124-8d72-57fb819bb80e</label>
Oct 16 18:28:08 user nova-compute[74247]:     <imagelabel>libvirt-c048698e-de64-4124-8d72-57fb819bb80e</imagelabel>
Oct 16 18:28:08 user nova-compute[74247]:   </seclabel>
Oct 16 18:28:08 user nova-compute[74247]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 16 18:28:08 user nova-compute[74247]:     <label>+64055:+108</label>
Oct 16 18:28:08 user nova-compute[74247]:     <imagelabel>+64055:+108</imagelabel>
Oct 16 18:28:08 user nova-compute[74247]:   </seclabel>
Oct 16 18:28:08 user nova-compute[74247]: </domain>
Oct 16 18:28:08 user nova-compute[74247]:  {{(pid=74247) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 16 18:28:08 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [req-bfc95c30-a0ba-4441-9268-017790a72f1d req-dba44e2d-7924-40d7-951d-00df0aca2675 service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Detaching interface fa:16:3e:bc:93:6e failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap246d0c9d-be' not found.
Oct 16 18:28:08 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [req-bfc95c30-a0ba-4441-9268-017790a72f1d req-dba44e2d-7924-40d7-951d-00df0aca2675 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T18:24:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1708908380',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1708908380',id=6,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4t5/HxarVjAIcPE9zeByR72HYnWO4eclBUfo863abS/M64e1Oj/mYiR12Cs6HtPrtMLyPaTm6rvsRa3pNGaznOooPgv/HGuQCekMNKw81O1jY6NY8zkFrvxeZV5v6ZKw==',key_name='tempest-keypair-1905579868',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:24:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ab4b3ccbd914164a2d5b38c7b89777b',ramdisk_id='',reservation_id='r-jcqqfx36',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1522926684',owner_user_name='tempest-TaggedAttachmentsTest-1522926684-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:24:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2000726f45b45feb6c3c5cedcbd40e2',uuid=c048698e-de64-4124-8d72-57fb819bb80e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "246d0c9d-bed7-460d-bbfd-0cb2ebe16dda", "address": "fa:16:3e:bc:93:6e", "network": {"id": "d0a8c577-68e9-4fc9-bb48-78cf1feb05a5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1663196803", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4ab4b3ccbd914164a2d5b38c7b89777b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap246d0c9d-be", "ovs_interfaceid": "246d0c9d-bed7-460d-bbfd-0cb2ebe16dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:28:08 user nova-compute[74247]: DEBUG nova.network.os_vif_util [req-bfc95c30-a0ba-4441-9268-017790a72f1d req-dba44e2d-7924-40d7-951d-00df0aca2675 service nova] Converting VIF {"id": "246d0c9d-bed7-460d-bbfd-0cb2ebe16dda", "address": "fa:16:3e:bc:93:6e", "network": {"id": "d0a8c577-68e9-4fc9-bb48-78cf1feb05a5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1663196803", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4ab4b3ccbd914164a2d5b38c7b89777b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap246d0c9d-be", "ovs_interfaceid": "246d0c9d-bed7-460d-bbfd-0cb2ebe16dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:28:08 user nova-compute[74247]: DEBUG nova.network.os_vif_util [req-bfc95c30-a0ba-4441-9268-017790a72f1d req-dba44e2d-7924-40d7-951d-00df0aca2675 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:93:6e,bridge_name='br-int',has_traffic_filtering=True,id=246d0c9d-bed7-460d-bbfd-0cb2ebe16dda,network=Network(d0a8c577-68e9-4fc9-bb48-78cf1feb05a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap246d0c9d-be') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:28:08 user nova-compute[74247]: DEBUG os_vif [req-bfc95c30-a0ba-4441-9268-017790a72f1d req-dba44e2d-7924-40d7-951d-00df0aca2675 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:93:6e,bridge_name='br-int',has_traffic_filtering=True,id=246d0c9d-bed7-460d-bbfd-0cb2ebe16dda,network=Network(d0a8c577-68e9-4fc9-bb48-78cf1feb05a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap246d0c9d-be') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:28:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap246d0c9d-be, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:28:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:28:09 user nova-compute[74247]: INFO os_vif [req-bfc95c30-a0ba-4441-9268-017790a72f1d req-dba44e2d-7924-40d7-951d-00df0aca2675 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:93:6e,bridge_name='br-int',has_traffic_filtering=True,id=246d0c9d-bed7-460d-bbfd-0cb2ebe16dda,network=Network(d0a8c577-68e9-4fc9-bb48-78cf1feb05a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap246d0c9d-be')
Oct 16 18:28:09 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [req-bfc95c30-a0ba-4441-9268-017790a72f1d req-dba44e2d-7924-40d7-951d-00df0aca2675 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:28:09 user nova-compute[74247]:   <nova:package version="0.0.0"/>
Oct 16 18:28:09 user nova-compute[74247]:   <nova:name>tempest-device-tagging-server-1708908380</nova:name>
Oct 16 18:28:09 user nova-compute[74247]:   <nova:creationTime>2023-10-16 18:28:08</nova:creationTime>
Oct 16 18:28:09 user nova-compute[74247]:   <nova:flavor name="m1.tiny">
Oct 16 18:28:09 user nova-compute[74247]:     <nova:memory>512</nova:memory>
Oct 16 18:28:09 user nova-compute[74247]:     <nova:disk>1</nova:disk>
Oct 16 18:28:09 user nova-compute[74247]:     <nova:swap>0</nova:swap>
Oct 16 18:28:09 user nova-compute[74247]:     <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:28:09 user nova-compute[74247]:     <nova:vcpus>1</nova:vcpus>
Oct 16 18:28:09 user nova-compute[74247]:   </nova:flavor>
Oct 16 18:28:09 user nova-compute[74247]:   <nova:owner>
Oct 16 18:28:09 user nova-compute[74247]:     <nova:user uuid="b2000726f45b45feb6c3c5cedcbd40e2">tempest-TaggedAttachmentsTest-1522926684-project-member</nova:user>
Oct 16 18:28:09 user nova-compute[74247]:     <nova:project uuid="4ab4b3ccbd914164a2d5b38c7b89777b">tempest-TaggedAttachmentsTest-1522926684</nova:project>
Oct 16 18:28:09 user nova-compute[74247]:   </nova:owner>
Oct 16 18:28:09 user nova-compute[74247]:   <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:28:09 user nova-compute[74247]:   <nova:ports>
Oct 16 18:28:09 user nova-compute[74247]:     <nova:port uuid="59256fa7-ebbd-4cde-80c4-012340d7aea0">
Oct 16 18:28:09 user nova-compute[74247]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 16 18:28:09 user nova-compute[74247]:     </nova:port>
Oct 16 18:28:09 user nova-compute[74247]:   </nova:ports>
Oct 16 18:28:09 user nova-compute[74247]: </nova:instance>
Oct 16 18:28:09 user nova-compute[74247]:  {{(pid=74247) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 16 18:28:09 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] COPY block job progress, current cursor: 822083584 final cursor: 1073741824 {{(pid=74247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 18:28:09 user nova-compute[74247]: INFO nova.network.neutron [None req-2d9f3112-82a6-4d6d-a874-0fbf9436e7a9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Port 246d0c9d-bed7-460d-bbfd-0cb2ebe16dda from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Oct 16 18:28:09 user nova-compute[74247]: DEBUG nova.network.neutron [None req-2d9f3112-82a6-4d6d-a874-0fbf9436e7a9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Updating instance_info_cache with network_info: [{"id": "59256fa7-ebbd-4cde-80c4-012340d7aea0", "address": "fa:16:3e:ff:27:0b", "network": {"id": "f35ee734-1070-4c5a-84f5-c76501c1b6cb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1676802825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ab4b3ccbd914164a2d5b38c7b89777b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59256fa7-eb", "ovs_interfaceid": "59256fa7-ebbd-4cde-80c4-012340d7aea0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:28:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-2d9f3112-82a6-4d6d-a874-0fbf9436e7a9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Releasing lock "refresh_cache-c048698e-de64-4124-8d72-57fb819bb80e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:28:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-2d9f3112-82a6-4d6d-a874-0fbf9436e7a9 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Lock "interface-c048698e-de64-4124-8d72-57fb819bb80e-246d0c9d-bed7-460d-bbfd-0cb2ebe16dda" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 22.597s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:28:09 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] COPY block job progress, current cursor: 930086912 final cursor: 1073741824 {{(pid=74247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 18:28:10 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] COPY block job progress, current cursor: 1060110336 final cursor: 1073741824 {{(pid=74247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 18:28:10 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:10 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XVGFsqem', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '48aab4d3-c6ab-4b02-b87b-874e0f995ddf'}, None), 'kwargs': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:28:11 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:28:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5ffa1d-f48d-46f8-b9df-99e6325e74e2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 18:28:11 user nova-compute[74247]: No targets found.
Oct 16 18:28:11 user nova-compute[74247]: iSNS:
Oct 16 18:28:11 user nova-compute[74247]: No targets found.
Oct 16 18:28:11 user nova-compute[74247]: STATIC:
Oct 16 18:28:11 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c
Oct 16 18:28:11 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:28:11 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:28:11 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf
Oct 16 18:28:11 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:28:11 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:28:11 user nova-compute[74247]: FIRMWARE:
Oct 16 18:28:11 user nova-compute[74247]: No targets found.
Oct 16 18:28:11 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 18:28:11 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 18:28:11 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb1dbe1-4c22-4e15-a357-0a7083a4228a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe23504-c2e6-4829-8f92-d341cf2415c7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)
Oct 16 18:28:11 user nova-compute[74247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf (non-flash)
Oct 16 18:28:11 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)
Oct 16 18:28:11 user nova-compute[74247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf (non-flash)
Oct 16 18:28:11 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe0685dcd30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf'): ({'sdc'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Removing single pathed devices sdc {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f24b737-2bf6-48e3-8b9e-17d1c67c3ab2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e11357f-ca9b-4118-a2d2-37f777679e90]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Flushing IO for device /dev/sdc {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1684620f-b29e-4782-97b1-046f3f249fb8]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0453a976-9bda-4719-a206-39f278fc05be]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] SCSI volumes sdc have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.038s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[434ff690-15d5-4370-a7ac-b0290893c43a]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf -p 172.16.0.220:3260 --logout" returned: 0 in 0.092s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece42197-22e9-4fe2-902a-c7d621117e8e]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf, portal: 172.16.0.220,3260]
Oct 16 18:28:11 user nova-compute[74247]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf, portal: 172.16.0.220,3260] successful.
Oct 16 18:28:11 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48aab4d3-c6ab-4b02-b87b-874e0f995ddf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[420608ae-138d-48dd-8694-b5ec78f8cbf9]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] <== disconnect_volume: return (393ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG nova.compute.manager [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aBIGibKX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'ff1e2d26-57c5-4aa1-b66f-3ead29571b7e', 'attached_at': '', 'detached_at': '', 'volume_id': 'be80392d-488c-4d06-8ff0-9e11c788399c', 'serial'} {{(pid=74247) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 16 18:28:11 user nova-compute[74247]: DEBUG nova.compute.manager [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] swap_volume: removing Cinder connection for volume 48aab4d3-c6ab-4b02-b87b-874e0f995ddf {{(pid=74247) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 16 18:28:12 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:12 user nova-compute[74247]: DEBUG nova.compute.manager [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] swap_volume: Updating volume 48aab4d3-c6ab-4b02-b87b-874e0f995ddf BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "aBIGibKX", "auth_password": "m3UPgbdSvMsZ0D", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "be80392d-488c-4d06-8ff0-9e11c788399c"}, "status": "reserved", "instance": "ff1e2d26-57c5-4aa1-b66f-3ead29571b7e", "attached_at": "", "detached_at": "", "volume_id": "be80392d-488c-4d06-8ff0-9e11c788399c", "serial": "be80392d-488c-4d06-8ff0-9e11c788399c"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'be80392d-488c-4d06-8ff0-9e11c788399c', 'no_device': None, 'attachment_id': 'cd753cdd-7774-4aca-bcfc-5eeb9215b0d7'} {{(pid=74247) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 16 18:28:12 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-61e4ce54-90db-44bb-928f-30c096648244 tempest-TestVolumeSwap-243939885 tempest-TestVolumeSwap-243939885-project-admin] Lock "ff1e2d26-57c5-4aa1-b66f-3ead29571b7e" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 33.829s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:28:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5a353d50-34bb-4161-88d1-2921265a789b tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Acquiring lock "ff1e2d26-57c5-4aa1-b66f-3ead29571b7e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:28:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5a353d50-34bb-4161-88d1-2921265a789b tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Lock "ff1e2d26-57c5-4aa1-b66f-3ead29571b7e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:28:13 user nova-compute[74247]: INFO nova.compute.manager [None req-5a353d50-34bb-4161-88d1-2921265a789b tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Detaching volume be80392d-488c-4d06-8ff0-9e11c788399c
Oct 16 18:28:13 user nova-compute[74247]: INFO nova.virt.block_device [None req-5a353d50-34bb-4161-88d1-2921265a789b tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Attempting to driver detach volume be80392d-488c-4d06-8ff0-9e11c788399c from mountpoint /dev/vdb
Oct 16 18:28:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-5a353d50-34bb-4161-88d1-2921265a789b tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Attempting to detach device vdb from instance ff1e2d26-57c5-4aa1-b66f-3ead29571b7e from the persistent domain config. {{(pid=74247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 18:28:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-5a353d50-34bb-4161-88d1-2921265a789b tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 18:28:13 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:28:13 user nova-compute[74247]:   <source dev="/dev/sdb"/>
Oct 16 18:28:13 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:28:13 user nova-compute[74247]:   <serial>be80392d-488c-4d06-8ff0-9e11c788399c</serial>
Oct 16 18:28:13 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 18:28:13 user nova-compute[74247]: </disk>
Oct 16 18:28:13 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:28:13 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-5a353d50-34bb-4161-88d1-2921265a789b tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Successfully detached device vdb from instance ff1e2d26-57c5-4aa1-b66f-3ead29571b7e from the persistent domain config.
Oct 16 18:28:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-5a353d50-34bb-4161-88d1-2921265a789b tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ff1e2d26-57c5-4aa1-b66f-3ead29571b7e from the live domain config. {{(pid=74247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 18:28:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-5a353d50-34bb-4161-88d1-2921265a789b tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 18:28:13 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:28:13 user nova-compute[74247]:   <source dev="/dev/sdb"/>
Oct 16 18:28:13 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:28:13 user nova-compute[74247]:   <serial>be80392d-488c-4d06-8ff0-9e11c788399c</serial>
Oct 16 18:28:13 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 18:28:13 user nova-compute[74247]: </disk>
Oct 16 18:28:13 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:28:14 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-5a353d50-34bb-4161-88d1-2921265a789b tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ff1e2d26-57c5-4aa1-b66f-3ead29571b7e {{(pid=74247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 18:28:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MHBuxbDs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:28:18 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:28:18 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:28:18 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:28:18 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:28:18 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:28:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6382b27c-7ebd-4fca-bde4-d607759f03ed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 18:28:18 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[430dd134-e493-482f-afd3-dad9113328be]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6] added
Oct 16 18:28:18 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[33fb1ef2-ba78-481b-bf99-1374c099db1f]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56c3067-6932-4310-b658-da41fbadfcbf]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MHBuxbDs {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MHBuxbDs" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d95a67-2a84-4a0a-9067-ab8ec13d2f19]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MHBuxbDs'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e039c009-c3aa-4a4b-80d5-51dcc72c5907]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e16fd5c-5312-48b9-bb50-01077449c4de]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)
Oct 16 18:28:18 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)
Oct 16 18:28:18 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[442b5fb7-48c4-41b3-b1fc-05e6b8232651]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6, portal: 172.16.0.220,3260]
Oct 16 18:28:18 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6, portal: 172.16.0.220,3260] successful.
Oct 16 18:28:18 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[92838e12-095c-4719-b007-1407c27bb6d9]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9252b289-7668-4a14-a9e3-3f21472a27a8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)
Oct 16 18:28:18 user nova-compute[74247]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:28:18 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)
Oct 16 18:28:18 user nova-compute[74247]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:28:18 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.360s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] HCTL ('34', '-', '-', 0) found on session 11 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca09c3b9-ac3a-4129-8425-ddefdc0e25ee]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Searching for a device in session 11 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:28:18 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MHBuxbDs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:28:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.408s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:28:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] <== connect_volume: return (1410ms) {'type': 'block', 'scsi_wwn': '23533613635316535', 'path': '/dev/sdc'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:28:19 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533613635316535', 'path': '/dev/sdc'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:28:19 user nova-compute[74247]: DEBUG nova.objects.instance [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lazy-loading 'flavor' on Instance uuid a686ee86-272c-47be-8801-9c1500af272f {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:28:19 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 18:28:19 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:28:19 user nova-compute[74247]:   <source dev="/dev/sdc"/>
Oct 16 18:28:19 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:28:19 user nova-compute[74247]:   <serial>8223babc-be85-42b1-899b-b21e077ad7c6</serial>
Oct 16 18:28:19 user nova-compute[74247]: </disk>
Oct 16 18:28:19 user nova-compute[74247]:  {{(pid=74247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 18:28:20 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:28:20 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:28:20 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] No VIF found with MAC fa:16:3e:9d:bb:be, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:28:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-83a88851-93c2-4b37-92fb-e640bfbe84db tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lock "a686ee86-272c-47be-8801-9c1500af272f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.849s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:28:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:23 user nova-compute[74247]: DEBUG nova.compute.manager [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Stashing vm_state: active {{(pid=74247) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 16 18:28:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:28:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:28:23 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:28:23 user nova-compute[74247]: INFO nova.compute.claims [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Claim successful on node user
Oct 16 18:28:23 user nova-compute[74247]: INFO nova.compute.resource_tracker [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Updating resource usage from migration 5f5d97b0-24f7-49fa-a306-467fe63e51f3
Oct 16 18:28:23 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:28:23 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:28:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.584s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:28:23 user nova-compute[74247]: INFO nova.compute.manager [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Migrating
Oct 16 18:28:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:28:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:28:23 user nova-compute[74247]: INFO nova.compute.rpcapi [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Oct 16 18:28:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:28:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Acquiring lock "refresh_cache-a686ee86-272c-47be-8801-9c1500af272f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:28:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Acquired lock "refresh_cache-a686ee86-272c-47be-8801-9c1500af272f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:28:23 user nova-compute[74247]: DEBUG nova.network.neutron [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:28:24 user nova-compute[74247]: DEBUG nova.network.neutron [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Updating instance_info_cache with network_info: [{"id": "8cb168df-92d2-4ecc-946a-7d9075f75561", "address": "fa:16:3e:9d:bb:be", "network": {"id": "f12e9b98-2724-4b9c-a299-7286c163458c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1410604293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973c8310858e4e1dafbc2fa926995940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb168df-92", "ovs_interfaceid": "8cb168df-92d2-4ecc-946a-7d9075f75561", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:28:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Releasing lock "refresh_cache-a686ee86-272c-47be-8801-9c1500af272f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:28:25 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Creating image(s)
Oct 16 18:28:25 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Did not create local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Ensure instance console log exists: /opt/stack/data/nova/instances/73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Start _get_guest_xml network_info=[{"id": "2f140983-b9a6-4fdd-a301-a9b42927c561", "address": "fa:16:3e:a8:1a:a3", "network": {"id": "64ae2feb-5041-4479-a5a1-02e5ff636224", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-402083057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "670a27f9af4f4b32a86386d343a0694b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f140983-b9", "ovs_interfaceid": "2f140983-b9a6-4fdd-a301-a9b42927c561", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fsdpBahK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b', 'attached_at': '', 'detached_at': '', 'volume_id': '3ab08fda-c4e7-456c-8003-24c8bfb6c688', 'serial': '3ab08fda-c4e7-456c-8003-24c8bfb6c688'}, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'b6a12a6b-b282-4a83-9a3d-e69140417d9b', 'guest_format': None, 'volume_type': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:28:25 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 16 18:28:25 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 16 18:28:25 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG nova.objects.instance [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Lazy-loading 'vcpu_model' on Instance uuid 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Starting migrate_disk_and_power_off {{(pid=74247) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fsdpBahK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:28:25 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 16 18:28:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:28:25 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 16 18:28:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:28:25 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:28:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e33dfe2-3c3f-492a-a3b4-3e8a086c2fac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 18:28:25 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1473ed0d-e7e2-4d66-9c27-e9c4dc2f8a60]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688] added
Oct 16 18:28:25 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6c93d2-2d08-4c1b-99c3-1e9dfd12f4f3]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e24940b-231f-4ad6-9477-781d3fa57003]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fsdpBahK {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fsdpBahK" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95ff1b9-ce1f-4cf8-a259-81a584d98fa1]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fsdpBahK'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2639353d-b60b-4d2c-b242-0237636a5357]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[760e54ba-d7a5-476f-8e39-9440ece2bc23]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)
Oct 16 18:28:25 user nova-compute[74247]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:28:25 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)
Oct 16 18:28:25 user nova-compute[74247]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:28:25 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca160051-9230-4f9f-a20f-fc93844175a9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688, portal: 172.16.0.220,3260]
Oct 16 18:28:25 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688, portal: 172.16.0.220,3260] successful.
Oct 16 18:28:25 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[07adad86-295c-496c-aed1-228bcb11fe03]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[54dd23cd-5328-47f9-939d-9ff87d642c7b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)
Oct 16 18:28:25 user nova-compute[74247]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:28:25 user nova-compute[74247]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)
Oct 16 18:28:25 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)
Oct 16 18:28:25 user nova-compute[74247]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:28:25 user nova-compute[74247]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)
Oct 16 18:28:25 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] HCTL ('35', '-', '-', 0) found on session 12 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[931fb8ad-727f-45a8-abc3-096f8e2f46ca]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Searching for a device in session 12 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fsdpBahK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG nova.compute.manager [req-cbc88483-aa61-4b80-a800-73ed3558a8c2 req-d66b5891-0038-4ac5-ad8e-01b003156265 service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] Received event network-vif-unplugged-8cb168df-92d2-4ecc-946a-7d9075f75561 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-cbc88483-aa61-4b80-a800-73ed3558a8c2 req-d66b5891-0038-4ac5-ad8e-01b003156265 service nova] Acquiring lock "a686ee86-272c-47be-8801-9c1500af272f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-cbc88483-aa61-4b80-a800-73ed3558a8c2 req-d66b5891-0038-4ac5-ad8e-01b003156265 service nova] Lock "a686ee86-272c-47be-8801-9c1500af272f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-cbc88483-aa61-4b80-a800-73ed3558a8c2 req-d66b5891-0038-4ac5-ad8e-01b003156265 service nova] Lock "a686ee86-272c-47be-8801-9c1500af272f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG nova.compute.manager [req-cbc88483-aa61-4b80-a800-73ed3558a8c2 req-d66b5891-0038-4ac5-ad8e-01b003156265 service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] No waiting events found dispatching network-vif-unplugged-8cb168df-92d2-4ecc-946a-7d9075f75561 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:28:25 user nova-compute[74247]: WARNING nova.compute.manager [req-cbc88483-aa61-4b80-a800-73ed3558a8c2 req-d66b5891-0038-4ac5-ad8e-01b003156265 service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] Received unexpected event network-vif-unplugged-8cb168df-92d2-4ecc-946a-7d9075f75561 for instance with vm_state active and task_state resize_migrating.
Oct 16 18:28:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:25 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: a686ee86-272c-47be-8801-9c1500af272f] Instance destroyed successfully.
Oct 16 18:28:25 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:24:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-208936177',display_name='tempest-ServerActionsTestOtherB-server-208936177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-208936177',id=4,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIs9LtanBEbN6S6UJgwgQipMcrzgCgmqD+MSXO/I2jlCfUtIcGHYoW9tgqCxpGH6Qd6bb/kDDqj9dBay7WvsSTTn0A8mddCk4+U9BnAHzFohZU35eWuYV7ckMsEqil5fw==',key_name='tempest-keypair-447758938',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:24:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='973c8310858e4e1dafbc2fa926995940',ramdisk_id='',reservation_id='r-2wkxxe7p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-650770368',owner_user_name='tempest-ServerActionsTestOtherB-650770368-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:28:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b6734bfca1e4bf5b3c75d06eb471220',uuid=a686ee86-272c-47be-8801-9c1500af272f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8cb168df-92d2-4ecc-946a-7d9075f75561", "address": "fa:16:3e:9d:bb:be", "network": {"id": "f12e9b98-2724-4b9c-a299-7286c163458c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1410604293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1410604293-network", "vif_mac": "fa:16:3e:9d:bb:be"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973c8310858e4e1dafbc2fa926995940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb168df-92", "ovs_interfaceid": "8cb168df-92d2-4ecc-946a-7d9075f75561", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Converting VIF {"id": "8cb168df-92d2-4ecc-946a-7d9075f75561", "address": "fa:16:3e:9d:bb:be", "network": {"id": "f12e9b98-2724-4b9c-a299-7286c163458c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1410604293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1410604293-network", "vif_mac": "fa:16:3e:9d:bb:be"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973c8310858e4e1dafbc2fa926995940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb168df-92", "ovs_interfaceid": "8cb168df-92d2-4ecc-946a-7d9075f75561", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:bb:be,bridge_name='br-int',has_traffic_filtering=True,id=8cb168df-92d2-4ecc-946a-7d9075f75561,network=Network(f12e9b98-2724-4b9c-a299-7286c163458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb168df-92') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG os_vif [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:bb:be,bridge_name='br-int',has_traffic_filtering=True,id=8cb168df-92d2-4ecc-946a-7d9075f75561,network=Network(f12e9b98-2724-4b9c-a299-7286c163458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb168df-92') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8cb168df-92, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=515cc43f-3743-441a-b945-db47ed68a6c5) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:28:25 user nova-compute[74247]: INFO os_vif [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:bb:be,bridge_name='br-int',has_traffic_filtering=True,id=8cb168df-92d2-4ecc-946a-7d9075f75561,network=Network(f12e9b98-2724-4b9c-a299-7286c163458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb168df-92')
Oct 16 18:28:25 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 18:28:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MHBuxbDs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:28:25 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:28:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-424dabd0-33a9-4652-8056-8765557a487c tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Acquiring lock "c868ea1c-0c1c-4470-b125-0a7a76d96c4d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-424dabd0-33a9-4652-8056-8765557a487c tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Lock "c868ea1c-0c1c-4470-b125-0a7a76d96c4d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-424dabd0-33a9-4652-8056-8765557a487c tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Acquiring lock "c868ea1c-0c1c-4470-b125-0a7a76d96c4d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-424dabd0-33a9-4652-8056-8765557a487c tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Lock "c868ea1c-0c1c-4470-b125-0a7a76d96c4d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-424dabd0-33a9-4652-8056-8765557a487c tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Lock "c868ea1c-0c1c-4470-b125-0a7a76d96c4d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:28:26 user nova-compute[74247]: INFO nova.compute.manager [None req-424dabd0-33a9-4652-8056-8765557a487c tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Terminating instance
Oct 16 18:28:26 user nova-compute[74247]: DEBUG nova.compute.manager [None req-424dabd0-33a9-4652-8056-8765557a487c tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.398s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '23835623533313633', 'path': '/dev/sdd'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835623533313633', 'path': '/dev/sdd'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.535s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d04721-1f79-41f1-80f7-4c40e78ed7f6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 18:28:26 user nova-compute[74247]: No targets found.
Oct 16 18:28:26 user nova-compute[74247]: iSNS:
Oct 16 18:28:26 user nova-compute[74247]: No targets found.
Oct 16 18:28:26 user nova-compute[74247]: STATIC:
Oct 16 18:28:26 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688
Oct 16 18:28:26 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:28:26 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:28:26 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6
Oct 16 18:28:26 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:28:26 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:28:26 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c
Oct 16 18:28:26 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:28:26 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:28:26 user nova-compute[74247]: FIRMWARE:
Oct 16 18:28:26 user nova-compute[74247]: No targets found.
Oct 16 18:28:26 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 18:28:26 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 18:28:26 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T18:25:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1223998491',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-413859192',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEogCyeuhbzTI40G7oRGcfQg1ZDIdQQs+E8Zqfgq6jVx7RJjmhFUF8Of7DSwnrttqR/RrY35HAlR9+flGO4UILfkJp/XvsGQTltIdbBTBZgqMx2HchODLVDJxQEAyvBXA==',key_name='tempest-keypair-1699437087',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:25:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='670a27f9af4f4b32a86386d343a0694b',ramdisk_id='',reservation_id='r-5j8o190g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1771639004',owner_user_name='tempest-ServerActionsV293TestJSON-1771639004-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:27:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='493de9166585427c8714c5ba06c2ceec',uuid=73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f140983-b9a6-4fdd-a301-a9b42927c561", "address": "fa:16:3e:a8:1a:a3", "network": {"id": "64ae2feb-5041-4479-a5a1-02e5ff636224", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-402083057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "670a27f9af4f4b32a86386d343a0694b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f140983-b9", "ovs_interfaceid": "2f140983-b9a6-4fdd-a301-a9b42927c561", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Converting VIF {"id": "2f140983-b9a6-4fdd-a301-a9b42927c561", "address": "fa:16:3e:a8:1a:a3", "network": {"id": "64ae2feb-5041-4479-a5a1-02e5ff636224", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-402083057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "670a27f9af4f4b32a86386d343a0694b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f140983-b9", "ovs_interfaceid": "2f140983-b9a6-4fdd-a301-a9b42927c561", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:1a:a3,bridge_name='br-int',has_traffic_filtering=True,id=2f140983-b9a6-4fdd-a301-a9b42927c561,network=Network(64ae2feb-5041-4479-a5a1-02e5ff636224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f140983-b9') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:28:26 user nova-compute[74247]:   <uuid>73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b</uuid>
Oct 16 18:28:26 user nova-compute[74247]:   <name>instance-00000009</name>
Oct 16 18:28:26 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:28:26 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:28:26 user nova-compute[74247]:   <metadata>
Oct 16 18:28:26 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:28:26 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:28:26 user nova-compute[74247]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1223998491</nova:name>
Oct 16 18:28:26 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:28:25</nova:creationTime>
Oct 16 18:28:26 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:28:26 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:28:26 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:28:26 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:28:26 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:28:26 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:28:26 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:28:26 user nova-compute[74247]:       <nova:owner>
Oct 16 18:28:26 user nova-compute[74247]:         <nova:user uuid="493de9166585427c8714c5ba06c2ceec">tempest-ServerActionsV293TestJSON-1771639004-project-member</nova:user>
Oct 16 18:28:26 user nova-compute[74247]:         <nova:project uuid="670a27f9af4f4b32a86386d343a0694b">tempest-ServerActionsV293TestJSON-1771639004</nova:project>
Oct 16 18:28:26 user nova-compute[74247]:       </nova:owner>
Oct 16 18:28:26 user nova-compute[74247]:       <nova:ports>
Oct 16 18:28:26 user nova-compute[74247]:         <nova:port uuid="2f140983-b9a6-4fdd-a301-a9b42927c561">
Oct 16 18:28:26 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 16 18:28:26 user nova-compute[74247]:         </nova:port>
Oct 16 18:28:26 user nova-compute[74247]:       </nova:ports>
Oct 16 18:28:26 user nova-compute[74247]:     </nova:instance>
Oct 16 18:28:26 user nova-compute[74247]:   </metadata>
Oct 16 18:28:26 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:28:26 user nova-compute[74247]:     <system>
Oct 16 18:28:26 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:28:26 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:28:26 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:28:26 user nova-compute[74247]:       <entry name="serial">73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b</entry>
Oct 16 18:28:26 user nova-compute[74247]:       <entry name="uuid">73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b</entry>
Oct 16 18:28:26 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:28:26 user nova-compute[74247]:     </system>
Oct 16 18:28:26 user nova-compute[74247]:   </sysinfo>
Oct 16 18:28:26 user nova-compute[74247]:   <os>
Oct 16 18:28:26 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:28:26 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:28:26 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:28:26 user nova-compute[74247]:   </os>
Oct 16 18:28:26 user nova-compute[74247]:   <features>
Oct 16 18:28:26 user nova-compute[74247]:     <acpi/>
Oct 16 18:28:26 user nova-compute[74247]:     <apic/>
Oct 16 18:28:26 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:28:26 user nova-compute[74247]:   </features>
Oct 16 18:28:26 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:28:26 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:28:26 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:28:26 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:28:26 user nova-compute[74247]:   </clock>
Oct 16 18:28:26 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:28:26 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:28:26 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:28:26 user nova-compute[74247]:   </cpu>
Oct 16 18:28:26 user nova-compute[74247]:   <devices>
Oct 16 18:28:26 user nova-compute[74247]:     <disk type="block" device="disk">
Oct 16 18:28:26 user nova-compute[74247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:28:26 user nova-compute[74247]:       <source dev="/dev/sdd"/>
Oct 16 18:28:26 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:28:26 user nova-compute[74247]:       <serial>3ab08fda-c4e7-456c-8003-24c8bfb6c688</serial>
Oct 16 18:28:26 user nova-compute[74247]:     </disk>
Oct 16 18:28:26 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:28:26 user nova-compute[74247]:       <mac address="fa:16:3e:a8:1a:a3"/>
Oct 16 18:28:26 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:28:26 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:28:26 user nova-compute[74247]:       <target dev="tap2f140983-b9"/>
Oct 16 18:28:26 user nova-compute[74247]:     </interface>
Oct 16 18:28:26 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:28:26 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b/console.log" append="off"/>
Oct 16 18:28:26 user nova-compute[74247]:     </serial>
Oct 16 18:28:26 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:28:26 user nova-compute[74247]:     <video>
Oct 16 18:28:26 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:28:26 user nova-compute[74247]:     </video>
Oct 16 18:28:26 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:28:26 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:28:26 user nova-compute[74247]:     </rng>
Oct 16 18:28:26 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:28:26 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:28:26 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:28:26 user nova-compute[74247]:     </memballoon>
Oct 16 18:28:26 user nova-compute[74247]:   </devices>
Oct 16 18:28:26 user nova-compute[74247]: </domain>
Oct 16 18:28:26 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T18:25:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1223998491',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-413859192',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEogCyeuhbzTI40G7oRGcfQg1ZDIdQQs+E8Zqfgq6jVx7RJjmhFUF8Of7DSwnrttqR/RrY35HAlR9+flGO4UILfkJp/XvsGQTltIdbBTBZgqMx2HchODLVDJxQEAyvBXA==',key_name='tempest-keypair-1699437087',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:25:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='670a27f9af4f4b32a86386d343a0694b',ramdisk_id='',reservation_id='r-5j8o190g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1771639004',owner_user_name='tempest-ServerActionsV293TestJSON-1771639004-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:27:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='493de9166585427c8714c5ba06c2ceec',uuid=73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f140983-b9a6-4fdd-a301-a9b42927c561", "address": "fa:16:3e:a8:1a:a3", "network": {"id": "64ae2feb-5041-4479-a5a1-02e5ff636224", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-402083057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "670a27f9af4f4b32a86386d343a0694b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f140983-b9", "ovs_interfaceid": "2f140983-b9a6-4fdd-a301-a9b42927c561", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Converting VIF {"id": "2f140983-b9a6-4fdd-a301-a9b42927c561", "address": "fa:16:3e:a8:1a:a3", "network": {"id": "64ae2feb-5041-4479-a5a1-02e5ff636224", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-402083057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "670a27f9af4f4b32a86386d343a0694b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f140983-b9", "ovs_interfaceid": "2f140983-b9a6-4fdd-a301-a9b42927c561", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:1a:a3,bridge_name='br-int',has_traffic_filtering=True,id=2f140983-b9a6-4fdd-a301-a9b42927c561,network=Network(64ae2feb-5041-4479-a5a1-02e5ff636224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f140983-b9') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG os_vif [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:1a:a3,bridge_name='br-int',has_traffic_filtering=True,id=2f140983-b9a6-4fdd-a301-a9b42927c561,network=Network(64ae2feb-5041-4479-a5a1-02e5ff636224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f140983-b9') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2c7a9523-431b-5399-a2a5-9c4e77d72d5b', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[44224e75-c349-4916-aa12-8ddc203b6117]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f140983-b9, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2f140983-b9, col_values=(('qos', UUID('22196a04-1360-47ea-a7ef-0c209b3bdcc1')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2f140983-b9, col_values=(('external_ids', {'iface-id': '2f140983-b9a6-4fdd-a301-a9b42927c561', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:1a:a3', 'vm-uuid': '73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ccd1e1-e785-43b8-9b1c-cbb401f1ce3f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:26 user nova-compute[74247]: INFO os_vif [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:1a:a3,bridge_name='br-int',has_traffic_filtering=True,id=2f140983-b9a6-4fdd-a301-a9b42927c561,network=Network(64ae2feb-5041-4479-a5a1-02e5ff636224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f140983-b9')
Oct 16 18:28:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)
Oct 16 18:28:26 user nova-compute[74247]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:28:26 user nova-compute[74247]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)
Oct 16 18:28:26 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)
Oct 16 18:28:26 user nova-compute[74247]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:28:26 user nova-compute[74247]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)
Oct 16 18:28:26 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe0484267a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6'): ({'sdc'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Removing single pathed devices sdc {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[27466fae-9f45-439e-89b9-8a39f5f730d1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b8c3fb-c192-4134-a681-8e57825230e3]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Flushing IO for device /dev/sdc {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] No VIF found with MAC fa:16:3e:a8:1a:a3, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[033bf082-89a2-4541-85bf-139dc32c6d50]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90b0fcb-5457-4691-b336-8c9c5cd78d73]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] SCSI volumes sdc have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f72b54-e2eb-4afe-928c-52125adb7c95]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[02531cc8-793e-4c84-8543-4f98f4c2c9df]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6, portal: 172.16.0.220,3260]
Oct 16 18:28:26 user nova-compute[74247]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6, portal: 172.16.0.220,3260] successful.
Oct 16 18:28:26 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed50221-af79-495f-98f3-941666ffe6cf]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] <== disconnect_volume: return (916ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 18:28:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:27 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:28:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f_resize/disk /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:27 user nova-compute[74247]: DEBUG nova.compute.manager [req-74a1b3f6-8969-49d2-8250-e1a74e385bbd req-a57dfbef-3753-49d4-94b7-5d049e363dac service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] Received event network-vif-plugged-8cb168df-92d2-4ecc-946a-7d9075f75561 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:28:27 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-74a1b3f6-8969-49d2-8250-e1a74e385bbd req-a57dfbef-3753-49d4-94b7-5d049e363dac service nova] Acquiring lock "a686ee86-272c-47be-8801-9c1500af272f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:28:27 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-74a1b3f6-8969-49d2-8250-e1a74e385bbd req-a57dfbef-3753-49d4-94b7-5d049e363dac service nova] Lock "a686ee86-272c-47be-8801-9c1500af272f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:28:27 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-74a1b3f6-8969-49d2-8250-e1a74e385bbd req-a57dfbef-3753-49d4-94b7-5d049e363dac service nova] Lock "a686ee86-272c-47be-8801-9c1500af272f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:28:27 user nova-compute[74247]: DEBUG nova.compute.manager [req-74a1b3f6-8969-49d2-8250-e1a74e385bbd req-a57dfbef-3753-49d4-94b7-5d049e363dac service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] No waiting events found dispatching network-vif-plugged-8cb168df-92d2-4ecc-946a-7d9075f75561 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:28:27 user nova-compute[74247]: WARNING nova.compute.manager [req-74a1b3f6-8969-49d2-8250-e1a74e385bbd req-a57dfbef-3753-49d4-94b7-5d049e363dac service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] Received unexpected event network-vif-plugged-8cb168df-92d2-4ecc-946a-7d9075f75561 for instance with vm_state active and task_state resize_migrating.
Oct 16 18:28:27 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Instance destroyed successfully.
Oct 16 18:28:27 user nova-compute[74247]: DEBUG nova.objects.instance [None req-424dabd0-33a9-4652-8056-8765557a487c tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Lazy-loading 'resources' on Instance uuid c868ea1c-0c1c-4470-b125-0a7a76d96c4d {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:28:27 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-424dabd0-33a9-4652-8056-8765557a487c tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:24:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1900535874',display_name='tempest-VolumesAssistedSnapshotsTest-server-1900535874',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1900535874',id=8,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZm5g5FswEClxZq2Tyo+5T/i2LrNoPZUIVcUfPwtLLTVFAkDd4sSvgvlAnR0pPH8ucb5fZDO40ybjQ0Mz3U/3nWIEiVTIbxgz035R8r98527gcnLaOf/vbKEM+0sTwBxw==',key_name='tempest-keypair-308070645',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:24:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47bf1a9c1d4b408195d15bccd73e818b',ramdisk_id='',reservation_id='r-30idq7eq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-229729736',owner_user_name='tempest-VolumesAssistedSnapshotsTest-229729736-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:24:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ec0452050fd47499d535837954fcf8e',uuid=c868ea1c-0c1c-4470-b125-0a7a76d96c4d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9ecd4e6-2676-47b4-baf8-d8f68156007d", "address": "fa:16:3e:91:15:33", "network": {"id": "00543722-2a00-4d5d-b9d4-8ee2814fa989", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1795227661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47bf1a9c1d4b408195d15bccd73e818b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ecd4e6-26", "ovs_interfaceid": "e9ecd4e6-2676-47b4-baf8-d8f68156007d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:28:27 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-424dabd0-33a9-4652-8056-8765557a487c tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Converting VIF {"id": "e9ecd4e6-2676-47b4-baf8-d8f68156007d", "address": "fa:16:3e:91:15:33", "network": {"id": "00543722-2a00-4d5d-b9d4-8ee2814fa989", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1795227661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47bf1a9c1d4b408195d15bccd73e818b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ecd4e6-26", "ovs_interfaceid": "e9ecd4e6-2676-47b4-baf8-d8f68156007d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:28:27 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-424dabd0-33a9-4652-8056-8765557a487c tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:15:33,bridge_name='br-int',has_traffic_filtering=True,id=e9ecd4e6-2676-47b4-baf8-d8f68156007d,network=Network(00543722-2a00-4d5d-b9d4-8ee2814fa989),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9ecd4e6-26') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:28:27 user nova-compute[74247]: DEBUG os_vif [None req-424dabd0-33a9-4652-8056-8765557a487c tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:15:33,bridge_name='br-int',has_traffic_filtering=True,id=e9ecd4e6-2676-47b4-baf8-d8f68156007d,network=Network(00543722-2a00-4d5d-b9d4-8ee2814fa989),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9ecd4e6-26') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:28:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9ecd4e6-26, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:28:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:28:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f3231b65-5ace-414a-9192-183809224977) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:28:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:28:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:27 user nova-compute[74247]: INFO os_vif [None req-424dabd0-33a9-4652-8056-8765557a487c tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:15:33,bridge_name='br-int',has_traffic_filtering=True,id=e9ecd4e6-2676-47b4-baf8-d8f68156007d,network=Network(00543722-2a00-4d5d-b9d4-8ee2814fa989),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9ecd4e6-26')
Oct 16 18:28:27 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-424dabd0-33a9-4652-8056-8765557a487c tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Deleting instance files /opt/stack/data/nova/instances/c868ea1c-0c1c-4470-b125-0a7a76d96c4d_del
Oct 16 18:28:27 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-424dabd0-33a9-4652-8056-8765557a487c tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Deletion of /opt/stack/data/nova/instances/c868ea1c-0c1c-4470-b125-0a7a76d96c4d_del complete
Oct 16 18:28:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] CMD "cp -r /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f_resize/disk /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk" returned: 0 in 0.556s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f_resize/disk.info /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk.info {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] CMD "cp -r /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f_resize/disk.info /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk.info" returned: 0 in 0.035s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:27 user nova-compute[74247]: INFO nova.compute.manager [None req-424dabd0-33a9-4652-8056-8765557a487c tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Took 1.62 seconds to destroy the instance on the hypervisor.
Oct 16 18:28:27 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-424dabd0-33a9-4652-8056-8765557a487c tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 18:28:27 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 18:28:27 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 18:28:28 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:28 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:29 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:29 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:29 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:29 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:28:29 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Took 1.51 seconds to deallocate network for instance.
Oct 16 18:28:29 user nova-compute[74247]: DEBUG nova.network.neutron [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Port 8cb168df-92d2-4ecc-946a-7d9075f75561 binding to destination host user is already ACTIVE {{(pid=74247) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Oct 16 18:28:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-424dabd0-33a9-4652-8056-8765557a487c tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:28:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-424dabd0-33a9-4652-8056-8765557a487c tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:28:29 user nova-compute[74247]: DEBUG nova.compute.manager [req-f6e6318f-bf4f-45e2-bba8-cdcc83715e76 req-3c750cd9-fabb-4ff3-a412-64eef8202cd3 service nova] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Received event network-vif-plugged-2f140983-b9a6-4fdd-a301-a9b42927c561 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:28:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f6e6318f-bf4f-45e2-bba8-cdcc83715e76 req-3c750cd9-fabb-4ff3-a412-64eef8202cd3 service nova] Acquiring lock "73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:28:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f6e6318f-bf4f-45e2-bba8-cdcc83715e76 req-3c750cd9-fabb-4ff3-a412-64eef8202cd3 service nova] Lock "73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:28:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f6e6318f-bf4f-45e2-bba8-cdcc83715e76 req-3c750cd9-fabb-4ff3-a412-64eef8202cd3 service nova] Lock "73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:28:29 user nova-compute[74247]: DEBUG nova.compute.manager [req-f6e6318f-bf4f-45e2-bba8-cdcc83715e76 req-3c750cd9-fabb-4ff3-a412-64eef8202cd3 service nova] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] No waiting events found dispatching network-vif-plugged-2f140983-b9a6-4fdd-a301-a9b42927c561 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:28:29 user nova-compute[74247]: WARNING nova.compute.manager [req-f6e6318f-bf4f-45e2-bba8-cdcc83715e76 req-3c750cd9-fabb-4ff3-a412-64eef8202cd3 service nova] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Received unexpected event network-vif-plugged-2f140983-b9a6-4fdd-a301-a9b42927c561 for instance with vm_state active and task_state rebuild_spawning.
Oct 16 18:28:29 user nova-compute[74247]: DEBUG nova.compute.manager [req-f6e6318f-bf4f-45e2-bba8-cdcc83715e76 req-3c750cd9-fabb-4ff3-a412-64eef8202cd3 service nova] [instance: c868ea1c-0c1c-4470-b125-0a7a76d96c4d] Received event network-vif-deleted-e9ecd4e6-2676-47b4-baf8-d8f68156007d {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:28:29 user nova-compute[74247]: DEBUG nova.compute.manager [req-f6e6318f-bf4f-45e2-bba8-cdcc83715e76 req-3c750cd9-fabb-4ff3-a412-64eef8202cd3 service nova] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Received event network-vif-plugged-2f140983-b9a6-4fdd-a301-a9b42927c561 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:28:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f6e6318f-bf4f-45e2-bba8-cdcc83715e76 req-3c750cd9-fabb-4ff3-a412-64eef8202cd3 service nova] Acquiring lock "73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:28:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f6e6318f-bf4f-45e2-bba8-cdcc83715e76 req-3c750cd9-fabb-4ff3-a412-64eef8202cd3 service nova] Lock "73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:28:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f6e6318f-bf4f-45e2-bba8-cdcc83715e76 req-3c750cd9-fabb-4ff3-a412-64eef8202cd3 service nova] Lock "73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:28:29 user nova-compute[74247]: DEBUG nova.compute.manager [req-f6e6318f-bf4f-45e2-bba8-cdcc83715e76 req-3c750cd9-fabb-4ff3-a412-64eef8202cd3 service nova] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] No waiting events found dispatching network-vif-plugged-2f140983-b9a6-4fdd-a301-a9b42927c561 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:28:29 user nova-compute[74247]: WARNING nova.compute.manager [req-f6e6318f-bf4f-45e2-bba8-cdcc83715e76 req-3c750cd9-fabb-4ff3-a412-64eef8202cd3 service nova] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Received unexpected event network-vif-plugged-2f140983-b9a6-4fdd-a301-a9b42927c561 for instance with vm_state active and task_state rebuild_spawning.
Oct 16 18:28:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Acquiring lock "a686ee86-272c-47be-8801-9c1500af272f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:28:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lock "a686ee86-272c-47be-8801-9c1500af272f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:28:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lock "a686ee86-272c-47be-8801-9c1500af272f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:28:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Acquiring lock "refresh_cache-a686ee86-272c-47be-8801-9c1500af272f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:28:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Acquired lock "refresh_cache-a686ee86-272c-47be-8801-9c1500af272f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:28:29 user nova-compute[74247]: DEBUG nova.network.neutron [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:28:30 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-424dabd0-33a9-4652-8056-8765557a487c tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:28:30 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-424dabd0-33a9-4652-8056-8765557a487c tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:28:30 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-424dabd0-33a9-4652-8056-8765557a487c tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.561s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:28:30 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-424dabd0-33a9-4652-8056-8765557a487c tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Deleted allocations for instance c868ea1c-0c1c-4470-b125-0a7a76d96c4d
Oct 16 18:28:30 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-424dabd0-33a9-4652-8056-8765557a487c tempest-VolumesAssistedSnapshotsTest-229729736 tempest-VolumesAssistedSnapshotsTest-229729736-project-member] Lock "c868ea1c-0c1c-4470-b125-0a7a76d96c4d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.938s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:28:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:30 user nova-compute[74247]: DEBUG nova.network.neutron [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Updating instance_info_cache with network_info: [{"id": "8cb168df-92d2-4ecc-946a-7d9075f75561", "address": "fa:16:3e:9d:bb:be", "network": {"id": "f12e9b98-2724-4b9c-a299-7286c163458c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1410604293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973c8310858e4e1dafbc2fa926995940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb168df-92", "ovs_interfaceid": "8cb168df-92d2-4ecc-946a-7d9075f75561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:28:30 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Releasing lock "refresh_cache-a686ee86-272c-47be-8801-9c1500af272f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:28:30 user nova-compute[74247]: DEBUG os_brick.utils [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:28:30 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:30 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:30 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d41f2a-779b-41ce-9d30-e604f1f8a2e2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:30 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:30 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:30 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11c3118-c012-486c-9317-9dc61885580e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:30 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:30 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:30 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d00f974-9e37-4f68-a11d-e728bc1e77d0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:30 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd64cb8-b1fc-4f05-8205-fbba97109083]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:30 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:30 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:28:30 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 18:28:30 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:30 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:28:30 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 18:28:30 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f78186-2db7-453a-9e1e-99f43423c470]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:30 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 18:28:30 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 18:28:30 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 18:28:30 user nova-compute[74247]: DEBUG os_brick.utils [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:28:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:30 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:28:30 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:28:30 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Instance spawned successfully.
Oct 16 18:28:30 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 18:28:30 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:28:30 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:28:30 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:28:30 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:28:31 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:28:31 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:28:31 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:28:31 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:28:31 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:28:31 user nova-compute[74247]: DEBUG nova.objects.instance [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74247) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 16 18:28:31 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4bf61dc4-578e-4224-bf81-68d41f46863f tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.089s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:28:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:34 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-5a353d50-34bb-4161-88d1-2921265a789b tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ff1e2d26-57c5-4aa1-b66f-3ead29571b7e is timed out.
Oct 16 18:28:34 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-5a353d50-34bb-4161-88d1-2921265a789b tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Successfully detached device vdb from instance ff1e2d26-57c5-4aa1-b66f-3ead29571b7e from the live domain config.
Oct 16 18:28:34 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a353d50-34bb-4161-88d1-2921265a789b tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a353d50-34bb-4161-88d1-2921265a789b tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aBIGibKX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': 'be80392d-488c-4d06-8ff0-9e11c788399c'}, None), 'kwargs': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:28:34 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-5a353d50-34bb-4161-88d1-2921265a789b tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:28:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-5a353d50-34bb-4161-88d1-2921265a789b tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-5a353d50-34bb-4161-88d1-2921265a789b tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[62266e0b-5fac-4b65-92c9-f8d93ddde11c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a353d50-34bb-4161-88d1-2921265a789b tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 18:28:34 user nova-compute[74247]: No targets found.
Oct 16 18:28:34 user nova-compute[74247]: iSNS:
Oct 16 18:28:34 user nova-compute[74247]: No targets found.
Oct 16 18:28:34 user nova-compute[74247]: STATIC:
Oct 16 18:28:34 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688
Oct 16 18:28:34 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:28:34 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:28:34 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c
Oct 16 18:28:34 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:28:34 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:28:34 user nova-compute[74247]: FIRMWARE:
Oct 16 18:28:34 user nova-compute[74247]: No targets found.
Oct 16 18:28:34 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a353d50-34bb-4161-88d1-2921265a789b tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 18:28:34 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 18:28:34 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a353d50-34bb-4161-88d1-2921265a789b tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9619a169-a523-43aa-9f79-fe12315aeae1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aee187f-1a02-4de8-9851-5b00bab6111e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a353d50-34bb-4161-88d1-2921265a789b tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)
Oct 16 18:28:34 user nova-compute[74247]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)
Oct 16 18:28:34 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a353d50-34bb-4161-88d1-2921265a789b tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c (non-flash)
Oct 16 18:28:34 user nova-compute[74247]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)
Oct 16 18:28:34 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a353d50-34bb-4161-88d1-2921265a789b tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe048410c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c'): ({'sdb'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-5a353d50-34bb-4161-88d1-2921265a789b tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Removing single pathed devices sdb {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e6cbe7-49e8-452a-a7f9-aefbabb6cc83]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[45cfb563-a915-4d6e-a73d-b41666557bef]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-5a353d50-34bb-4161-88d1-2921265a789b tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Flushing IO for device /dev/sdb {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff10291-c7f2-42d5-b887-045ec5950c12]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-5a353d50-34bb-4161-88d1-2921265a789b tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[97bdda3a-8cd5-4ddd-b552-b333e41a1608]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-5a353d50-34bb-4161-88d1-2921265a789b tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-5a353d50-34bb-4161-88d1-2921265a789b tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] SCSI volumes sdb have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a353d50-34bb-4161-88d1-2921265a789b tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9c6f51-4ea3-4991-b817-f7cd1741e9d1]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a353d50-34bb-4161-88d1-2921265a789b tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb845075-8db6-4f0d-a433-caac917e0847]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a353d50-34bb-4161-88d1-2921265a789b tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c, portal: 172.16.0.220,3260]
Oct 16 18:28:34 user nova-compute[74247]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c, portal: 172.16.0.220,3260] successful.
Oct 16 18:28:34 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be80392d-488c-4d06-8ff0-9e11c788399c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db8878a-6750-4b1e-88b9-e5b2887a9401]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a353d50-34bb-4161-88d1-2921265a789b tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-5a353d50-34bb-4161-88d1-2921265a789b tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a353d50-34bb-4161-88d1-2921265a789b tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] <== disconnect_volume: return (355ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:28:34 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a353d50-34bb-4161-88d1-2921265a789b tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 18:28:35 user nova-compute[74247]: DEBUG nova.objects.instance [None req-5a353d50-34bb-4161-88d1-2921265a789b tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Lazy-loading 'flavor' on Instance uuid ff1e2d26-57c5-4aa1-b66f-3ead29571b7e {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:28:35 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5a353d50-34bb-4161-88d1-2921265a789b tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Lock "ff1e2d26-57c5-4aa1-b66f-3ead29571b7e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.953s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:28:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:37 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4fe01c7d-0d13-42c8-98c5-5dc01e3c6050 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Acquiring lock "c048698e-de64-4124-8d72-57fb819bb80e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:28:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4fe01c7d-0d13-42c8-98c5-5dc01e3c6050 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Lock "c048698e-de64-4124-8d72-57fb819bb80e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:28:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4fe01c7d-0d13-42c8-98c5-5dc01e3c6050 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Acquiring lock "c048698e-de64-4124-8d72-57fb819bb80e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:28:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4fe01c7d-0d13-42c8-98c5-5dc01e3c6050 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Lock "c048698e-de64-4124-8d72-57fb819bb80e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:28:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4fe01c7d-0d13-42c8-98c5-5dc01e3c6050 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Lock "c048698e-de64-4124-8d72-57fb819bb80e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:28:38 user nova-compute[74247]: INFO nova.compute.manager [None req-4fe01c7d-0d13-42c8-98c5-5dc01e3c6050 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Terminating instance
Oct 16 18:28:38 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4fe01c7d-0d13-42c8-98c5-5dc01e3c6050 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 18:28:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:38 user nova-compute[74247]: DEBUG nova.compute.manager [req-4d9cf70c-49b8-4fca-934b-ea243f0a152d req-40a56d1a-e6f8-491c-bd7b-931aa4903259 service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Received event network-vif-unplugged-59256fa7-ebbd-4cde-80c4-012340d7aea0 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:28:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4d9cf70c-49b8-4fca-934b-ea243f0a152d req-40a56d1a-e6f8-491c-bd7b-931aa4903259 service nova] Acquiring lock "c048698e-de64-4124-8d72-57fb819bb80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:28:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4d9cf70c-49b8-4fca-934b-ea243f0a152d req-40a56d1a-e6f8-491c-bd7b-931aa4903259 service nova] Lock "c048698e-de64-4124-8d72-57fb819bb80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:28:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4d9cf70c-49b8-4fca-934b-ea243f0a152d req-40a56d1a-e6f8-491c-bd7b-931aa4903259 service nova] Lock "c048698e-de64-4124-8d72-57fb819bb80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:28:38 user nova-compute[74247]: DEBUG nova.compute.manager [req-4d9cf70c-49b8-4fca-934b-ea243f0a152d req-40a56d1a-e6f8-491c-bd7b-931aa4903259 service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] No waiting events found dispatching network-vif-unplugged-59256fa7-ebbd-4cde-80c4-012340d7aea0 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:28:38 user nova-compute[74247]: DEBUG nova.compute.manager [req-4d9cf70c-49b8-4fca-934b-ea243f0a152d req-40a56d1a-e6f8-491c-bd7b-931aa4903259 service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Received event network-vif-unplugged-59256fa7-ebbd-4cde-80c4-012340d7aea0 for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:28:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:39 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Instance destroyed successfully.
Oct 16 18:28:39 user nova-compute[74247]: DEBUG nova.objects.instance [None req-4fe01c7d-0d13-42c8-98c5-5dc01e3c6050 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Lazy-loading 'resources' on Instance uuid c048698e-de64-4124-8d72-57fb819bb80e {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:28:39 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-4fe01c7d-0d13-42c8-98c5-5dc01e3c6050 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T18:24:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1708908380',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1708908380',id=6,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4t5/HxarVjAIcPE9zeByR72HYnWO4eclBUfo863abS/M64e1Oj/mYiR12Cs6HtPrtMLyPaTm6rvsRa3pNGaznOooPgv/HGuQCekMNKw81O1jY6NY8zkFrvxeZV5v6ZKw==',key_name='tempest-keypair-1905579868',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:24:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ab4b3ccbd914164a2d5b38c7b89777b',ramdisk_id='',reservation_id='r-jcqqfx36',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1522926684',owner_user_name='tempest-TaggedAttachmentsTest-1522926684-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:24:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2000726f45b45feb6c3c5cedcbd40e2',uuid=c048698e-de64-4124-8d72-57fb819bb80e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59256fa7-ebbd-4cde-80c4-012340d7aea0", "address": "fa:16:3e:ff:27:0b", "network": {"id": "f35ee734-1070-4c5a-84f5-c76501c1b6cb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1676802825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ab4b3ccbd914164a2d5b38c7b89777b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59256fa7-eb", "ovs_interfaceid": "59256fa7-ebbd-4cde-80c4-012340d7aea0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:28:39 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-4fe01c7d-0d13-42c8-98c5-5dc01e3c6050 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Converting VIF {"id": "59256fa7-ebbd-4cde-80c4-012340d7aea0", "address": "fa:16:3e:ff:27:0b", "network": {"id": "f35ee734-1070-4c5a-84f5-c76501c1b6cb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1676802825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ab4b3ccbd914164a2d5b38c7b89777b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59256fa7-eb", "ovs_interfaceid": "59256fa7-ebbd-4cde-80c4-012340d7aea0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:28:39 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-4fe01c7d-0d13-42c8-98c5-5dc01e3c6050 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:27:0b,bridge_name='br-int',has_traffic_filtering=True,id=59256fa7-ebbd-4cde-80c4-012340d7aea0,network=Network(f35ee734-1070-4c5a-84f5-c76501c1b6cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59256fa7-eb') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:28:39 user nova-compute[74247]: DEBUG os_vif [None req-4fe01c7d-0d13-42c8-98c5-5dc01e3c6050 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:27:0b,bridge_name='br-int',has_traffic_filtering=True,id=59256fa7-ebbd-4cde-80c4-012340d7aea0,network=Network(f35ee734-1070-4c5a-84f5-c76501c1b6cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59256fa7-eb') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:28:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap59256fa7-eb, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:28:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:28:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ac37b938-d626-448a-b4c5-4cbe5a2c9c02) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:28:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:39 user nova-compute[74247]: INFO os_vif [None req-4fe01c7d-0d13-42c8-98c5-5dc01e3c6050 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:27:0b,bridge_name='br-int',has_traffic_filtering=True,id=59256fa7-ebbd-4cde-80c4-012340d7aea0,network=Network(f35ee734-1070-4c5a-84f5-c76501c1b6cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59256fa7-eb')
Oct 16 18:28:39 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-4fe01c7d-0d13-42c8-98c5-5dc01e3c6050 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Deleting instance files /opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e_del
Oct 16 18:28:39 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-4fe01c7d-0d13-42c8-98c5-5dc01e3c6050 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Deletion of /opt/stack/data/nova/instances/c048698e-de64-4124-8d72-57fb819bb80e_del complete
Oct 16 18:28:39 user nova-compute[74247]: INFO nova.compute.manager [None req-4fe01c7d-0d13-42c8-98c5-5dc01e3c6050 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 16 18:28:39 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-4fe01c7d-0d13-42c8-98c5-5dc01e3c6050 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 18:28:39 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 18:28:39 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: c048698e-de64-4124-8d72-57fb819bb80e] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 18:28:40 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:28:40 user nova-compute[74247]: DEBUG nova.compute.manager [req-ee78d967-323c-467a-aa6b-fb478d090cbc req-ee9345b7-051a-42fe-8fab-9a4e47334698 service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Received event network-vif-deleted-59256fa7-ebbd-4cde-80c4-012340d7aea0 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:28:40 user nova-compute[74247]: INFO nova.compute.manager [req-ee78d967-323c-467a-aa6b-fb478d090cbc req-ee9345b7-051a-42fe-8fab-9a4e47334698 service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Neutron deleted interface 59256fa7-ebbd-4cde-80c4-012340d7aea0; detaching it from the instance and deleting it from the info cache
Oct 16 18:28:40 user nova-compute[74247]: DEBUG nova.network.neutron [req-ee78d967-323c-467a-aa6b-fb478d090cbc req-ee9345b7-051a-42fe-8fab-9a4e47334698 service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:28:40 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Took 0.82 seconds to deallocate network for instance.
Oct 16 18:28:40 user nova-compute[74247]: DEBUG nova.compute.manager [req-ee78d967-323c-467a-aa6b-fb478d090cbc req-ee9345b7-051a-42fe-8fab-9a4e47334698 service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Detach interface failed, port_id=59256fa7-ebbd-4cde-80c4-012340d7aea0, reason: Instance c048698e-de64-4124-8d72-57fb819bb80e could not be found. {{(pid=74247) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 18:28:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4fe01c7d-0d13-42c8-98c5-5dc01e3c6050 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:28:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4fe01c7d-0d13-42c8-98c5-5dc01e3c6050 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:28:40 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4fe01c7d-0d13-42c8-98c5-5dc01e3c6050 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:28:40 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4fe01c7d-0d13-42c8-98c5-5dc01e3c6050 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:28:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4fe01c7d-0d13-42c8-98c5-5dc01e3c6050 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.375s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:28:40 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-4fe01c7d-0d13-42c8-98c5-5dc01e3c6050 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Deleted allocations for instance c048698e-de64-4124-8d72-57fb819bb80e
Oct 16 18:28:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4fe01c7d-0d13-42c8-98c5-5dc01e3c6050 tempest-TaggedAttachmentsTest-1522926684 tempest-TaggedAttachmentsTest-1522926684-project-member] Lock "c048698e-de64-4124-8d72-57fb819bb80e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.307s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:28:40 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:40 user nova-compute[74247]: DEBUG nova.compute.manager [req-67aaa8f8-7ba7-45b7-b81e-80f5648058af req-5835b64b-6e01-4c05-b21b-6c2c083cfb0a service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Received event network-vif-plugged-59256fa7-ebbd-4cde-80c4-012340d7aea0 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:28:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-67aaa8f8-7ba7-45b7-b81e-80f5648058af req-5835b64b-6e01-4c05-b21b-6c2c083cfb0a service nova] Acquiring lock "c048698e-de64-4124-8d72-57fb819bb80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:28:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-67aaa8f8-7ba7-45b7-b81e-80f5648058af req-5835b64b-6e01-4c05-b21b-6c2c083cfb0a service nova] Lock "c048698e-de64-4124-8d72-57fb819bb80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:28:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-67aaa8f8-7ba7-45b7-b81e-80f5648058af req-5835b64b-6e01-4c05-b21b-6c2c083cfb0a service nova] Lock "c048698e-de64-4124-8d72-57fb819bb80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:28:40 user nova-compute[74247]: DEBUG nova.compute.manager [req-67aaa8f8-7ba7-45b7-b81e-80f5648058af req-5835b64b-6e01-4c05-b21b-6c2c083cfb0a service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] No waiting events found dispatching network-vif-plugged-59256fa7-ebbd-4cde-80c4-012340d7aea0 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:28:40 user nova-compute[74247]: WARNING nova.compute.manager [req-67aaa8f8-7ba7-45b7-b81e-80f5648058af req-5835b64b-6e01-4c05-b21b-6c2c083cfb0a service nova] [instance: c048698e-de64-4124-8d72-57fb819bb80e] Received unexpected event network-vif-plugged-59256fa7-ebbd-4cde-80c4-012340d7aea0 for instance with vm_state deleted and task_state None.
Oct 16 18:28:44 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:54 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:28:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:01 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Starting finish_migration {{(pid=74247) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 16 18:29:01 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Instance directory exists: not creating {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 16 18:29:01 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Creating image(s)
Oct 16 18:29:01 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:01 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.174s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:01 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk. size=21474836480 {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 18:29:01 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:01 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:01 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk 21474836480 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:01 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk 21474836480" returned: 0 in 0.045s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:01 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Did not create local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 18:29:01 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Ensure instance console log exists: /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:29:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:29:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:29:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:29:01 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Start _get_guest_xml network_info=[{"id": "8cb168df-92d2-4ecc-946a-7d9075f75561", "address": "fa:16:3e:9d:bb:be", "network": {"id": "f12e9b98-2724-4b9c-a299-7286c163458c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1410604293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1410604293-network", "vif_mac": "fa:16:3e:9d:bb:be"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973c8310858e4e1dafbc2fa926995940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb168df-92", "ovs_interfaceid": "8cb168df-92d2-4ecc-946a-7d9075f75561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': '83126bb1-29f5-42fe-8620-72ab0797f776'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MHBuxbDs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'a686ee86-272c-47be-8801-9c1500af272f', 'attached_at': '2023-10-16T18:29:01.000000', 'detached_at': '', 'volume_id': '8223babc-be85-42b1-899b-b21e077ad7c6', 'serial': '8223babc-be85-42b1-899b-b21e077ad7c6'}, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'b4c8465b-0719-4d2d-a3ce-7c98180311a8', 'guest_format': None, 'volume_type': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:29:01 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:29:01 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:29:01 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:29:01 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:29:01 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:29:01 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:29:01 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:29:01 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:05Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:29:01 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:29:01 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:29:01 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:29:01 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:29:01 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:29:01 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:29:01 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:29:01 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:29:01 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:29:01 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MHBuxbDs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:29:02 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:29:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:29:02 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:29:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:29:02 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:29:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34a2ece-3ee6-4d4e-8db9-1aaa0949d161]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 18:29:02 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc80eacd-8d24-4cf1-8dff-a0fdd24439c3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6] added
Oct 16 18:29:02 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0cf943-b268-4066-83f0-f69b8c67c550]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44970a5-6a89-4886-8e69-fa7f8ec5783c]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MHBuxbDs {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MHBuxbDs" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce62df7-b578-470d-9e8c-f4843aa52784]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MHBuxbDs'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e9bb21-b6d1-4eff-bdb0-9f2687b387f1]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[819c6c0b-1b90-487e-a9c0-b82daf163dfd]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)
Oct 16 18:29:02 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)
Oct 16 18:29:02 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b744ea46-d270-464d-92cf-26bd203a841a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6, portal: 172.16.0.220,3260]
Oct 16 18:29:02 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6, portal: 172.16.0.220,3260] successful.
Oct 16 18:29:02 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65a853a-04cb-4052-9886-a8463c3c98b3]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab6dc3b-43aa-414c-a2e4-9f6197095cb4]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)
Oct 16 18:29:02 user nova-compute[74247]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:29:02 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)
Oct 16 18:29:02 user nova-compute[74247]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:29:02 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46dd774-271c-4217-a1fd-15a40e4b8e9f]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:29:02 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: None {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:29:03 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:29:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MHBuxbDs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:29:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:29:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23533613635316535', 'path': '/dev/sdb'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:29:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533613635316535', 'path': '/dev/sdb'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:29:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:24:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-208936177',display_name='tempest-ServerActionsTestOtherB-server-208936177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-208936177',id=4,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIs9LtanBEbN6S6UJgwgQipMcrzgCgmqD+MSXO/I2jlCfUtIcGHYoW9tgqCxpGH6Qd6bb/kDDqj9dBay7WvsSTTn0A8mddCk4+U9BnAHzFohZU35eWuYV7ckMsEqil5fw==',key_name='tempest-keypair-447758938',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:24:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='973c8310858e4e1dafbc2fa926995940',ramdisk_id='',reservation_id='r-2wkxxe7p',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-650770368',owner_user_name='tempest-ServerActionsTestOtherB-650770368-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:28:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b6734bfca1e4bf5b3c75d06eb471220',uuid=a686ee86-272c-47be-8801-9c1500af272f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8cb168df-92d2-4ecc-946a-7d9075f75561", "address": "fa:16:3e:9d:bb:be", "network": {"id": "f12e9b98-2724-4b9c-a299-7286c163458c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1410604293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1410604293-network", "vif_mac": "fa:16:3e:9d:bb:be"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973c8310858e4e1dafbc2fa926995940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb168df-92", "ovs_interfaceid": "8cb168df-92d2-4ecc-946a-7d9075f75561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:29:03 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Converting VIF {"id": "8cb168df-92d2-4ecc-946a-7d9075f75561", "address": "fa:16:3e:9d:bb:be", "network": {"id": "f12e9b98-2724-4b9c-a299-7286c163458c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1410604293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1410604293-network", "vif_mac": "fa:16:3e:9d:bb:be"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973c8310858e4e1dafbc2fa926995940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb168df-92", "ovs_interfaceid": "8cb168df-92d2-4ecc-946a-7d9075f75561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:29:03 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:bb:be,bridge_name='br-int',has_traffic_filtering=True,id=8cb168df-92d2-4ecc-946a-7d9075f75561,network=Network(f12e9b98-2724-4b9c-a299-7286c163458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb168df-92') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:29:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:29:03 user nova-compute[74247]:   <uuid>a686ee86-272c-47be-8801-9c1500af272f</uuid>
Oct 16 18:29:03 user nova-compute[74247]:   <name>instance-00000004</name>
Oct 16 18:29:03 user nova-compute[74247]:   <memory>2097152</memory>
Oct 16 18:29:03 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:29:03 user nova-compute[74247]:   <metadata>
Oct 16 18:29:03 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:29:03 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:29:03 user nova-compute[74247]:       <nova:name>tempest-ServerActionsTestOtherB-server-208936177</nova:name>
Oct 16 18:29:03 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:29:01</nova:creationTime>
Oct 16 18:29:03 user nova-compute[74247]:       <nova:flavor name="m1.small">
Oct 16 18:29:03 user nova-compute[74247]:         <nova:memory>2048</nova:memory>
Oct 16 18:29:03 user nova-compute[74247]:         <nova:disk>20</nova:disk>
Oct 16 18:29:03 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:29:03 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:29:03 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:29:03 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:29:03 user nova-compute[74247]:       <nova:owner>
Oct 16 18:29:03 user nova-compute[74247]:         <nova:user uuid="2b6734bfca1e4bf5b3c75d06eb471220">tempest-ServerActionsTestOtherB-650770368-project-member</nova:user>
Oct 16 18:29:03 user nova-compute[74247]:         <nova:project uuid="973c8310858e4e1dafbc2fa926995940">tempest-ServerActionsTestOtherB-650770368</nova:project>
Oct 16 18:29:03 user nova-compute[74247]:       </nova:owner>
Oct 16 18:29:03 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:29:03 user nova-compute[74247]:       <nova:ports>
Oct 16 18:29:03 user nova-compute[74247]:         <nova:port uuid="8cb168df-92d2-4ecc-946a-7d9075f75561">
Oct 16 18:29:03 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 16 18:29:03 user nova-compute[74247]:         </nova:port>
Oct 16 18:29:03 user nova-compute[74247]:       </nova:ports>
Oct 16 18:29:03 user nova-compute[74247]:     </nova:instance>
Oct 16 18:29:03 user nova-compute[74247]:   </metadata>
Oct 16 18:29:03 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:29:03 user nova-compute[74247]:     <system>
Oct 16 18:29:03 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:29:03 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:29:03 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:29:03 user nova-compute[74247]:       <entry name="serial">a686ee86-272c-47be-8801-9c1500af272f</entry>
Oct 16 18:29:03 user nova-compute[74247]:       <entry name="uuid">a686ee86-272c-47be-8801-9c1500af272f</entry>
Oct 16 18:29:03 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:29:03 user nova-compute[74247]:     </system>
Oct 16 18:29:03 user nova-compute[74247]:   </sysinfo>
Oct 16 18:29:03 user nova-compute[74247]:   <os>
Oct 16 18:29:03 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:29:03 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:29:03 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:29:03 user nova-compute[74247]:   </os>
Oct 16 18:29:03 user nova-compute[74247]:   <features>
Oct 16 18:29:03 user nova-compute[74247]:     <acpi/>
Oct 16 18:29:03 user nova-compute[74247]:     <apic/>
Oct 16 18:29:03 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:29:03 user nova-compute[74247]:   </features>
Oct 16 18:29:03 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:29:03 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:29:03 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:29:03 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:29:03 user nova-compute[74247]:   </clock>
Oct 16 18:29:03 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:29:03 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:29:03 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:29:03 user nova-compute[74247]:   </cpu>
Oct 16 18:29:03 user nova-compute[74247]:   <devices>
Oct 16 18:29:03 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:29:03 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:29:03 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk"/>
Oct 16 18:29:03 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:29:03 user nova-compute[74247]:     </disk>
Oct 16 18:29:03 user nova-compute[74247]:     <disk type="block" device="disk">
Oct 16 18:29:03 user nova-compute[74247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:29:03 user nova-compute[74247]:       <source dev="/dev/sdb"/>
Oct 16 18:29:03 user nova-compute[74247]:       <target dev="vdb" bus="virtio"/>
Oct 16 18:29:03 user nova-compute[74247]:       <serial>8223babc-be85-42b1-899b-b21e077ad7c6</serial>
Oct 16 18:29:03 user nova-compute[74247]:     </disk>
Oct 16 18:29:03 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:29:03 user nova-compute[74247]:       <mac address="fa:16:3e:9d:bb:be"/>
Oct 16 18:29:03 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:29:03 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:29:03 user nova-compute[74247]:       <target dev="tap8cb168df-92"/>
Oct 16 18:29:03 user nova-compute[74247]:     </interface>
Oct 16 18:29:03 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:29:03 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/console.log" append="off"/>
Oct 16 18:29:03 user nova-compute[74247]:     </serial>
Oct 16 18:29:03 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:29:03 user nova-compute[74247]:     <video>
Oct 16 18:29:03 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:29:03 user nova-compute[74247]:     </video>
Oct 16 18:29:03 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:29:03 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:29:03 user nova-compute[74247]:     </rng>
Oct 16 18:29:03 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:29:03 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:29:03 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:29:03 user nova-compute[74247]:     </memballoon>
Oct 16 18:29:03 user nova-compute[74247]:   </devices>
Oct 16 18:29:03 user nova-compute[74247]: </domain>
Oct 16 18:29:03 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:29:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:24:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-208936177',display_name='tempest-ServerActionsTestOtherB-server-208936177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-208936177',id=4,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIs9LtanBEbN6S6UJgwgQipMcrzgCgmqD+MSXO/I2jlCfUtIcGHYoW9tgqCxpGH6Qd6bb/kDDqj9dBay7WvsSTTn0A8mddCk4+U9BnAHzFohZU35eWuYV7ckMsEqil5fw==',key_name='tempest-keypair-447758938',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:24:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='973c8310858e4e1dafbc2fa926995940',ramdisk_id='',reservation_id='r-2wkxxe7p',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-650770368',owner_user_name='tempest-ServerActionsTestOtherB-650770368-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:28:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b6734bfca1e4bf5b3c75d06eb471220',uuid=a686ee86-272c-47be-8801-9c1500af272f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8cb168df-92d2-4ecc-946a-7d9075f75561", "address": "fa:16:3e:9d:bb:be", "network": {"id": "f12e9b98-2724-4b9c-a299-7286c163458c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1410604293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1410604293-network", "vif_mac": "fa:16:3e:9d:bb:be"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973c8310858e4e1dafbc2fa926995940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb168df-92", "ovs_interfaceid": "8cb168df-92d2-4ecc-946a-7d9075f75561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:29:03 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Converting VIF {"id": "8cb168df-92d2-4ecc-946a-7d9075f75561", "address": "fa:16:3e:9d:bb:be", "network": {"id": "f12e9b98-2724-4b9c-a299-7286c163458c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1410604293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1410604293-network", "vif_mac": "fa:16:3e:9d:bb:be"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973c8310858e4e1dafbc2fa926995940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb168df-92", "ovs_interfaceid": "8cb168df-92d2-4ecc-946a-7d9075f75561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:29:03 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:bb:be,bridge_name='br-int',has_traffic_filtering=True,id=8cb168df-92d2-4ecc-946a-7d9075f75561,network=Network(f12e9b98-2724-4b9c-a299-7286c163458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb168df-92') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:29:03 user nova-compute[74247]: DEBUG os_vif [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:bb:be,bridge_name='br-int',has_traffic_filtering=True,id=8cb168df-92d2-4ecc-946a-7d9075f75561,network=Network(f12e9b98-2724-4b9c-a299-7286c163458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb168df-92') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:29:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:29:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:29:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '22752197-763b-5756-87e8-d7d5bf2f7f5c', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:29:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:29:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8cb168df-92, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:29:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8cb168df-92, col_values=(('qos', UUID('918291ee-5589-4b3c-82af-c65f8117a761')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:29:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8cb168df-92, col_values=(('external_ids', {'iface-id': '8cb168df-92d2-4ecc-946a-7d9075f75561', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:bb:be', 'vm-uuid': 'a686ee86-272c-47be-8801-9c1500af272f'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:29:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:29:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:03 user nova-compute[74247]: INFO os_vif [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:bb:be,bridge_name='br-int',has_traffic_filtering=True,id=8cb168df-92d2-4ecc-946a-7d9075f75561,network=Network(f12e9b98-2724-4b9c-a299-7286c163458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb168df-92')
Oct 16 18:29:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:29:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:29:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] No VIF found with MAC fa:16:3e:9d:bb:be, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:29:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-9bea29bc-a3ed-4082-aa99-622eed6c24c1 tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Acquiring lock "ff1e2d26-57c5-4aa1-b66f-3ead29571b7e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:29:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-9bea29bc-a3ed-4082-aa99-622eed6c24c1 tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Lock "ff1e2d26-57c5-4aa1-b66f-3ead29571b7e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:29:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-9bea29bc-a3ed-4082-aa99-622eed6c24c1 tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Acquiring lock "ff1e2d26-57c5-4aa1-b66f-3ead29571b7e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:29:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-9bea29bc-a3ed-4082-aa99-622eed6c24c1 tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Lock "ff1e2d26-57c5-4aa1-b66f-3ead29571b7e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:29:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-9bea29bc-a3ed-4082-aa99-622eed6c24c1 tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Lock "ff1e2d26-57c5-4aa1-b66f-3ead29571b7e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:29:04 user nova-compute[74247]: INFO nova.compute.manager [None req-9bea29bc-a3ed-4082-aa99-622eed6c24c1 tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Terminating instance
Oct 16 18:29:04 user nova-compute[74247]: DEBUG nova.compute.manager [None req-9bea29bc-a3ed-4082-aa99-622eed6c24c1 tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 18:29:04 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:29:04 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:29:04 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 18:29:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:04 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Skipping network cache update for instance because it is being deleted. {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9970}}
Oct 16 18:29:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:04 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Didn't find any instances for network info cache update. {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 18:29:04 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:29:04 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:29:04 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:29:04 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:29:04 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:29:04 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:29:04 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 18:29:04 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:29:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:29:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:29:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:29:04 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 18:29:04 user nova-compute[74247]: DEBUG nova.compute.manager [req-9b09b3a4-efee-45ff-b2c9-6f599a0fb24b req-91239cac-2139-4e39-b259-a403e84c4b8a service nova] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Received event network-vif-unplugged-9f035e65-b642-4b32-a5b2-1e82808c6ccc {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:29:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9b09b3a4-efee-45ff-b2c9-6f599a0fb24b req-91239cac-2139-4e39-b259-a403e84c4b8a service nova] Acquiring lock "ff1e2d26-57c5-4aa1-b66f-3ead29571b7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:29:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9b09b3a4-efee-45ff-b2c9-6f599a0fb24b req-91239cac-2139-4e39-b259-a403e84c4b8a service nova] Lock "ff1e2d26-57c5-4aa1-b66f-3ead29571b7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:29:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9b09b3a4-efee-45ff-b2c9-6f599a0fb24b req-91239cac-2139-4e39-b259-a403e84c4b8a service nova] Lock "ff1e2d26-57c5-4aa1-b66f-3ead29571b7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:29:04 user nova-compute[74247]: DEBUG nova.compute.manager [req-9b09b3a4-efee-45ff-b2c9-6f599a0fb24b req-91239cac-2139-4e39-b259-a403e84c4b8a service nova] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] No waiting events found dispatching network-vif-unplugged-9f035e65-b642-4b32-a5b2-1e82808c6ccc {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:29:04 user nova-compute[74247]: DEBUG nova.compute.manager [req-9b09b3a4-efee-45ff-b2c9-6f599a0fb24b req-91239cac-2139-4e39-b259-a403e84c4b8a service nova] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Received event network-vif-unplugged-9f035e65-b642-4b32-a5b2-1e82808c6ccc for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:29:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:05 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Instance destroyed successfully.
Oct 16 18:29:05 user nova-compute[74247]: DEBUG nova.objects.instance [None req-9bea29bc-a3ed-4082-aa99-622eed6c24c1 tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Lazy-loading 'resources' on Instance uuid ff1e2d26-57c5-4aa1-b66f-3ead29571b7e {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:29:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-9bea29bc-a3ed-4082-aa99-622eed6c24c1 tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:24:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-20291116',display_name='tempest-TestVolumeSwap-server-20291116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-20291116',id=7,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnPo7kClnk+yEISweFZgTpAOjOm8pokMKzu0W5qmpZCLG0UG6R3LGOuEF2hPW1jcNilAE4mhz1w/YeA+MRgKDrB0RuniasiJpWmaDhUDL0063pA9501qBitEDnXoWhAfw==',key_name='tempest-keypair-858685379',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:24:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fcd68f315ff3434d955243adda597196',ramdisk_id='',reservation_id='r-o2wvki97',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-322864409',owner_user_name='tempest-TestVolumeSwap-322864409-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:24:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ea1c72d4f8d497bb45168ec0bf1ccd9',uuid=ff1e2d26-57c5-4aa1-b66f-3ead29571b7e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f035e65-b642-4b32-a5b2-1e82808c6ccc", "address": "fa:16:3e:0b:8b:d0", "network": {"id": "d463c254-d68d-4ea5-9642-08d9a1418f04", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1349151729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcd68f315ff3434d955243adda597196", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f035e65-b6", "ovs_interfaceid": "9f035e65-b642-4b32-a5b2-1e82808c6ccc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:29:05 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-9bea29bc-a3ed-4082-aa99-622eed6c24c1 tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Converting VIF {"id": "9f035e65-b642-4b32-a5b2-1e82808c6ccc", "address": "fa:16:3e:0b:8b:d0", "network": {"id": "d463c254-d68d-4ea5-9642-08d9a1418f04", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1349151729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcd68f315ff3434d955243adda597196", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f035e65-b6", "ovs_interfaceid": "9f035e65-b642-4b32-a5b2-1e82808c6ccc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:29:05 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-9bea29bc-a3ed-4082-aa99-622eed6c24c1 tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:8b:d0,bridge_name='br-int',has_traffic_filtering=True,id=9f035e65-b642-4b32-a5b2-1e82808c6ccc,network=Network(d463c254-d68d-4ea5-9642-08d9a1418f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f035e65-b6') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:29:05 user nova-compute[74247]: DEBUG os_vif [None req-9bea29bc-a3ed-4082-aa99-622eed6c24c1 tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:8b:d0,bridge_name='br-int',has_traffic_filtering=True,id=9f035e65-b642-4b32-a5b2-1e82808c6ccc,network=Network(d463c254-d68d-4ea5-9642-08d9a1418f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f035e65-b6') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:29:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f035e65-b6, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:29:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:29:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f095e35c-bfaa-49c8-ae85-6242ab01e075) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:29:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:29:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:05 user nova-compute[74247]: INFO os_vif [None req-9bea29bc-a3ed-4082-aa99-622eed6c24c1 tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:8b:d0,bridge_name='br-int',has_traffic_filtering=True,id=9f035e65-b642-4b32-a5b2-1e82808c6ccc,network=Network(d463c254-d68d-4ea5-9642-08d9a1418f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f035e65-b6')
Oct 16 18:29:05 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-9bea29bc-a3ed-4082-aa99-622eed6c24c1 tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Deleting instance files /opt/stack/data/nova/instances/ff1e2d26-57c5-4aa1-b66f-3ead29571b7e_del
Oct 16 18:29:05 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-9bea29bc-a3ed-4082-aa99-622eed6c24c1 tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Deletion of /opt/stack/data/nova/instances/ff1e2d26-57c5-4aa1-b66f-3ead29571b7e_del complete
Oct 16 18:29:05 user nova-compute[74247]: INFO nova.compute.manager [None req-9bea29bc-a3ed-4082-aa99-622eed6c24c1 tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Took 1.43 seconds to destroy the instance on the hypervisor.
Oct 16 18:29:05 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-9bea29bc-a3ed-4082-aa99-622eed6c24c1 tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 18:29:05 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 18:29:05 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 18:29:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-9691880a-26d4-4791-8513-25d6c9e4c6fe req-6ee966ba-e501-438a-8e46-f49de9195e49 service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] Received event network-vif-plugged-8cb168df-92d2-4ecc-946a-7d9075f75561 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:29:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9691880a-26d4-4791-8513-25d6c9e4c6fe req-6ee966ba-e501-438a-8e46-f49de9195e49 service nova] Acquiring lock "a686ee86-272c-47be-8801-9c1500af272f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:29:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9691880a-26d4-4791-8513-25d6c9e4c6fe req-6ee966ba-e501-438a-8e46-f49de9195e49 service nova] Lock "a686ee86-272c-47be-8801-9c1500af272f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:29:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9691880a-26d4-4791-8513-25d6c9e4c6fe req-6ee966ba-e501-438a-8e46-f49de9195e49 service nova] Lock "a686ee86-272c-47be-8801-9c1500af272f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:29:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-9691880a-26d4-4791-8513-25d6c9e4c6fe req-6ee966ba-e501-438a-8e46-f49de9195e49 service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] No waiting events found dispatching network-vif-plugged-8cb168df-92d2-4ecc-946a-7d9075f75561 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:29:05 user nova-compute[74247]: WARNING nova.compute.manager [req-9691880a-26d4-4791-8513-25d6c9e4c6fe req-6ee966ba-e501-438a-8e46-f49de9195e49 service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] Received unexpected event network-vif-plugged-8cb168df-92d2-4ecc-946a-7d9075f75561 for instance with vm_state active and task_state resize_finish.
Oct 16 18:29:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:06 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:29:06 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Took 0.93 seconds to deallocate network for instance.
Oct 16 18:29:06 user nova-compute[74247]: DEBUG nova.compute.manager [req-81803078-dd33-4c1b-9cdc-7c1687f9c20f req-a69aa189-2fb1-4132-9ca9-93f884b70d4e service nova] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Received event network-vif-deleted-9f035e65-b642-4b32-a5b2-1e82808c6ccc {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:29:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-9bea29bc-a3ed-4082-aa99-622eed6c24c1 tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:29:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-9bea29bc-a3ed-4082-aa99-622eed6c24c1 tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:29:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:06 user nova-compute[74247]: DEBUG nova.compute.manager [req-fcc043ff-10f6-4798-a56a-59354bb0912a req-a8e24137-5f40-4c12-be55-5dcbe4560f8e service nova] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Received event network-vif-plugged-9f035e65-b642-4b32-a5b2-1e82808c6ccc {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:29:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-fcc043ff-10f6-4798-a56a-59354bb0912a req-a8e24137-5f40-4c12-be55-5dcbe4560f8e service nova] Acquiring lock "ff1e2d26-57c5-4aa1-b66f-3ead29571b7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:29:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-fcc043ff-10f6-4798-a56a-59354bb0912a req-a8e24137-5f40-4c12-be55-5dcbe4560f8e service nova] Lock "ff1e2d26-57c5-4aa1-b66f-3ead29571b7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:29:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-fcc043ff-10f6-4798-a56a-59354bb0912a req-a8e24137-5f40-4c12-be55-5dcbe4560f8e service nova] Lock "ff1e2d26-57c5-4aa1-b66f-3ead29571b7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:29:06 user nova-compute[74247]: DEBUG nova.compute.manager [req-fcc043ff-10f6-4798-a56a-59354bb0912a req-a8e24137-5f40-4c12-be55-5dcbe4560f8e service nova] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] No waiting events found dispatching network-vif-plugged-9f035e65-b642-4b32-a5b2-1e82808c6ccc {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:29:06 user nova-compute[74247]: WARNING nova.compute.manager [req-fcc043ff-10f6-4798-a56a-59354bb0912a req-a8e24137-5f40-4c12-be55-5dcbe4560f8e service nova] [instance: ff1e2d26-57c5-4aa1-b66f-3ead29571b7e] Received unexpected event network-vif-plugged-9f035e65-b642-4b32-a5b2-1e82808c6ccc for instance with vm_state deleted and task_state None.
Oct 16 18:29:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:29:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4daa6370-2cdf-4668-b66b-e10196377c9c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:06 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-9bea29bc-a3ed-4082-aa99-622eed6c24c1 tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:29:06 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-9bea29bc-a3ed-4082-aa99-622eed6c24c1 tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:29:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-9bea29bc-a3ed-4082-aa99-622eed6c24c1 tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.432s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:29:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4daa6370-2cdf-4668-b66b-e10196377c9c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4daa6370-2cdf-4668-b66b-e10196377c9c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:07 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-9bea29bc-a3ed-4082-aa99-622eed6c24c1 tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Deleted allocations for instance ff1e2d26-57c5-4aa1-b66f-3ead29571b7e
Oct 16 18:29:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-9bea29bc-a3ed-4082-aa99-622eed6c24c1 tempest-TestVolumeSwap-322864409 tempest-TestVolumeSwap-322864409-project-member] Lock "ff1e2d26-57c5-4aa1-b66f-3ead29571b7e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.010s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:29:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4daa6370-2cdf-4668-b66b-e10196377c9c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed0e45-071e-4c56-902d-42eacc97c2c1/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:07 user nova-compute[74247]: DEBUG nova.compute.manager [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:29:07 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: a686ee86-272c-47be-8801-9c1500af272f] Instance running successfully.
Oct 16 18:29:07 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Failed to set time: agent not configured {{(pid=74247) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 16 18:29:07 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-85e8a5a1-4f2a-48a0-a2ca-80e6fb0d8a83 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] finish_migration finished successfully. {{(pid=74247) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 16 18:29:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed0e45-071e-4c56-902d-42eacc97c2c1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed0e45-071e-4c56-902d-42eacc97c2c1/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:07 user nova-compute[74247]: DEBUG nova.compute.manager [req-43861efa-8a07-4128-973f-b249cd164359 req-504708c4-e5d3-4356-bd2c-ce7d042f65d8 service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] Received event network-vif-plugged-8cb168df-92d2-4ecc-946a-7d9075f75561 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:29:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-43861efa-8a07-4128-973f-b249cd164359 req-504708c4-e5d3-4356-bd2c-ce7d042f65d8 service nova] Acquiring lock "a686ee86-272c-47be-8801-9c1500af272f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:29:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-43861efa-8a07-4128-973f-b249cd164359 req-504708c4-e5d3-4356-bd2c-ce7d042f65d8 service nova] Lock "a686ee86-272c-47be-8801-9c1500af272f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:29:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-43861efa-8a07-4128-973f-b249cd164359 req-504708c4-e5d3-4356-bd2c-ce7d042f65d8 service nova] Lock "a686ee86-272c-47be-8801-9c1500af272f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:29:07 user nova-compute[74247]: DEBUG nova.compute.manager [req-43861efa-8a07-4128-973f-b249cd164359 req-504708c4-e5d3-4356-bd2c-ce7d042f65d8 service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] No waiting events found dispatching network-vif-plugged-8cb168df-92d2-4ecc-946a-7d9075f75561 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:29:07 user nova-compute[74247]: WARNING nova.compute.manager [req-43861efa-8a07-4128-973f-b249cd164359 req-504708c4-e5d3-4356-bd2c-ce7d042f65d8 service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] Received unexpected event network-vif-plugged-8cb168df-92d2-4ecc-946a-7d9075f75561 for instance with vm_state active and task_state resize_finish.
Oct 16 18:29:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed0e45-071e-4c56-902d-42eacc97c2c1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:08 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:29:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:09 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:29:09 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:29:09 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=7689MB free_disk=25.355884552001953GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 18:29:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:29:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:29:09 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Applying migration context for instance a686ee86-272c-47be-8801-9c1500af272f as it has an incoming, in-progress migration 5f5d97b0-24f7-49fa-a306-467fe63e51f3. Migration status is finished {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 16 18:29:09 user nova-compute[74247]: INFO nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: a686ee86-272c-47be-8801-9c1500af272f] Updating resource usage from migration 5f5d97b0-24f7-49fa-a306-467fe63e51f3
Oct 16 18:29:09 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:29:09 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance e37fbc27-3404-479a-be08-4d590391cf30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:29:09 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 4daa6370-2cdf-4668-b66b-e10196377c9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:29:09 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:29:09 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 16ed0e45-071e-4c56-902d-42eacc97c2c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:29:09 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance bbec99d1-82a3-4e4d-a3ae-17e00821bee1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:29:09 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 7c17a25b-6818-48fa-b406-638dbf1845d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:29:09 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Migration 5f5d97b0-24f7-49fa-a306-467fe63e51f3 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 16 18:29:09 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance a686ee86-272c-47be-8801-9c1500af272f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:29:09 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 18:29:09 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 18:29:09 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:29:09 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:29:09 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 18:29:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.512s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:29:10 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:10 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:34 user nova-compute[74247]: DEBUG nova.compute.manager [req-c77343e6-629a-457a-86f4-cac02b890a08 req-c2d9a5b4-a4a1-4d52-9ca8-2a2268273aba service nova] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Received event network-changed-db973a04-4ef6-40c2-a694-c7a12631bc59 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:29:34 user nova-compute[74247]: DEBUG nova.compute.manager [req-c77343e6-629a-457a-86f4-cac02b890a08 req-c2d9a5b4-a4a1-4d52-9ca8-2a2268273aba service nova] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Refreshing instance network info cache due to event network-changed-db973a04-4ef6-40c2-a694-c7a12631bc59. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:29:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c77343e6-629a-457a-86f4-cac02b890a08 req-c2d9a5b4-a4a1-4d52-9ca8-2a2268273aba service nova] Acquiring lock "refresh_cache-bbec99d1-82a3-4e4d-a3ae-17e00821bee1" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:29:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c77343e6-629a-457a-86f4-cac02b890a08 req-c2d9a5b4-a4a1-4d52-9ca8-2a2268273aba service nova] Acquired lock "refresh_cache-bbec99d1-82a3-4e4d-a3ae-17e00821bee1" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:29:34 user nova-compute[74247]: DEBUG nova.network.neutron [req-c77343e6-629a-457a-86f4-cac02b890a08 req-c2d9a5b4-a4a1-4d52-9ca8-2a2268273aba service nova] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Refreshing network info cache for port db973a04-4ef6-40c2-a694-c7a12631bc59 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:29:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:35 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "bbec99d1-82a3-4e4d-a3ae-17e00821bee1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:29:35 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "bbec99d1-82a3-4e4d-a3ae-17e00821bee1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:29:35 user nova-compute[74247]: DEBUG nova.objects.instance [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lazy-loading 'flavor' on Instance uuid bbec99d1-82a3-4e4d-a3ae-17e00821bee1 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:29:35 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "bbec99d1-82a3-4e4d-a3ae-17e00821bee1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.089s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:29:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "bbec99d1-82a3-4e4d-a3ae-17e00821bee1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:29:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "bbec99d1-82a3-4e4d-a3ae-17e00821bee1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:29:36 user nova-compute[74247]: INFO nova.compute.manager [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Attaching volume 91e22910-3fb9-43fd-ac65-70fb0215b313 to /dev/vdb
Oct 16 18:29:36 user nova-compute[74247]: DEBUG os_brick.utils [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:29:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:36 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a678b85-0035-4c27-a210-d17e80930e8a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:29:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:36 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee7826b-2cc0-4623-bd7f-bd7c1a951817]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:29:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:36 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f15c41-b28f-4fbc-8e0b-e3347c131a44]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:29:36 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[07988144-8965-4374-b2bc-b94106d06e57]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:29:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:29:36 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 18:29:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:29:36 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 18:29:36 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c69d07-f5f6-4128-9da0-ff07b231082e]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:29:36 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 18:29:36 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 18:29:36 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 18:29:36 user nova-compute[74247]: DEBUG os_brick.utils [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:29:36 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Updating existing volume attachment record: c7e8a654-b6a7-4ad0-bde9-f31b43a3d6d6 {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 18:29:36 user nova-compute[74247]: DEBUG nova.network.neutron [req-c77343e6-629a-457a-86f4-cac02b890a08 req-c2d9a5b4-a4a1-4d52-9ca8-2a2268273aba service nova] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Updated VIF entry in instance network info cache for port db973a04-4ef6-40c2-a694-c7a12631bc59. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:29:36 user nova-compute[74247]: DEBUG nova.network.neutron [req-c77343e6-629a-457a-86f4-cac02b890a08 req-c2d9a5b4-a4a1-4d52-9ca8-2a2268273aba service nova] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Updating instance_info_cache with network_info: [{"id": "db973a04-4ef6-40c2-a694-c7a12631bc59", "address": "fa:16:3e:d4:26:c0", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb973a04-4e", "ovs_interfaceid": "db973a04-4ef6-40c2-a694-c7a12631bc59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:29:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c77343e6-629a-457a-86f4-cac02b890a08 req-c2d9a5b4-a4a1-4d52-9ca8-2a2268273aba service nova] Releasing lock "refresh_cache-bbec99d1-82a3-4e4d-a3ae-17e00821bee1" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:29:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:40 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:40 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Acquiring lock "7fa3da6f-ba9f-4752-901a-933427fcbda8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:29:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:29:41 user nova-compute[74247]: DEBUG nova.compute.manager [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 18:29:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:29:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:29:41 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:29:41 user nova-compute[74247]: INFO nova.compute.claims [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Claim successful on node user
Oct 16 18:29:42 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:29:42 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:29:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.513s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:29:42 user nova-compute[74247]: DEBUG nova.compute.manager [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 18:29:42 user nova-compute[74247]: DEBUG nova.compute.manager [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 18:29:42 user nova-compute[74247]: DEBUG nova.network.neutron [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 18:29:42 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 18:29:42 user nova-compute[74247]: DEBUG nova.compute.manager [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 18:29:42 user nova-compute[74247]: INFO nova.virt.block_device [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Booting with volume 2e2502cf-023d-406e-8618-c7c75907ae93 at /dev/vda
Oct 16 18:29:42 user nova-compute[74247]: DEBUG nova.policy [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e7ccba53dfe84ade9e0ce346b9eb3420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90038686fba435a8e52f00df40b3ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 18:29:42 user nova-compute[74247]: DEBUG os_brick.utils [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:29:42 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:42 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:42 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[841cfdaf-38b3-48e5-84be-1c6609c24203]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:29:42 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:42 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:42 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[35715e2e-b032-4ded-b6f1-81b935995f85]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:29:42 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:42 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:42 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[480d882c-0f1d-4b49-8d2f-e92c8c7f4211]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:29:42 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1dba42-91d0-489c-b837-12ddeb455219]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:29:42 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:42 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:29:42 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 18:29:42 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:42 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:29:42 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 18:29:42 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc0a85e-94f9-493c-b45f-17f69ff8005a]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:29:42 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 18:29:42 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 18:29:42 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 18:29:42 user nova-compute[74247]: DEBUG os_brick.utils [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:29:42 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Updating existing volume attachment record: 54fc3012-b619-4d95-9958-d9335f609b18 {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 18:29:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:43 user nova-compute[74247]: DEBUG nova.network.neutron [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Successfully created port: a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11 {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:29:43 user nova-compute[74247]: DEBUG nova.network.neutron [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Successfully created port: 1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:29:44 user nova-compute[74247]: DEBUG nova.network.neutron [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Successfully created port: 2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5 {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:29:45 user nova-compute[74247]: DEBUG nova.network.neutron [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Successfully created port: a815917f-f1ec-48f2-b272-97bf2ad1d6cd {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:29:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:45 user nova-compute[74247]: DEBUG nova.compute.manager [req-6c17ac04-d178-4948-843f-b31e0a2a7a7b req-d483340c-2f9d-4813-badc-5e3a09008978 service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Received event network-changed-5f5253f2-6e79-44f0-a4aa-167f273e7c6a {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:29:45 user nova-compute[74247]: DEBUG nova.compute.manager [req-6c17ac04-d178-4948-843f-b31e0a2a7a7b req-d483340c-2f9d-4813-badc-5e3a09008978 service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Refreshing instance network info cache due to event network-changed-5f5253f2-6e79-44f0-a4aa-167f273e7c6a. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:29:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-6c17ac04-d178-4948-843f-b31e0a2a7a7b req-d483340c-2f9d-4813-badc-5e3a09008978 service nova] Acquiring lock "refresh_cache-7c17a25b-6818-48fa-b406-638dbf1845d4" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:29:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-6c17ac04-d178-4948-843f-b31e0a2a7a7b req-d483340c-2f9d-4813-badc-5e3a09008978 service nova] Acquired lock "refresh_cache-7c17a25b-6818-48fa-b406-638dbf1845d4" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:29:45 user nova-compute[74247]: DEBUG nova.network.neutron [req-6c17ac04-d178-4948-843f-b31e0a2a7a7b req-d483340c-2f9d-4813-badc-5e3a09008978 service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Refreshing network info cache for port 5f5253f2-6e79-44f0-a4aa-167f273e7c6a {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:29:45 user nova-compute[74247]: DEBUG nova.network.neutron [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Successfully created port: 23684bac-dba0-4fdd-80d3-750ed2a77731 {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:29:46 user nova-compute[74247]: DEBUG nova.network.neutron [req-6c17ac04-d178-4948-843f-b31e0a2a7a7b req-d483340c-2f9d-4813-badc-5e3a09008978 service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Updated VIF entry in instance network info cache for port 5f5253f2-6e79-44f0-a4aa-167f273e7c6a. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:29:46 user nova-compute[74247]: DEBUG nova.network.neutron [req-6c17ac04-d178-4948-843f-b31e0a2a7a7b req-d483340c-2f9d-4813-badc-5e3a09008978 service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Updating instance_info_cache with network_info: [{"id": "5f5253f2-6e79-44f0-a4aa-167f273e7c6a", "address": "fa:16:3e:f9:f6:64", "network": {"id": "b8a52a8d-7eca-40b7-b94b-820a4ab8687b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1308054402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "021c1d91069e4798af2caae2c29694ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5253f2-6e", "ovs_interfaceid": "5f5253f2-6e79-44f0-a4aa-167f273e7c6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:29:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-6c17ac04-d178-4948-843f-b31e0a2a7a7b req-d483340c-2f9d-4813-badc-5e3a09008978 service nova] Releasing lock "refresh_cache-7c17a25b-6818-48fa-b406-638dbf1845d4" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:29:46 user nova-compute[74247]: DEBUG nova.network.neutron [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Successfully updated port: a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11 {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:29:46 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:29:46 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Cleaning up deleted instances {{(pid=74247) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 16 18:29:46 user nova-compute[74247]: DEBUG nova.compute.manager [req-4d298c6f-736d-493b-82c2-34bbe6070381 req-da6e0b8e-fe16-4e0d-8886-d6bfa5dd77fa service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-changed-a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:29:46 user nova-compute[74247]: DEBUG nova.compute.manager [req-4d298c6f-736d-493b-82c2-34bbe6070381 req-da6e0b8e-fe16-4e0d-8886-d6bfa5dd77fa service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Refreshing instance network info cache due to event network-changed-a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:29:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4d298c6f-736d-493b-82c2-34bbe6070381 req-da6e0b8e-fe16-4e0d-8886-d6bfa5dd77fa service nova] Acquiring lock "refresh_cache-7fa3da6f-ba9f-4752-901a-933427fcbda8" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:29:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4d298c6f-736d-493b-82c2-34bbe6070381 req-da6e0b8e-fe16-4e0d-8886-d6bfa5dd77fa service nova] Acquired lock "refresh_cache-7fa3da6f-ba9f-4752-901a-933427fcbda8" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:29:46 user nova-compute[74247]: DEBUG nova.network.neutron [req-4d298c6f-736d-493b-82c2-34bbe6070381 req-da6e0b8e-fe16-4e0d-8886-d6bfa5dd77fa service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Refreshing network info cache for port a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:29:46 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] There are 0 instances to clean {{(pid=74247) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 16 18:29:46 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:29:46 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Cleaning up deleted instances with incomplete migration  {{(pid=74247) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 16 18:29:46 user nova-compute[74247]: DEBUG nova.network.neutron [req-4d298c6f-736d-493b-82c2-34bbe6070381 req-da6e0b8e-fe16-4e0d-8886-d6bfa5dd77fa service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:29:46 user nova-compute[74247]: DEBUG nova.network.neutron [req-4d298c6f-736d-493b-82c2-34bbe6070381 req-da6e0b8e-fe16-4e0d-8886-d6bfa5dd77fa service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:29:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4d298c6f-736d-493b-82c2-34bbe6070381 req-da6e0b8e-fe16-4e0d-8886-d6bfa5dd77fa service nova] Releasing lock "refresh_cache-7fa3da6f-ba9f-4752-901a-933427fcbda8" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:29:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:47 user nova-compute[74247]: DEBUG nova.compute.manager [None req-e48a766d-997c-4f60-9b0e-9b5978e64a34 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:29:47 user nova-compute[74247]: INFO nova.compute.manager [None req-e48a766d-997c-4f60-9b0e-9b5978e64a34 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] instance snapshotting
Oct 16 18:29:47 user nova-compute[74247]: DEBUG nova.network.neutron [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Successfully updated port: 40eb3a07-e825-44ad-9077-c1880b1e8768 {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:29:47 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-e48a766d-997c-4f60-9b0e-9b5978e64a34 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Beginning live snapshot process
Oct 16 18:29:47 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:29:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-e48a766d-997c-4f60-9b0e-9b5978e64a34 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk --force-share --output=json -f qcow2 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-e48a766d-997c-4f60-9b0e-9b5978e64a34 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk --force-share --output=json -f qcow2" returned: 0 in 0.185s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-e48a766d-997c-4f60-9b0e-9b5978e64a34 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk --force-share --output=json -f qcow2 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:48 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-e48a766d-997c-4f60-9b0e-9b5978e64a34 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk --force-share --output=json -f qcow2" returned: 0 in 0.215s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:48 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-e48a766d-997c-4f60-9b0e-9b5978e64a34 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:48 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-e48a766d-997c-4f60-9b0e-9b5978e64a34 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.210s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:48 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-e48a766d-997c-4f60-9b0e-9b5978e64a34 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdhs52t91/13a3500032f140138fb56fe14e2693f5.delta 1073741824 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:48 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-e48a766d-997c-4f60-9b0e-9b5978e64a34 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdhs52t91/13a3500032f140138fb56fe14e2693f5.delta 1073741824" returned: 0 in 0.062s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:48 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-e48a766d-997c-4f60-9b0e-9b5978e64a34 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 16 18:29:48 user nova-compute[74247]: DEBUG nova.network.neutron [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Successfully updated port: 2813ff58-0b02-4da1-8774-ad7452da7d78 {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:29:48 user nova-compute[74247]: DEBUG nova.compute.manager [req-27c695b5-b5dd-4324-88c9-5f45b1eed696 req-33778a78-3721-4f08-b62a-cc0eb59bd82b service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-changed-40eb3a07-e825-44ad-9077-c1880b1e8768 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:29:48 user nova-compute[74247]: DEBUG nova.compute.manager [req-27c695b5-b5dd-4324-88c9-5f45b1eed696 req-33778a78-3721-4f08-b62a-cc0eb59bd82b service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Refreshing instance network info cache due to event network-changed-40eb3a07-e825-44ad-9077-c1880b1e8768. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:29:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-27c695b5-b5dd-4324-88c9-5f45b1eed696 req-33778a78-3721-4f08-b62a-cc0eb59bd82b service nova] Acquiring lock "refresh_cache-7fa3da6f-ba9f-4752-901a-933427fcbda8" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:29:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-27c695b5-b5dd-4324-88c9-5f45b1eed696 req-33778a78-3721-4f08-b62a-cc0eb59bd82b service nova] Acquired lock "refresh_cache-7fa3da6f-ba9f-4752-901a-933427fcbda8" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:29:48 user nova-compute[74247]: DEBUG nova.network.neutron [req-27c695b5-b5dd-4324-88c9-5f45b1eed696 req-33778a78-3721-4f08-b62a-cc0eb59bd82b service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Refreshing network info cache for port 40eb3a07-e825-44ad-9077-c1880b1e8768 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:29:48 user nova-compute[74247]: DEBUG nova.network.neutron [req-27c695b5-b5dd-4324-88c9-5f45b1eed696 req-33778a78-3721-4f08-b62a-cc0eb59bd82b service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:29:49 user nova-compute[74247]: DEBUG nova.network.neutron [req-27c695b5-b5dd-4324-88c9-5f45b1eed696 req-33778a78-3721-4f08-b62a-cc0eb59bd82b service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:29:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-27c695b5-b5dd-4324-88c9-5f45b1eed696 req-33778a78-3721-4f08-b62a-cc0eb59bd82b service nova] Releasing lock "refresh_cache-7fa3da6f-ba9f-4752-901a-933427fcbda8" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:29:49 user nova-compute[74247]: DEBUG nova.compute.manager [req-27c695b5-b5dd-4324-88c9-5f45b1eed696 req-33778a78-3721-4f08-b62a-cc0eb59bd82b service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-changed-2813ff58-0b02-4da1-8774-ad7452da7d78 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:29:49 user nova-compute[74247]: DEBUG nova.compute.manager [req-27c695b5-b5dd-4324-88c9-5f45b1eed696 req-33778a78-3721-4f08-b62a-cc0eb59bd82b service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Refreshing instance network info cache due to event network-changed-2813ff58-0b02-4da1-8774-ad7452da7d78. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:29:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-27c695b5-b5dd-4324-88c9-5f45b1eed696 req-33778a78-3721-4f08-b62a-cc0eb59bd82b service nova] Acquiring lock "refresh_cache-7fa3da6f-ba9f-4752-901a-933427fcbda8" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:29:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-27c695b5-b5dd-4324-88c9-5f45b1eed696 req-33778a78-3721-4f08-b62a-cc0eb59bd82b service nova] Acquired lock "refresh_cache-7fa3da6f-ba9f-4752-901a-933427fcbda8" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:29:49 user nova-compute[74247]: DEBUG nova.network.neutron [req-27c695b5-b5dd-4324-88c9-5f45b1eed696 req-33778a78-3721-4f08-b62a-cc0eb59bd82b service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Refreshing network info cache for port 2813ff58-0b02-4da1-8774-ad7452da7d78 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:29:49 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-e48a766d-997c-4f60-9b0e-9b5978e64a34 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 18:29:49 user nova-compute[74247]: DEBUG nova.network.neutron [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Successfully updated port: 1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:29:49 user nova-compute[74247]: DEBUG nova.network.neutron [req-27c695b5-b5dd-4324-88c9-5f45b1eed696 req-33778a78-3721-4f08-b62a-cc0eb59bd82b service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:29:49 user nova-compute[74247]: DEBUG nova.network.neutron [req-27c695b5-b5dd-4324-88c9-5f45b1eed696 req-33778a78-3721-4f08-b62a-cc0eb59bd82b service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:29:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-27c695b5-b5dd-4324-88c9-5f45b1eed696 req-33778a78-3721-4f08-b62a-cc0eb59bd82b service nova] Releasing lock "refresh_cache-7fa3da6f-ba9f-4752-901a-933427fcbda8" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:29:49 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-e48a766d-997c-4f60-9b0e-9b5978e64a34 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] COPY block job progress, current cursor: 75497471 final cursor: 75497472 {{(pid=74247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 18:29:50 user nova-compute[74247]: DEBUG nova.network.neutron [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Successfully updated port: 2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5 {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:29:50 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-e48a766d-997c-4f60-9b0e-9b5978e64a34 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 18:29:50 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-e48a766d-997c-4f60-9b0e-9b5978e64a34 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 16 18:29:50 user nova-compute[74247]: DEBUG nova.privsep.utils [None req-e48a766d-997c-4f60-9b0e-9b5978e64a34 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74247) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 18:29:50 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-e48a766d-997c-4f60-9b0e-9b5978e64a34 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdhs52t91/13a3500032f140138fb56fe14e2693f5.delta /opt/stack/data/nova/instances/snapshots/tmpdhs52t91/13a3500032f140138fb56fe14e2693f5 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:50 user nova-compute[74247]: DEBUG nova.compute.manager [req-cc9e7fb0-01ab-455d-b1fd-b1f6da2b8adb req-ed829cfe-8dde-4ae2-87c4-1a5ec4127db2 service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-changed-1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:29:50 user nova-compute[74247]: DEBUG nova.compute.manager [req-cc9e7fb0-01ab-455d-b1fd-b1f6da2b8adb req-ed829cfe-8dde-4ae2-87c4-1a5ec4127db2 service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Refreshing instance network info cache due to event network-changed-1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:29:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-cc9e7fb0-01ab-455d-b1fd-b1f6da2b8adb req-ed829cfe-8dde-4ae2-87c4-1a5ec4127db2 service nova] Acquiring lock "refresh_cache-7fa3da6f-ba9f-4752-901a-933427fcbda8" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:29:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-cc9e7fb0-01ab-455d-b1fd-b1f6da2b8adb req-ed829cfe-8dde-4ae2-87c4-1a5ec4127db2 service nova] Acquired lock "refresh_cache-7fa3da6f-ba9f-4752-901a-933427fcbda8" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:29:50 user nova-compute[74247]: DEBUG nova.network.neutron [req-cc9e7fb0-01ab-455d-b1fd-b1f6da2b8adb req-ed829cfe-8dde-4ae2-87c4-1a5ec4127db2 service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Refreshing network info cache for port 1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:29:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:50 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-e48a766d-997c-4f60-9b0e-9b5978e64a34 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdhs52t91/13a3500032f140138fb56fe14e2693f5.delta /opt/stack/data/nova/instances/snapshots/tmpdhs52t91/13a3500032f140138fb56fe14e2693f5" returned: 0 in 0.428s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:50 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-e48a766d-997c-4f60-9b0e-9b5978e64a34 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Snapshot extracted, beginning image upload
Oct 16 18:29:50 user nova-compute[74247]: DEBUG nova.network.neutron [req-cc9e7fb0-01ab-455d-b1fd-b1f6da2b8adb req-ed829cfe-8dde-4ae2-87c4-1a5ec4127db2 service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:29:51 user nova-compute[74247]: DEBUG nova.network.neutron [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Successfully updated port: a815917f-f1ec-48f2-b272-97bf2ad1d6cd {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:29:51 user nova-compute[74247]: DEBUG nova.network.neutron [req-cc9e7fb0-01ab-455d-b1fd-b1f6da2b8adb req-ed829cfe-8dde-4ae2-87c4-1a5ec4127db2 service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:29:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-cc9e7fb0-01ab-455d-b1fd-b1f6da2b8adb req-ed829cfe-8dde-4ae2-87c4-1a5ec4127db2 service nova] Releasing lock "refresh_cache-7fa3da6f-ba9f-4752-901a-933427fcbda8" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:29:51 user nova-compute[74247]: DEBUG nova.compute.manager [req-cc9e7fb0-01ab-455d-b1fd-b1f6da2b8adb req-ed829cfe-8dde-4ae2-87c4-1a5ec4127db2 service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-changed-2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:29:51 user nova-compute[74247]: DEBUG nova.compute.manager [req-cc9e7fb0-01ab-455d-b1fd-b1f6da2b8adb req-ed829cfe-8dde-4ae2-87c4-1a5ec4127db2 service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Refreshing instance network info cache due to event network-changed-2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:29:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-cc9e7fb0-01ab-455d-b1fd-b1f6da2b8adb req-ed829cfe-8dde-4ae2-87c4-1a5ec4127db2 service nova] Acquiring lock "refresh_cache-7fa3da6f-ba9f-4752-901a-933427fcbda8" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:29:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-cc9e7fb0-01ab-455d-b1fd-b1f6da2b8adb req-ed829cfe-8dde-4ae2-87c4-1a5ec4127db2 service nova] Acquired lock "refresh_cache-7fa3da6f-ba9f-4752-901a-933427fcbda8" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:29:51 user nova-compute[74247]: DEBUG nova.network.neutron [req-cc9e7fb0-01ab-455d-b1fd-b1f6da2b8adb req-ed829cfe-8dde-4ae2-87c4-1a5ec4127db2 service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Refreshing network info cache for port 2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:29:51 user nova-compute[74247]: DEBUG nova.network.neutron [req-cc9e7fb0-01ab-455d-b1fd-b1f6da2b8adb req-ed829cfe-8dde-4ae2-87c4-1a5ec4127db2 service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:29:51 user nova-compute[74247]: DEBUG nova.network.neutron [req-cc9e7fb0-01ab-455d-b1fd-b1f6da2b8adb req-ed829cfe-8dde-4ae2-87c4-1a5ec4127db2 service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:29:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-cc9e7fb0-01ab-455d-b1fd-b1f6da2b8adb req-ed829cfe-8dde-4ae2-87c4-1a5ec4127db2 service nova] Releasing lock "refresh_cache-7fa3da6f-ba9f-4752-901a-933427fcbda8" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:29:51 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:29:51 user nova-compute[74247]: DEBUG nova.network.neutron [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Successfully updated port: 23684bac-dba0-4fdd-80d3-750ed2a77731 {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:29:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Acquiring lock "refresh_cache-7fa3da6f-ba9f-4752-901a-933427fcbda8" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:29:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Acquired lock "refresh_cache-7fa3da6f-ba9f-4752-901a-933427fcbda8" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:29:51 user nova-compute[74247]: DEBUG nova.network.neutron [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:29:51 user nova-compute[74247]: DEBUG nova.network.neutron [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:29:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:52 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:29:52 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:29:52 user nova-compute[74247]: DEBUG nova.compute.manager [req-1d2a7f82-c089-4676-ba87-f4995cc6bf66 req-60a401bc-c3e1-4150-9765-70adf3e3c2fb service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-changed-a815917f-f1ec-48f2-b272-97bf2ad1d6cd {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:29:52 user nova-compute[74247]: DEBUG nova.compute.manager [req-1d2a7f82-c089-4676-ba87-f4995cc6bf66 req-60a401bc-c3e1-4150-9765-70adf3e3c2fb service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Refreshing instance network info cache due to event network-changed-a815917f-f1ec-48f2-b272-97bf2ad1d6cd. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:29:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1d2a7f82-c089-4676-ba87-f4995cc6bf66 req-60a401bc-c3e1-4150-9765-70adf3e3c2fb service nova] Acquiring lock "refresh_cache-7fa3da6f-ba9f-4752-901a-933427fcbda8" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:29:53 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:29:53 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:29:53 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-e48a766d-997c-4f60-9b0e-9b5978e64a34 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Snapshot image upload complete
Oct 16 18:29:53 user nova-compute[74247]: INFO nova.compute.manager [None req-e48a766d-997c-4f60-9b0e-9b5978e64a34 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Took 6.49 seconds to snapshot the instance on the hypervisor.
Oct 16 18:29:54 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:29:54 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:29:54 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 18:29:54 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Rebuilding the list of instances to heal {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 18:29:54 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Skipping network cache update for instance because it is Building. {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 16 18:29:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Acquiring lock "d4c23a0a-d5cb-4893-9a40-4586e98a2535" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:29:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Lock "d4c23a0a-d5cb-4893-9a40-4586e98a2535" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:29:54 user nova-compute[74247]: DEBUG nova.compute.manager [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 18:29:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "refresh_cache-b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:29:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquired lock "refresh_cache-b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:29:54 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Forcefully refreshing network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 18:29:54 user nova-compute[74247]: DEBUG nova.objects.instance [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lazy-loading 'info_cache' on Instance uuid b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:29:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:29:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:29:55 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:29:55 user nova-compute[74247]: INFO nova.compute.claims [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Claim successful on node user
Oct 16 18:29:55 user nova-compute[74247]: DEBUG nova.network.neutron [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Updating instance_info_cache with network_info: [{"id": "a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11", "address": "fa:16:3e:7e:13:34", "network": {"id": "43dd1e8a-1185-462c-9421-d0d7b2d90334", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1360889325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ea7e01-7e", "ovs_interfaceid": "a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40eb3a07-e825-44ad-9077-c1880b1e8768", "address": "fa:16:3e:ef:f1:d7", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40eb3a07-e8", "ovs_interfaceid": "40eb3a07-e825-44ad-9077-c1880b1e8768", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2813ff58-0b02-4da1-8774-ad7452da7d78", "address": "fa:16:3e:56:f0:e9", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2813ff58-0b", "ovs_interfaceid": "2813ff58-0b02-4da1-8774-ad7452da7d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec", "address": "fa:16:3e:32:8d:af", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dbd4bf3-bf", "ovs_interfaceid": "1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5", "address": "fa:16:3e:73:c9:16", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9f5274-68", "ovs_interfaceid": "2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a815917f-f1ec-48f2-b272-97bf2ad1d6cd", "address": "fa:16:3e:22:3b:ee", "network": {"id": "20ec901d-4e30-4c4a-ab56-7d57878cfdcc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1805797092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa815917f-f1", "ovs_interfaceid": "a815917f-f1ec-48f2-b272-97bf2ad1d6cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23684bac-dba0-4fdd-80d3-750ed2a77731", "address": "fa:16:3e:46:79:42", "network": {"id": "20ec901d-4e30-4c4a-ab56-7d57878cfdcc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1805797092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23684bac-db", "ovs_interfaceid": "23684bac-dba0-4fdd-80d3-750ed2a77731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:29:55 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Refreshing inventories for resource provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 16 18:29:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Releasing lock "refresh_cache-7fa3da6f-ba9f-4752-901a-933427fcbda8" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:29:55 user nova-compute[74247]: DEBUG nova.compute.manager [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Instance network_info: |[{"id": "a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11", "address": "fa:16:3e:7e:13:34", "network": {"id": "43dd1e8a-1185-462c-9421-d0d7b2d90334", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1360889325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ea7e01-7e", "ovs_interfaceid": "a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40eb3a07-e825-44ad-9077-c1880b1e8768", "address": "fa:16:3e:ef:f1:d7", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40eb3a07-e8", "ovs_interfaceid": "40eb3a07-e825-44ad-9077-c1880b1e8768", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2813ff58-0b02-4da1-8774-ad7452da7d78", "address": "fa:16:3e:56:f0:e9", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2813ff58-0b", "ovs_interfaceid": "2813ff58-0b02-4da1-8774-ad7452da7d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec", "address": "fa:16:3e:32:8d:af", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dbd4bf3-bf", "ovs_interfaceid": "1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5", "address": "fa:16:3e:73:c9:16", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9f5274-68", "ovs_interfaceid": "2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a815917f-f1ec-48f2-b272-97bf2ad1d6cd", "address": "fa:16:3e:22:3b:ee", "network": {"id": "20ec901d-4e30-4c4a-ab56-7d57878cfdcc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1805797092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa815917f-f1", "ovs_interfaceid": "a815917f-f1ec-48f2-b272-97bf2ad1d6cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23684bac-dba0-4fdd-80d3-750ed2a77731", "address": "fa:16:3e:46:79:42", "network": {"id": "20ec901d-4e30-4c4a-ab56-7d57878cfdcc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1805797092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23684bac-db", "ovs_interfaceid": "23684bac-dba0-4fdd-80d3-750ed2a77731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 18:29:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1d2a7f82-c089-4676-ba87-f4995cc6bf66 req-60a401bc-c3e1-4150-9765-70adf3e3c2fb service nova] Acquired lock "refresh_cache-7fa3da6f-ba9f-4752-901a-933427fcbda8" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:29:55 user nova-compute[74247]: DEBUG nova.network.neutron [req-1d2a7f82-c089-4676-ba87-f4995cc6bf66 req-60a401bc-c3e1-4150-9765-70adf3e3c2fb service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Refreshing network info cache for port a815917f-f1ec-48f2-b272-97bf2ad1d6cd {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:29:55 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Updating ProviderTree inventory for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 16 18:29:55 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Updating inventory in ProviderTree for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 16 18:29:55 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Refreshing aggregate associations for resource provider 7b8a7b7b-c686-4162-903b-700fbc4d7273, aggregates: None {{(pid=74247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 16 18:29:55 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Refreshing trait associations for resource provider 7b8a7b7b-c686-4162-903b-700fbc4d7273, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=74247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 16 18:29:55 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Updating instance_info_cache with network_info: [{"id": "f4db2672-7205-43d7-ac3b-3f6ea5c336c6", "address": "fa:16:3e:5f:52:2e", "network": {"id": "f99cbf0c-7d0c-4ef8-934a-aaac218e9381", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2096188408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94e9d0485eec462990dd029379397962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4db2672-72", "ovs_interfaceid": "f4db2672-7205-43d7-ac3b-3f6ea5c336c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:29:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Releasing lock "refresh_cache-b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:29:55 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Updated the network info_cache for instance {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 18:29:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:55 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:29:55 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:29:55 user nova-compute[74247]: DEBUG nova.network.neutron [req-1d2a7f82-c089-4676-ba87-f4995cc6bf66 req-60a401bc-c3e1-4150-9765-70adf3e3c2fb service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Updated VIF entry in instance network info cache for port a815917f-f1ec-48f2-b272-97bf2ad1d6cd. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:29:55 user nova-compute[74247]: DEBUG nova.network.neutron [req-1d2a7f82-c089-4676-ba87-f4995cc6bf66 req-60a401bc-c3e1-4150-9765-70adf3e3c2fb service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Updating instance_info_cache with network_info: [{"id": "a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11", "address": "fa:16:3e:7e:13:34", "network": {"id": "43dd1e8a-1185-462c-9421-d0d7b2d90334", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1360889325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ea7e01-7e", "ovs_interfaceid": "a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40eb3a07-e825-44ad-9077-c1880b1e8768", "address": "fa:16:3e:ef:f1:d7", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40eb3a07-e8", "ovs_interfaceid": "40eb3a07-e825-44ad-9077-c1880b1e8768", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2813ff58-0b02-4da1-8774-ad7452da7d78", "address": "fa:16:3e:56:f0:e9", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2813ff58-0b", "ovs_interfaceid": "2813ff58-0b02-4da1-8774-ad7452da7d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec", "address": "fa:16:3e:32:8d:af", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dbd4bf3-bf", "ovs_interfaceid": "1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5", "address": "fa:16:3e:73:c9:16", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9f5274-68", "ovs_interfaceid": "2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a815917f-f1ec-48f2-b272-97bf2ad1d6cd", "address": "fa:16:3e:22:3b:ee", "network": {"id": "20ec901d-4e30-4c4a-ab56-7d57878cfdcc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1805797092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa815917f-f1", "ovs_interfaceid": "a815917f-f1ec-48f2-b272-97bf2ad1d6cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23684bac-dba0-4fdd-80d3-750ed2a77731", "address": "fa:16:3e:46:79:42", "network": {"id": "20ec901d-4e30-4c4a-ab56-7d57878cfdcc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1805797092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23684bac-db", "ovs_interfaceid": "23684bac-dba0-4fdd-80d3-750ed2a77731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:29:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.779s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:29:55 user nova-compute[74247]: DEBUG nova.compute.manager [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 18:29:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1d2a7f82-c089-4676-ba87-f4995cc6bf66 req-60a401bc-c3e1-4150-9765-70adf3e3c2fb service nova] Releasing lock "refresh_cache-7fa3da6f-ba9f-4752-901a-933427fcbda8" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:29:55 user nova-compute[74247]: DEBUG nova.compute.manager [req-1d2a7f82-c089-4676-ba87-f4995cc6bf66 req-60a401bc-c3e1-4150-9765-70adf3e3c2fb service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-changed-23684bac-dba0-4fdd-80d3-750ed2a77731 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:29:55 user nova-compute[74247]: DEBUG nova.compute.manager [req-1d2a7f82-c089-4676-ba87-f4995cc6bf66 req-60a401bc-c3e1-4150-9765-70adf3e3c2fb service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Refreshing instance network info cache due to event network-changed-23684bac-dba0-4fdd-80d3-750ed2a77731. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:29:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1d2a7f82-c089-4676-ba87-f4995cc6bf66 req-60a401bc-c3e1-4150-9765-70adf3e3c2fb service nova] Acquiring lock "refresh_cache-7fa3da6f-ba9f-4752-901a-933427fcbda8" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:29:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1d2a7f82-c089-4676-ba87-f4995cc6bf66 req-60a401bc-c3e1-4150-9765-70adf3e3c2fb service nova] Acquired lock "refresh_cache-7fa3da6f-ba9f-4752-901a-933427fcbda8" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:29:55 user nova-compute[74247]: DEBUG nova.network.neutron [req-1d2a7f82-c089-4676-ba87-f4995cc6bf66 req-60a401bc-c3e1-4150-9765-70adf3e3c2fb service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Refreshing network info cache for port 23684bac-dba0-4fdd-80d3-750ed2a77731 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:29:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:55 user nova-compute[74247]: DEBUG nova.compute.manager [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 18:29:55 user nova-compute[74247]: DEBUG nova.network.neutron [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 18:29:55 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Oct 16 18:29:55 user nova-compute[74247]: DEBUG nova.compute.manager [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 18:29:55 user nova-compute[74247]: DEBUG nova.policy [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0cebea5593d0403389777c0c9b0d0372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a018057c194fc497ad8476dd290a69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 18:29:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Acquiring lock "73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:29:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Lock "73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:29:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Acquiring lock "73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:29:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Lock "73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:29:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Lock "73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:29:55 user nova-compute[74247]: INFO nova.compute.manager [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Terminating instance
Oct 16 18:29:55 user nova-compute[74247]: DEBUG nova.compute.manager [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG nova.compute.manager [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:29:56 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Creating image(s)
Oct 16 18:29:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Acquiring lock "/opt/stack/data/nova/instances/d4c23a0a-d5cb-4893-9a40-4586e98a2535/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Lock "/opt/stack/data/nova/instances/d4c23a0a-d5cb-4893-9a40-4586e98a2535/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Lock "/opt/stack/data/nova/instances/d4c23a0a-d5cb-4893-9a40-4586e98a2535/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Acquiring lock "ad817f0592afee347eb12ccd44fc0daef262fd01" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Lock "ad817f0592afee347eb12ccd44fc0daef262fd01" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad817f0592afee347eb12ccd44fc0daef262fd01.part --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG nova.network.neutron [req-1d2a7f82-c089-4676-ba87-f4995cc6bf66 req-60a401bc-c3e1-4150-9765-70adf3e3c2fb service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Updated VIF entry in instance network info cache for port 23684bac-dba0-4fdd-80d3-750ed2a77731. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG nova.network.neutron [req-1d2a7f82-c089-4676-ba87-f4995cc6bf66 req-60a401bc-c3e1-4150-9765-70adf3e3c2fb service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Updating instance_info_cache with network_info: [{"id": "a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11", "address": "fa:16:3e:7e:13:34", "network": {"id": "43dd1e8a-1185-462c-9421-d0d7b2d90334", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1360889325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ea7e01-7e", "ovs_interfaceid": "a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40eb3a07-e825-44ad-9077-c1880b1e8768", "address": "fa:16:3e:ef:f1:d7", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40eb3a07-e8", "ovs_interfaceid": "40eb3a07-e825-44ad-9077-c1880b1e8768", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2813ff58-0b02-4da1-8774-ad7452da7d78", "address": "fa:16:3e:56:f0:e9", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2813ff58-0b", "ovs_interfaceid": "2813ff58-0b02-4da1-8774-ad7452da7d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec", "address": "fa:16:3e:32:8d:af", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dbd4bf3-bf", "ovs_interfaceid": "1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5", "address": "fa:16:3e:73:c9:16", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9f5274-68", "ovs_interfaceid": "2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a815917f-f1ec-48f2-b272-97bf2ad1d6cd", "address": "fa:16:3e:22:3b:ee", "network": {"id": "20ec901d-4e30-4c4a-ab56-7d57878cfdcc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1805797092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa815917f-f1", "ovs_interfaceid": "a815917f-f1ec-48f2-b272-97bf2ad1d6cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23684bac-dba0-4fdd-80d3-750ed2a77731", "address": "fa:16:3e:46:79:42", "network": {"id": "20ec901d-4e30-4c4a-ab56-7d57878cfdcc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1805797092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23684bac-db", "ovs_interfaceid": "23684bac-dba0-4fdd-80d3-750ed2a77731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG nova.compute.manager [req-f1cbdc5d-9e21-4feb-b8fd-681a5fbb9bbc req-e7361d39-d7f5-4499-b541-92917b323f5e service nova] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Received event network-vif-unplugged-2f140983-b9a6-4fdd-a301-a9b42927c561 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f1cbdc5d-9e21-4feb-b8fd-681a5fbb9bbc req-e7361d39-d7f5-4499-b541-92917b323f5e service nova] Acquiring lock "73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f1cbdc5d-9e21-4feb-b8fd-681a5fbb9bbc req-e7361d39-d7f5-4499-b541-92917b323f5e service nova] Lock "73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f1cbdc5d-9e21-4feb-b8fd-681a5fbb9bbc req-e7361d39-d7f5-4499-b541-92917b323f5e service nova] Lock "73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG nova.compute.manager [req-f1cbdc5d-9e21-4feb-b8fd-681a5fbb9bbc req-e7361d39-d7f5-4499-b541-92917b323f5e service nova] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] No waiting events found dispatching network-vif-unplugged-2f140983-b9a6-4fdd-a301-a9b42927c561 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG nova.compute.manager [req-f1cbdc5d-9e21-4feb-b8fd-681a5fbb9bbc req-e7361d39-d7f5-4499-b541-92917b323f5e service nova] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Received event network-vif-unplugged-2f140983-b9a6-4fdd-a301-a9b42927c561 for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1d2a7f82-c089-4676-ba87-f4995cc6bf66 req-60a401bc-c3e1-4150-9765-70adf3e3c2fb service nova] Releasing lock "refresh_cache-7fa3da6f-ba9f-4752-901a-933427fcbda8" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:29:56 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Instance destroyed successfully.
Oct 16 18:29:56 user nova-compute[74247]: DEBUG nova.objects.instance [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Lazy-loading 'resources' on Instance uuid 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T18:25:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1223998491',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-413859192',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEogCyeuhbzTI40G7oRGcfQg1ZDIdQQs+E8Zqfgq6jVx7RJjmhFUF8Of7DSwnrttqR/RrY35HAlR9+flGO4UILfkJp/XvsGQTltIdbBTBZgqMx2HchODLVDJxQEAyvBXA==',key_name='tempest-keypair-1699437087',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:28:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='670a27f9af4f4b32a86386d343a0694b',ramdisk_id='',reservation_id='r-5j8o190g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1771639004',owner_user_name='tempest-ServerActionsV293TestJSON-1771639004-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:28:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='493de9166585427c8714c5ba06c2ceec',uuid=73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f140983-b9a6-4fdd-a301-a9b42927c561", "address": "fa:16:3e:a8:1a:a3", "network": {"id": "64ae2feb-5041-4479-a5a1-02e5ff636224", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-402083057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "670a27f9af4f4b32a86386d343a0694b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f140983-b9", "ovs_interfaceid": "2f140983-b9a6-4fdd-a301-a9b42927c561", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Converting VIF {"id": "2f140983-b9a6-4fdd-a301-a9b42927c561", "address": "fa:16:3e:a8:1a:a3", "network": {"id": "64ae2feb-5041-4479-a5a1-02e5ff636224", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-402083057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "670a27f9af4f4b32a86386d343a0694b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f140983-b9", "ovs_interfaceid": "2f140983-b9a6-4fdd-a301-a9b42927c561", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:1a:a3,bridge_name='br-int',has_traffic_filtering=True,id=2f140983-b9a6-4fdd-a301-a9b42927c561,network=Network(64ae2feb-5041-4479-a5a1-02e5ff636224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f140983-b9') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG os_vif [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:1a:a3,bridge_name='br-int',has_traffic_filtering=True,id=2f140983-b9a6-4fdd-a301-a9b42927c561,network=Network(64ae2feb-5041-4479-a5a1-02e5ff636224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f140983-b9') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f140983-b9, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=22196a04-1360-47ea-a7ef-0c209b3bdcc1) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:29:56 user nova-compute[74247]: INFO os_vif [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:1a:a3,bridge_name='br-int',has_traffic_filtering=True,id=2f140983-b9a6-4fdd-a301-a9b42927c561,network=Network(64ae2feb-5041-4479-a5a1-02e5ff636224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f140983-b9')
Oct 16 18:29:56 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fsdpBahK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:29:56 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:29:56 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad817f0592afee347eb12ccd44fc0daef262fd01.part --force-share --output=json" returned: 0 in 0.259s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG nova.virt.images [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] b90a1621-833a-4187-80e0-12981d48dfb7 was qcow2, converting to raw {{(pid=74247) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG nova.privsep.utils [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74247) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ad817f0592afee347eb12ccd44fc0daef262fd01.part /opt/stack/data/nova/instances/_base/ad817f0592afee347eb12ccd44fc0daef262fd01.converted {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e781054b-55b4-4694-90ab-6a2d01ea02a4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 18:29:56 user nova-compute[74247]: No targets found.
Oct 16 18:29:56 user nova-compute[74247]: iSNS:
Oct 16 18:29:56 user nova-compute[74247]: No targets found.
Oct 16 18:29:56 user nova-compute[74247]: STATIC:
Oct 16 18:29:56 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688
Oct 16 18:29:56 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:29:56 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:29:56 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6
Oct 16 18:29:56 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:29:56 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:29:56 user nova-compute[74247]: FIRMWARE:
Oct 16 18:29:56 user nova-compute[74247]: No targets found.
Oct 16 18:29:56 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 18:29:56 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 18:29:56 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93762ba-96e2-45aa-8d56-a38cb1b70b0b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:29:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1baf92-013e-422b-b8f7-85eb985c9959]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)
Oct 16 18:29:57 user nova-compute[74247]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:29:57 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 (non-flash)
Oct 16 18:29:57 user nova-compute[74247]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:29:57 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe068213c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688'): ({'sdd'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Removing single pathed devices sdd {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[270d5b77-179a-4a85-b026-025daead6401]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.029s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[972315b4-afe3-4040-951d-38ac974a9ea7]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Flushing IO for device /dev/sdd {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.040s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54a275a-9490-42df-92ec-9eff0cfb80bc]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ad817f0592afee347eb12ccd44fc0daef262fd01.part /opt/stack/data/nova/instances/_base/ad817f0592afee347eb12ccd44fc0daef262fd01.converted" returned: 0 in 0.270s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad817f0592afee347eb12ccd44fc0daef262fd01.converted --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4a1de4-df07-4b43-890a-fc6300f71ca1]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] SCSI volumes sdd have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_e78033b0', '/dev/disk/by-id/scsi-23835623533313633', '/dev/disk/by-id/scsi-1SCST_BIOe78033b0-85b53163b8dee476') {{(pid=85128) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[96209f9c-7a7c-4649-ab44-8f318f2a14d2]: (4, None) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad817f0592afee347eb12ccd44fc0daef262fd01.converted --force-share --output=json" returned: 0 in 0.326s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Lock "ad817f0592afee347eb12ccd44fc0daef262fd01" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.516s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.265s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[285a58e9-6df6-48da-9c91-7f81c82e7671]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad817f0592afee347eb12ccd44fc0daef262fd01 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG nova.network.neutron [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Successfully created port: 423dc8c8-ef91-4b4c-a3f1-29f8769ae668 {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 -p 172.16.0.220:3260 --logout" returned: 0 in 0.114s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64e412b-9c6e-4167-abce-93804bfc6162]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688, portal: 172.16.0.220,3260]
Oct 16 18:29:57 user nova-compute[74247]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688, portal: 172.16.0.220,3260] successful.
Oct 16 18:29:57 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ab08fda-c4e7-456c-8003-24c8bfb6c688 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68193c8-ad72-482e-88db-4c1e7b6b0ee7]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.830s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] <== disconnect_volume: return (832ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 18:29:57 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Deleting instance files /opt/stack/data/nova/instances/73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b_del
Oct 16 18:29:57 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Deletion of /opt/stack/data/nova/instances/73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b_del complete
Oct 16 18:29:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad817f0592afee347eb12ccd44fc0daef262fd01 --force-share --output=json" returned: 0 in 0.219s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Acquiring lock "ad817f0592afee347eb12ccd44fc0daef262fd01" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Lock "ad817f0592afee347eb12ccd44fc0daef262fd01" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad817f0592afee347eb12ccd44fc0daef262fd01 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-bc84750c-8951-40e5-ac00-d5fc3de6b3cb tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Acquiring lock "16ed0e45-071e-4c56-902d-42eacc97c2c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-bc84750c-8951-40e5-ac00-d5fc3de6b3cb tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lock "16ed0e45-071e-4c56-902d-42eacc97c2c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-bc84750c-8951-40e5-ac00-d5fc3de6b3cb tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Acquiring lock "16ed0e45-071e-4c56-902d-42eacc97c2c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-bc84750c-8951-40e5-ac00-d5fc3de6b3cb tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lock "16ed0e45-071e-4c56-902d-42eacc97c2c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-bc84750c-8951-40e5-ac00-d5fc3de6b3cb tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lock "16ed0e45-071e-4c56-902d-42eacc97c2c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:29:57 user nova-compute[74247]: INFO nova.compute.manager [None req-bc84750c-8951-40e5-ac00-d5fc3de6b3cb tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Terminating instance
Oct 16 18:29:57 user nova-compute[74247]: DEBUG nova.compute.manager [None req-bc84750c-8951-40e5-ac00-d5fc3de6b3cb tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 18:29:57 user nova-compute[74247]: INFO nova.compute.manager [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Took 1.85 seconds to destroy the instance on the hypervisor.
Oct 16 18:29:57 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad817f0592afee347eb12ccd44fc0daef262fd01 --force-share --output=json" returned: 0 in 0.205s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad817f0592afee347eb12ccd44fc0daef262fd01,backing_fmt=raw /opt/stack/data/nova/instances/d4c23a0a-d5cb-4893-9a40-4586e98a2535/disk 1073741824 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad817f0592afee347eb12ccd44fc0daef262fd01,backing_fmt=raw /opt/stack/data/nova/instances/d4c23a0a-d5cb-4893-9a40-4586e98a2535/disk 1073741824" returned: 0 in 0.071s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Lock "ad817f0592afee347eb12ccd44fc0daef262fd01" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad817f0592afee347eb12ccd44fc0daef262fd01 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad817f0592afee347eb12ccd44fc0daef262fd01 --force-share --output=json" returned: 0 in 0.197s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d4c23a0a-d5cb-4893-9a40-4586e98a2535/disk. size=1073741824 {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c23a0a-d5cb-4893-9a40-4586e98a2535/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG nova.compute.manager [req-be28c4d8-0d11-45aa-81a0-6969b70d6c8e req-37981e4b-e238-4179-be91-5ad560d8214f service nova] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Received event network-vif-unplugged-6a65c68a-defd-43f5-86d4-885e9f05d19e {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-be28c4d8-0d11-45aa-81a0-6969b70d6c8e req-37981e4b-e238-4179-be91-5ad560d8214f service nova] Acquiring lock "16ed0e45-071e-4c56-902d-42eacc97c2c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-be28c4d8-0d11-45aa-81a0-6969b70d6c8e req-37981e4b-e238-4179-be91-5ad560d8214f service nova] Lock "16ed0e45-071e-4c56-902d-42eacc97c2c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-be28c4d8-0d11-45aa-81a0-6969b70d6c8e req-37981e4b-e238-4179-be91-5ad560d8214f service nova] Lock "16ed0e45-071e-4c56-902d-42eacc97c2c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG nova.compute.manager [req-be28c4d8-0d11-45aa-81a0-6969b70d6c8e req-37981e4b-e238-4179-be91-5ad560d8214f service nova] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] No waiting events found dispatching network-vif-unplugged-6a65c68a-defd-43f5-86d4-885e9f05d19e {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG nova.compute.manager [req-be28c4d8-0d11-45aa-81a0-6969b70d6c8e req-37981e4b-e238-4179-be91-5ad560d8214f service nova] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Received event network-vif-unplugged-6a65c68a-defd-43f5-86d4-885e9f05d19e for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG nova.compute.manager [req-4bd3f5d8-e939-4ad0-8e0f-6149c7fd45ed req-9dd4c3db-9d34-40e3-b292-833e0711b214 service nova] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Received event network-vif-plugged-2f140983-b9a6-4fdd-a301-a9b42927c561 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4bd3f5d8-e939-4ad0-8e0f-6149c7fd45ed req-9dd4c3db-9d34-40e3-b292-833e0711b214 service nova] Acquiring lock "73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4bd3f5d8-e939-4ad0-8e0f-6149c7fd45ed req-9dd4c3db-9d34-40e3-b292-833e0711b214 service nova] Lock "73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4bd3f5d8-e939-4ad0-8e0f-6149c7fd45ed req-9dd4c3db-9d34-40e3-b292-833e0711b214 service nova] Lock "73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG nova.compute.manager [req-4bd3f5d8-e939-4ad0-8e0f-6149c7fd45ed req-9dd4c3db-9d34-40e3-b292-833e0711b214 service nova] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] No waiting events found dispatching network-vif-plugged-2f140983-b9a6-4fdd-a301-a9b42927c561 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:29:58 user nova-compute[74247]: WARNING nova.compute.manager [req-4bd3f5d8-e939-4ad0-8e0f-6149c7fd45ed req-9dd4c3db-9d34-40e3-b292-833e0711b214 service nova] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Received unexpected event network-vif-plugged-2f140983-b9a6-4fdd-a301-a9b42927c561 for instance with vm_state active and task_state deleting.
Oct 16 18:29:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c23a0a-d5cb-4893-9a40-4586e98a2535/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Cannot resize image /opt/stack/data/nova/instances/d4c23a0a-d5cb-4893-9a40-4586e98a2535/disk to a smaller size. {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Ensure instance console log exists: /opt/stack/data/nova/instances/d4c23a0a-d5cb-4893-9a40-4586e98a2535/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG nova.network.neutron [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Successfully updated port: 423dc8c8-ef91-4b4c-a3f1-29f8769ae668 {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Acquiring lock "refresh_cache-d4c23a0a-d5cb-4893-9a40-4586e98a2535" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Acquired lock "refresh_cache-d4c23a0a-d5cb-4893-9a40-4586e98a2535" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG nova.network.neutron [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG nova.network.neutron [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:29:58 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Instance destroyed successfully.
Oct 16 18:29:58 user nova-compute[74247]: DEBUG nova.objects.instance [None req-bc84750c-8951-40e5-ac00-d5fc3de6b3cb tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lazy-loading 'resources' on Instance uuid 16ed0e45-071e-4c56-902d-42eacc97c2c1 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-bc84750c-8951-40e5-ac00-d5fc3de6b3cb tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:27:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1671619588',display_name='tempest-VolumesAdminNegativeTest-server-1671619588',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1671619588',id=12,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:27:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42df518506b24ac5bedd9d75b15fa9b7',ramdisk_id='',reservation_id='r-jgc85m50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1972822081',owner_user_name='tempest-VolumesAdminNegativeTest-1972822081-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:27:51Z,user_data=None,user_id='fc992e02d7424d11b144101559cbc8ef',uuid=16ed0e45-071e-4c56-902d-42eacc97c2c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a65c68a-defd-43f5-86d4-885e9f05d19e", "address": "fa:16:3e:ff:38:ab", "network": {"id": "8451dc81-ded8-462e-a394-f5cd774f684b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1470365086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42df518506b24ac5bedd9d75b15fa9b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a65c68a-de", "ovs_interfaceid": "6a65c68a-defd-43f5-86d4-885e9f05d19e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-bc84750c-8951-40e5-ac00-d5fc3de6b3cb tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Converting VIF {"id": "6a65c68a-defd-43f5-86d4-885e9f05d19e", "address": "fa:16:3e:ff:38:ab", "network": {"id": "8451dc81-ded8-462e-a394-f5cd774f684b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1470365086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42df518506b24ac5bedd9d75b15fa9b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a65c68a-de", "ovs_interfaceid": "6a65c68a-defd-43f5-86d4-885e9f05d19e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-bc84750c-8951-40e5-ac00-d5fc3de6b3cb tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:38:ab,bridge_name='br-int',has_traffic_filtering=True,id=6a65c68a-defd-43f5-86d4-885e9f05d19e,network=Network(8451dc81-ded8-462e-a394-f5cd774f684b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a65c68a-de') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG os_vif [None req-bc84750c-8951-40e5-ac00-d5fc3de6b3cb tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:38:ab,bridge_name='br-int',has_traffic_filtering=True,id=6a65c68a-defd-43f5-86d4-885e9f05d19e,network=Network(8451dc81-ded8-462e-a394-f5cd774f684b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a65c68a-de') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a65c68a-de, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f23bf741-ab2b-4f77-a1f4-88098f0a42d8) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:58 user nova-compute[74247]: INFO os_vif [None req-bc84750c-8951-40e5-ac00-d5fc3de6b3cb tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:38:ab,bridge_name='br-int',has_traffic_filtering=True,id=6a65c68a-defd-43f5-86d4-885e9f05d19e,network=Network(8451dc81-ded8-462e-a394-f5cd774f684b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a65c68a-de')
Oct 16 18:29:58 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-bc84750c-8951-40e5-ac00-d5fc3de6b3cb tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Deleting instance files /opt/stack/data/nova/instances/16ed0e45-071e-4c56-902d-42eacc97c2c1_del
Oct 16 18:29:58 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-bc84750c-8951-40e5-ac00-d5fc3de6b3cb tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Deletion of /opt/stack/data/nova/instances/16ed0e45-071e-4c56-902d-42eacc97c2c1_del complete
Oct 16 18:29:58 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:29:58 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Took 1.09 seconds to deallocate network for instance.
Oct 16 18:29:58 user nova-compute[74247]: INFO nova.compute.manager [None req-bc84750c-8951-40e5-ac00-d5fc3de6b3cb tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Took 1.11 seconds to destroy the instance on the hypervisor.
Oct 16 18:29:58 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-bc84750c-8951-40e5-ac00-d5fc3de6b3cb tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG nova.compute.manager [req-bf956d1e-1c77-46a9-a5a5-4fade70d195e req-9a33f341-f785-4934-afc8-40215fc52f0e service nova] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Received event network-vif-deleted-2f140983-b9a6-4fdd-a301-a9b42927c561 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:29:58 user nova-compute[74247]: INFO nova.compute.manager [req-bf956d1e-1c77-46a9-a5a5-4fade70d195e req-9a33f341-f785-4934-afc8-40215fc52f0e service nova] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Neutron deleted interface 2f140983-b9a6-4fdd-a301-a9b42927c561; detaching it from the instance and deleting it from the info cache
Oct 16 18:29:58 user nova-compute[74247]: DEBUG nova.network.neutron [req-bf956d1e-1c77-46a9-a5a5-4fade70d195e req-9a33f341-f785-4934-afc8-40215fc52f0e service nova] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:29:58 user nova-compute[74247]: DEBUG nova.compute.manager [req-bf956d1e-1c77-46a9-a5a5-4fade70d195e req-9a33f341-f785-4934-afc8-40215fc52f0e service nova] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Detach interface failed, port_id=2f140983-b9a6-4fdd-a301-a9b42927c561, reason: Instance 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b could not be found. {{(pid=74247) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG nova.network.neutron [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Updating instance_info_cache with network_info: [{"id": "423dc8c8-ef91-4b4c-a3f1-29f8769ae668", "address": "fa:16:3e:f9:1d:bf", "network": {"id": "46ba27ba-e8dd-4c09-8b0e-1418f651dc21", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1347745998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85a018057c194fc497ad8476dd290a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap423dc8c8-ef", "ovs_interfaceid": "423dc8c8-ef91-4b4c-a3f1-29f8769ae668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Releasing lock "refresh_cache-d4c23a0a-d5cb-4893-9a40-4586e98a2535" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG nova.compute.manager [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Instance network_info: |[{"id": "423dc8c8-ef91-4b4c-a3f1-29f8769ae668", "address": "fa:16:3e:f9:1d:bf", "network": {"id": "46ba27ba-e8dd-4c09-8b0e-1418f651dc21", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1347745998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85a018057c194fc497ad8476dd290a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap423dc8c8-ef", "ovs_interfaceid": "423dc8c8-ef91-4b4c-a3f1-29f8769ae668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Start _get_guest_xml network_info=[{"id": "423dc8c8-ef91-4b4c-a3f1-29f8769ae668", "address": "fa:16:3e:f9:1d:bf", "network": {"id": "46ba27ba-e8dd-4c09-8b0e-1418f651dc21", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1347745998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85a018057c194fc497ad8476dd290a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap423dc8c8-ef", "ovs_interfaceid": "423dc8c8-ef91-4b4c-a3f1-29f8769ae668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:29:48Z,direct_url=<?>,disk_format='qcow2',id=b90a1621-833a-4187-80e0-12981d48dfb7,min_disk=0,min_ram=0,name='',owner='3ed088c6c96c443bab0b79691a51daba',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:29:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'boot_index': 0, 'device_name': '/dev/sda', 'encryption_options': None, 'disk_bus': 'scsi', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': 'b90a1621-833a-4187-80e0-12981d48dfb7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:29:59 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:29:59 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:29:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:29:48Z,direct_url=<?>,disk_format='qcow2',id=b90a1621-833a-4187-80e0-12981d48dfb7,min_disk=0,min_ram=0,name='',owner='3ed088c6c96c443bab0b79691a51daba',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:29:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T18:29:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-791406764',display_name='tempest-AttachSCSIVolumeTestJSON-server-791406764',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-791406764',id=16,image_ref='b90a1621-833a-4187-80e0-12981d48dfb7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBML2fAT3Ax5OrVksD34Dd5wMBbq+p6bA6TKmMnvwD9mGuDgOSjZ+agz+odm9/f5LM68jvYD/4JlIAj2Htp5yGVqquQn5kuPGEPJ3yx4lq0I/iaXmRQDXynEXTGOxPZf00g==',key_name='tempest-keypair-1855339094',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85a018057c194fc497ad8476dd290a69',ramdisk_id='',reservation_id='r-n59d770m',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b90a1621-833a-4187-80e0-12981d48dfb7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1602494163',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1602494163-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:29:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cebea5593d0403389777c0c9b0d0372',uuid=d4c23a0a-d5cb-4893-9a40-4586e98a2535,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "423dc8c8-ef91-4b4c-a3f1-29f8769ae668", "address": "fa:16:3e:f9:1d:bf", "network": {"id": "46ba27ba-e8dd-4c09-8b0e-1418f651dc21", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1347745998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85a018057c194fc497ad8476dd290a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap423dc8c8-ef", "ovs_interfaceid": "423dc8c8-ef91-4b4c-a3f1-29f8769ae668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Converting VIF {"id": "423dc8c8-ef91-4b4c-a3f1-29f8769ae668", "address": "fa:16:3e:f9:1d:bf", "network": {"id": "46ba27ba-e8dd-4c09-8b0e-1418f651dc21", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1347745998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85a018057c194fc497ad8476dd290a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap423dc8c8-ef", "ovs_interfaceid": "423dc8c8-ef91-4b4c-a3f1-29f8769ae668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:1d:bf,bridge_name='br-int',has_traffic_filtering=True,id=423dc8c8-ef91-4b4c-a3f1-29f8769ae668,network=Network(46ba27ba-e8dd-4c09-8b0e-1418f651dc21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap423dc8c8-ef') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG nova.objects.instance [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Lazy-loading 'pci_devices' on Instance uuid d4c23a0a-d5cb-4893-9a40-4586e98a2535 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:29:59 user nova-compute[74247]:   <uuid>d4c23a0a-d5cb-4893-9a40-4586e98a2535</uuid>
Oct 16 18:29:59 user nova-compute[74247]:   <name>instance-00000010</name>
Oct 16 18:29:59 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:29:59 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:29:59 user nova-compute[74247]:   <metadata>
Oct 16 18:29:59 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:29:59 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:29:59 user nova-compute[74247]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-791406764</nova:name>
Oct 16 18:29:59 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:29:59</nova:creationTime>
Oct 16 18:29:59 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:29:59 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:29:59 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:29:59 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:29:59 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:29:59 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:29:59 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:29:59 user nova-compute[74247]:       <nova:owner>
Oct 16 18:29:59 user nova-compute[74247]:         <nova:user uuid="0cebea5593d0403389777c0c9b0d0372">tempest-AttachSCSIVolumeTestJSON-1602494163-project-member</nova:user>
Oct 16 18:29:59 user nova-compute[74247]:         <nova:project uuid="85a018057c194fc497ad8476dd290a69">tempest-AttachSCSIVolumeTestJSON-1602494163</nova:project>
Oct 16 18:29:59 user nova-compute[74247]:       </nova:owner>
Oct 16 18:29:59 user nova-compute[74247]:       <nova:root type="image" uuid="b90a1621-833a-4187-80e0-12981d48dfb7"/>
Oct 16 18:29:59 user nova-compute[74247]:       <nova:ports>
Oct 16 18:29:59 user nova-compute[74247]:         <nova:port uuid="423dc8c8-ef91-4b4c-a3f1-29f8769ae668">
Oct 16 18:29:59 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 16 18:29:59 user nova-compute[74247]:         </nova:port>
Oct 16 18:29:59 user nova-compute[74247]:       </nova:ports>
Oct 16 18:29:59 user nova-compute[74247]:     </nova:instance>
Oct 16 18:29:59 user nova-compute[74247]:   </metadata>
Oct 16 18:29:59 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:29:59 user nova-compute[74247]:     <system>
Oct 16 18:29:59 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:29:59 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:29:59 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:29:59 user nova-compute[74247]:       <entry name="serial">d4c23a0a-d5cb-4893-9a40-4586e98a2535</entry>
Oct 16 18:29:59 user nova-compute[74247]:       <entry name="uuid">d4c23a0a-d5cb-4893-9a40-4586e98a2535</entry>
Oct 16 18:29:59 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:29:59 user nova-compute[74247]:     </system>
Oct 16 18:29:59 user nova-compute[74247]:   </sysinfo>
Oct 16 18:29:59 user nova-compute[74247]:   <os>
Oct 16 18:29:59 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:29:59 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:29:59 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:29:59 user nova-compute[74247]:   </os>
Oct 16 18:29:59 user nova-compute[74247]:   <features>
Oct 16 18:29:59 user nova-compute[74247]:     <acpi/>
Oct 16 18:29:59 user nova-compute[74247]:     <apic/>
Oct 16 18:29:59 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:29:59 user nova-compute[74247]:   </features>
Oct 16 18:29:59 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:29:59 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:29:59 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:29:59 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:29:59 user nova-compute[74247]:   </clock>
Oct 16 18:29:59 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:29:59 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:29:59 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:29:59 user nova-compute[74247]:   </cpu>
Oct 16 18:29:59 user nova-compute[74247]:   <devices>
Oct 16 18:29:59 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:29:59 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:29:59 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/d4c23a0a-d5cb-4893-9a40-4586e98a2535/disk"/>
Oct 16 18:29:59 user nova-compute[74247]:       <target dev="sda" bus="scsi"/>
Oct 16 18:29:59 user nova-compute[74247]:       <address type="drive" controller="0" unit="0"/>
Oct 16 18:29:59 user nova-compute[74247]:     </disk>
Oct 16 18:29:59 user nova-compute[74247]:     <disk type="file" device="cdrom">
Oct 16 18:29:59 user nova-compute[74247]:       <driver name="qemu" type="raw" cache="none"/>
Oct 16 18:29:59 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/d4c23a0a-d5cb-4893-9a40-4586e98a2535/disk.config"/>
Oct 16 18:29:59 user nova-compute[74247]:       <target dev="sdb" bus="scsi"/>
Oct 16 18:29:59 user nova-compute[74247]:       <address type="drive" controller="0" unit="1"/>
Oct 16 18:29:59 user nova-compute[74247]:     </disk>
Oct 16 18:29:59 user nova-compute[74247]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Oct 16 18:29:59 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:29:59 user nova-compute[74247]:       <mac address="fa:16:3e:f9:1d:bf"/>
Oct 16 18:29:59 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:29:59 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:29:59 user nova-compute[74247]:       <target dev="tap423dc8c8-ef"/>
Oct 16 18:29:59 user nova-compute[74247]:     </interface>
Oct 16 18:29:59 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:29:59 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/d4c23a0a-d5cb-4893-9a40-4586e98a2535/console.log" append="off"/>
Oct 16 18:29:59 user nova-compute[74247]:     </serial>
Oct 16 18:29:59 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:29:59 user nova-compute[74247]:     <video>
Oct 16 18:29:59 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:29:59 user nova-compute[74247]:     </video>
Oct 16 18:29:59 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:29:59 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:29:59 user nova-compute[74247]:     </rng>
Oct 16 18:29:59 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:29:59 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:29:59 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:29:59 user nova-compute[74247]:     </memballoon>
Oct 16 18:29:59 user nova-compute[74247]:   </devices>
Oct 16 18:29:59 user nova-compute[74247]: </domain>
Oct 16 18:29:59 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T18:29:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-791406764',display_name='tempest-AttachSCSIVolumeTestJSON-server-791406764',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-791406764',id=16,image_ref='b90a1621-833a-4187-80e0-12981d48dfb7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBML2fAT3Ax5OrVksD34Dd5wMBbq+p6bA6TKmMnvwD9mGuDgOSjZ+agz+odm9/f5LM68jvYD/4JlIAj2Htp5yGVqquQn5kuPGEPJ3yx4lq0I/iaXmRQDXynEXTGOxPZf00g==',key_name='tempest-keypair-1855339094',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85a018057c194fc497ad8476dd290a69',ramdisk_id='',reservation_id='r-n59d770m',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b90a1621-833a-4187-80e0-12981d48dfb7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1602494163',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1602494163-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:29:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cebea5593d0403389777c0c9b0d0372',uuid=d4c23a0a-d5cb-4893-9a40-4586e98a2535,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "423dc8c8-ef91-4b4c-a3f1-29f8769ae668", "address": "fa:16:3e:f9:1d:bf", "network": {"id": "46ba27ba-e8dd-4c09-8b0e-1418f651dc21", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1347745998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85a018057c194fc497ad8476dd290a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap423dc8c8-ef", "ovs_interfaceid": "423dc8c8-ef91-4b4c-a3f1-29f8769ae668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Converting VIF {"id": "423dc8c8-ef91-4b4c-a3f1-29f8769ae668", "address": "fa:16:3e:f9:1d:bf", "network": {"id": "46ba27ba-e8dd-4c09-8b0e-1418f651dc21", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1347745998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85a018057c194fc497ad8476dd290a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap423dc8c8-ef", "ovs_interfaceid": "423dc8c8-ef91-4b4c-a3f1-29f8769ae668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:1d:bf,bridge_name='br-int',has_traffic_filtering=True,id=423dc8c8-ef91-4b4c-a3f1-29f8769ae668,network=Network(46ba27ba-e8dd-4c09-8b0e-1418f651dc21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap423dc8c8-ef') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG os_vif [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:1d:bf,bridge_name='br-int',has_traffic_filtering=True,id=423dc8c8-ef91-4b4c-a3f1-29f8769ae668,network=Network(46ba27ba-e8dd-4c09-8b0e-1418f651dc21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap423dc8c8-ef') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b412aa8a-fb5c-523d-8130-b076e6ecdbb0', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap423dc8c8-ef, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap423dc8c8-ef, col_values=(('qos', UUID('18626ac9-d328-4db9-a36e-28e16c8fd655')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap423dc8c8-ef, col_values=(('external_ids', {'iface-id': '423dc8c8-ef91-4b4c-a3f1-29f8769ae668', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:1d:bf', 'vm-uuid': 'd4c23a0a-d5cb-4893-9a40-4586e98a2535'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:29:59 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Took 0.60 seconds to deallocate network for instance.
Oct 16 18:29:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:29:59 user nova-compute[74247]: INFO os_vif [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:1d:bf,bridge_name='br-int',has_traffic_filtering=True,id=423dc8c8-ef91-4b4c-a3f1-29f8769ae668,network=Network(46ba27ba-e8dd-4c09-8b0e-1418f651dc21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap423dc8c8-ef')
Oct 16 18:29:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] No BDM found with device name sda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] No VIF found with MAC fa:16:3e:f9:1d:bf, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:29:59 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Using config drive
Oct 16 18:29:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-bc84750c-8951-40e5-ac00-d5fc3de6b3cb tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-bc84750c-8951-40e5-ac00-d5fc3de6b3cb tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:59 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Creating config drive at /opt/stack/data/nova/instances/d4c23a0a-d5cb-4893-9a40-4586e98a2535/disk.config
Oct 16 18:29:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d4c23a0a-d5cb-4893-9a40-4586e98a2535/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpys3unlmw {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d4c23a0a-d5cb-4893-9a40-4586e98a2535/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpys3unlmw" returned: 0 in 0.066s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:29:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4daa6370-2cdf-4668-b66b-e10196377c9c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4daa6370-2cdf-4668-b66b-e10196377c9c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4daa6370-2cdf-4668-b66b-e10196377c9c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:00 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-bc84750c-8951-40e5-ac00-d5fc3de6b3cb tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:30:00 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-bc84750c-8951-40e5-ac00-d5fc3de6b3cb tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:30:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-bc84750c-8951-40e5-ac00-d5fc3de6b3cb tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.652s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:30:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4daa6370-2cdf-4668-b66b-e10196377c9c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:00 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-bc84750c-8951-40e5-ac00-d5fc3de6b3cb tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Deleted allocations for instance 16ed0e45-071e-4c56-902d-42eacc97c2c1
Oct 16 18:30:00 user nova-compute[74247]: DEBUG nova.compute.manager [req-97468009-a167-42f9-b3eb-ca96d5c7298a req-0fa7781f-4cbb-492d-8dae-6dfa3058813c service nova] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Received event network-vif-plugged-6a65c68a-defd-43f5-86d4-885e9f05d19e {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:30:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-97468009-a167-42f9-b3eb-ca96d5c7298a req-0fa7781f-4cbb-492d-8dae-6dfa3058813c service nova] Acquiring lock "16ed0e45-071e-4c56-902d-42eacc97c2c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:30:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-97468009-a167-42f9-b3eb-ca96d5c7298a req-0fa7781f-4cbb-492d-8dae-6dfa3058813c service nova] Lock "16ed0e45-071e-4c56-902d-42eacc97c2c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:30:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-97468009-a167-42f9-b3eb-ca96d5c7298a req-0fa7781f-4cbb-492d-8dae-6dfa3058813c service nova] Lock "16ed0e45-071e-4c56-902d-42eacc97c2c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:30:00 user nova-compute[74247]: DEBUG nova.compute.manager [req-97468009-a167-42f9-b3eb-ca96d5c7298a req-0fa7781f-4cbb-492d-8dae-6dfa3058813c service nova] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] No waiting events found dispatching network-vif-plugged-6a65c68a-defd-43f5-86d4-885e9f05d19e {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:30:00 user nova-compute[74247]: WARNING nova.compute.manager [req-97468009-a167-42f9-b3eb-ca96d5c7298a req-0fa7781f-4cbb-492d-8dae-6dfa3058813c service nova] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Received unexpected event network-vif-plugged-6a65c68a-defd-43f5-86d4-885e9f05d19e for instance with vm_state deleted and task_state None.
Oct 16 18:30:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-bc84750c-8951-40e5-ac00-d5fc3de6b3cb tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lock "16ed0e45-071e-4c56-902d-42eacc97c2c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.709s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:30:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:00 user nova-compute[74247]: DEBUG nova.compute.manager [req-dc1be3c7-727b-4940-8315-db37afb4e082 req-ae6b7909-4815-4c45-a108-a1a3a6aa8fa4 service nova] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Received event network-changed-423dc8c8-ef91-4b4c-a3f1-29f8769ae668 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:30:00 user nova-compute[74247]: DEBUG nova.compute.manager [req-dc1be3c7-727b-4940-8315-db37afb4e082 req-ae6b7909-4815-4c45-a108-a1a3a6aa8fa4 service nova] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Refreshing instance network info cache due to event network-changed-423dc8c8-ef91-4b4c-a3f1-29f8769ae668. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:30:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-dc1be3c7-727b-4940-8315-db37afb4e082 req-ae6b7909-4815-4c45-a108-a1a3a6aa8fa4 service nova] Acquiring lock "refresh_cache-d4c23a0a-d5cb-4893-9a40-4586e98a2535" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:30:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-dc1be3c7-727b-4940-8315-db37afb4e082 req-ae6b7909-4815-4c45-a108-a1a3a6aa8fa4 service nova] Acquired lock "refresh_cache-d4c23a0a-d5cb-4893-9a40-4586e98a2535" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:30:00 user nova-compute[74247]: DEBUG nova.network.neutron [req-dc1be3c7-727b-4940-8315-db37afb4e082 req-ae6b7909-4815-4c45-a108-a1a3a6aa8fa4 service nova] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Refreshing network info cache for port 423dc8c8-ef91-4b4c-a3f1-29f8769ae668 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:30:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:00 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Error from libvirt while getting description of instance-0000000c: [Error Code 42] Domain not found: no domain with matching uuid '16ed0e45-071e-4c56-902d-42eacc97c2c1' (instance-0000000c): libvirt.libvirtError: Domain not found: no domain with matching uuid '16ed0e45-071e-4c56-902d-42eacc97c2c1' (instance-0000000c)
Oct 16 18:30:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:01 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:01 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:01 user nova-compute[74247]: DEBUG nova.compute.manager [req-6168379d-923e-4c18-abb1-b00c885faa80 req-1a519085-e984-41c0-abc1-e444ad031856 service nova] [instance: 16ed0e45-071e-4c56-902d-42eacc97c2c1] Received event network-vif-deleted-6a65c68a-defd-43f5-86d4-885e9f05d19e {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:30:01 user nova-compute[74247]: DEBUG nova.network.neutron [req-dc1be3c7-727b-4940-8315-db37afb4e082 req-ae6b7909-4815-4c45-a108-a1a3a6aa8fa4 service nova] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Updated VIF entry in instance network info cache for port 423dc8c8-ef91-4b4c-a3f1-29f8769ae668. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:30:01 user nova-compute[74247]: DEBUG nova.network.neutron [req-dc1be3c7-727b-4940-8315-db37afb4e082 req-ae6b7909-4815-4c45-a108-a1a3a6aa8fa4 service nova] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Updating instance_info_cache with network_info: [{"id": "423dc8c8-ef91-4b4c-a3f1-29f8769ae668", "address": "fa:16:3e:f9:1d:bf", "network": {"id": "46ba27ba-e8dd-4c09-8b0e-1418f651dc21", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1347745998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85a018057c194fc497ad8476dd290a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap423dc8c8-ef", "ovs_interfaceid": "423dc8c8-ef91-4b4c-a3f1-29f8769ae668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:30:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-dc1be3c7-727b-4940-8315-db37afb4e082 req-ae6b7909-4815-4c45-a108-a1a3a6aa8fa4 service nova] Releasing lock "refresh_cache-d4c23a0a-d5cb-4893-9a40-4586e98a2535" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:30:01 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:01 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:01 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:01 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:01 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:02 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:02 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:30:02 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:30:02 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=7941MB free_disk=25.25851821899414GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 18:30:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:30:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:30:02 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Applying migration context for instance a686ee86-272c-47be-8801-9c1500af272f as it has an incoming, in-progress migration 5f5d97b0-24f7-49fa-a306-467fe63e51f3. Migration status is finished {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 16 18:30:02 user nova-compute[74247]: INFO nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: a686ee86-272c-47be-8801-9c1500af272f] Updating resource usage from migration 5f5d97b0-24f7-49fa-a306-467fe63e51f3
Oct 16 18:30:02 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:30:02 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance e37fbc27-3404-479a-be08-4d590391cf30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:30:02 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 4daa6370-2cdf-4668-b66b-e10196377c9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:30:02 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:30:02 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance bbec99d1-82a3-4e4d-a3ae-17e00821bee1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:30:02 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 7c17a25b-6818-48fa-b406-638dbf1845d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:30:02 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Migration 5f5d97b0-24f7-49fa-a306-467fe63e51f3 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 16 18:30:02 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance a686ee86-272c-47be-8801-9c1500af272f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:30:02 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 7fa3da6f-ba9f-4752-901a-933427fcbda8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:30:02 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance d4c23a0a-d5cb-4893-9a40-4586e98a2535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:30:02 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 18:30:02 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 18:30:02 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:30:02 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:30:02 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 18:30:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.501s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:30:02 user nova-compute[74247]: INFO nova.virt.block_device [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Booting with volume e8274378-306d-460c-82c3-abda468dd73a at /dev/vdb
Oct 16 18:30:03 user nova-compute[74247]: DEBUG nova.compute.manager [req-a73304f3-65cc-4973-97b4-3cd0daa5169c req-2910e69c-1f6f-4db6-923b-d3026af2417b service nova] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Received event network-vif-plugged-423dc8c8-ef91-4b4c-a3f1-29f8769ae668 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:30:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a73304f3-65cc-4973-97b4-3cd0daa5169c req-2910e69c-1f6f-4db6-923b-d3026af2417b service nova] Acquiring lock "d4c23a0a-d5cb-4893-9a40-4586e98a2535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:30:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a73304f3-65cc-4973-97b4-3cd0daa5169c req-2910e69c-1f6f-4db6-923b-d3026af2417b service nova] Lock "d4c23a0a-d5cb-4893-9a40-4586e98a2535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:30:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a73304f3-65cc-4973-97b4-3cd0daa5169c req-2910e69c-1f6f-4db6-923b-d3026af2417b service nova] Lock "d4c23a0a-d5cb-4893-9a40-4586e98a2535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:30:03 user nova-compute[74247]: DEBUG nova.compute.manager [req-a73304f3-65cc-4973-97b4-3cd0daa5169c req-2910e69c-1f6f-4db6-923b-d3026af2417b service nova] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] No waiting events found dispatching network-vif-plugged-423dc8c8-ef91-4b4c-a3f1-29f8769ae668 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:30:03 user nova-compute[74247]: WARNING nova.compute.manager [req-a73304f3-65cc-4973-97b4-3cd0daa5169c req-2910e69c-1f6f-4db6-923b-d3026af2417b service nova] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Received unexpected event network-vif-plugged-423dc8c8-ef91-4b4c-a3f1-29f8769ae668 for instance with vm_state building and task_state spawning.
Oct 16 18:30:03 user nova-compute[74247]: DEBUG nova.compute.manager [req-a73304f3-65cc-4973-97b4-3cd0daa5169c req-2910e69c-1f6f-4db6-923b-d3026af2417b service nova] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Received event network-vif-plugged-423dc8c8-ef91-4b4c-a3f1-29f8769ae668 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:30:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a73304f3-65cc-4973-97b4-3cd0daa5169c req-2910e69c-1f6f-4db6-923b-d3026af2417b service nova] Acquiring lock "d4c23a0a-d5cb-4893-9a40-4586e98a2535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:30:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a73304f3-65cc-4973-97b4-3cd0daa5169c req-2910e69c-1f6f-4db6-923b-d3026af2417b service nova] Lock "d4c23a0a-d5cb-4893-9a40-4586e98a2535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:30:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a73304f3-65cc-4973-97b4-3cd0daa5169c req-2910e69c-1f6f-4db6-923b-d3026af2417b service nova] Lock "d4c23a0a-d5cb-4893-9a40-4586e98a2535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:30:03 user nova-compute[74247]: DEBUG nova.compute.manager [req-a73304f3-65cc-4973-97b4-3cd0daa5169c req-2910e69c-1f6f-4db6-923b-d3026af2417b service nova] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] No waiting events found dispatching network-vif-plugged-423dc8c8-ef91-4b4c-a3f1-29f8769ae668 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:30:03 user nova-compute[74247]: WARNING nova.compute.manager [req-a73304f3-65cc-4973-97b4-3cd0daa5169c req-2910e69c-1f6f-4db6-923b-d3026af2417b service nova] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Received unexpected event network-vif-plugged-423dc8c8-ef91-4b4c-a3f1-29f8769ae668 for instance with vm_state building and task_state spawning.
Oct 16 18:30:03 user nova-compute[74247]: DEBUG os_brick.utils [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:30:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32fb71e-96de-47a4-80e9-6ef16de32f33]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec786c0e-82aa-4f3a-be78-a6e57f51b0cb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3dca05-b1fc-4a77-a53b-3ff145da3006]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[febbf7a8-1c46-41b4-acba-8e7550b49ff4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:30:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 18:30:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:30:03 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 18:30:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e03642-8531-42a4-bbe1-3bf5c5a35833]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 18:30:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 18:30:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 18:30:03 user nova-compute[74247]: DEBUG os_brick.utils [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:30:03 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Updating existing volume attachment record: b92e0cf8-9ad5-421e-857d-7853d210bfca {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 18:30:03 user nova-compute[74247]: DEBUG nova.compute.manager [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:30:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:30:03 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Instance spawned successfully.
Oct 16 18:30:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 18:30:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:30:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:30:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:30:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:30:04 user nova-compute[74247]: INFO nova.compute.manager [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Took 8.00 seconds to spawn the instance on the hypervisor.
Oct 16 18:30:04 user nova-compute[74247]: DEBUG nova.compute.manager [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:30:04 user nova-compute[74247]: INFO nova.compute.manager [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Took 9.34 seconds to build instance.
Oct 16 18:30:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3ce9965b-1cad-48fc-a9e0-dbf60111d84e tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Lock "d4c23a0a-d5cb-4893-9a40-4586e98a2535" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.478s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:30:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:10 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:12 user nova-compute[74247]: DEBUG nova.network.neutron [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Port 8cb168df-92d2-4ecc-946a-7d9075f75561 binding to destination host user is already ACTIVE {{(pid=74247) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Oct 16 18:30:12 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Acquiring lock "refresh_cache-a686ee86-272c-47be-8801-9c1500af272f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:30:12 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Acquired lock "refresh_cache-a686ee86-272c-47be-8801-9c1500af272f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:30:12 user nova-compute[74247]: DEBUG nova.network.neutron [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:30:12 user nova-compute[74247]: DEBUG nova.network.neutron [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Updating instance_info_cache with network_info: [{"id": "8cb168df-92d2-4ecc-946a-7d9075f75561", "address": "fa:16:3e:9d:bb:be", "network": {"id": "f12e9b98-2724-4b9c-a299-7286c163458c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1410604293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973c8310858e4e1dafbc2fa926995940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb168df-92", "ovs_interfaceid": "8cb168df-92d2-4ecc-946a-7d9075f75561", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:30:12 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Releasing lock "refresh_cache-a686ee86-272c-47be-8801-9c1500af272f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:30:12 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Creating tmpfile /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/tmpobugqod6 to verify with other compute node that the instance is on the same shared storage. {{(pid=74247) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Oct 16 18:30:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:13 user nova-compute[74247]: DEBUG nova.compute.manager [req-9c6d4901-c8ea-46cd-80e0-17b1ca75968b req-ffcc1348-5e95-4ed0-a192-ce819c4b7240 service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] Received event network-vif-unplugged-8cb168df-92d2-4ecc-946a-7d9075f75561 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:30:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9c6d4901-c8ea-46cd-80e0-17b1ca75968b req-ffcc1348-5e95-4ed0-a192-ce819c4b7240 service nova] Acquiring lock "a686ee86-272c-47be-8801-9c1500af272f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:30:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9c6d4901-c8ea-46cd-80e0-17b1ca75968b req-ffcc1348-5e95-4ed0-a192-ce819c4b7240 service nova] Lock "a686ee86-272c-47be-8801-9c1500af272f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:30:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9c6d4901-c8ea-46cd-80e0-17b1ca75968b req-ffcc1348-5e95-4ed0-a192-ce819c4b7240 service nova] Lock "a686ee86-272c-47be-8801-9c1500af272f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:30:13 user nova-compute[74247]: DEBUG nova.compute.manager [req-9c6d4901-c8ea-46cd-80e0-17b1ca75968b req-ffcc1348-5e95-4ed0-a192-ce819c4b7240 service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] No waiting events found dispatching network-vif-unplugged-8cb168df-92d2-4ecc-946a-7d9075f75561 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:30:13 user nova-compute[74247]: WARNING nova.compute.manager [req-9c6d4901-c8ea-46cd-80e0-17b1ca75968b req-ffcc1348-5e95-4ed0-a192-ce819c4b7240 service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] Received unexpected event network-vif-unplugged-8cb168df-92d2-4ecc-946a-7d9075f75561 for instance with vm_state resized and task_state resize_reverting.
Oct 16 18:30:13 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: a686ee86-272c-47be-8801-9c1500af272f] Instance destroyed successfully.
Oct 16 18:30:13 user nova-compute[74247]: DEBUG nova.objects.instance [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lazy-loading 'resources' on Instance uuid a686ee86-272c-47be-8801-9c1500af272f {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:30:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:24:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-208936177',display_name='tempest-ServerActionsTestOtherB-server-208936177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-208936177',id=4,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIs9LtanBEbN6S6UJgwgQipMcrzgCgmqD+MSXO/I2jlCfUtIcGHYoW9tgqCxpGH6Qd6bb/kDDqj9dBay7WvsSTTn0A8mddCk4+U9BnAHzFohZU35eWuYV7ckMsEqil5fw==',key_name='tempest-keypair-447758938',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:29:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='973c8310858e4e1dafbc2fa926995940',ramdisk_id='',reservation_id='r-2wkxxe7p',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-650770368',owner_user_name='tempest-ServerActionsTestOtherB-650770368-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:29:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b6734bfca1e4bf5b3c75d06eb471220',uuid=a686ee86-272c-47be-8801-9c1500af272f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "8cb168df-92d2-4ecc-946a-7d9075f75561", "address": "fa:16:3e:9d:bb:be", "network": {"id": "f12e9b98-2724-4b9c-a299-7286c163458c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1410604293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973c8310858e4e1dafbc2fa926995940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb168df-92", "ovs_interfaceid": "8cb168df-92d2-4ecc-946a-7d9075f75561", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:30:13 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Converting VIF {"id": "8cb168df-92d2-4ecc-946a-7d9075f75561", "address": "fa:16:3e:9d:bb:be", "network": {"id": "f12e9b98-2724-4b9c-a299-7286c163458c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1410604293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973c8310858e4e1dafbc2fa926995940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb168df-92", "ovs_interfaceid": "8cb168df-92d2-4ecc-946a-7d9075f75561", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:30:13 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:bb:be,bridge_name='br-int',has_traffic_filtering=True,id=8cb168df-92d2-4ecc-946a-7d9075f75561,network=Network(f12e9b98-2724-4b9c-a299-7286c163458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb168df-92') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:30:13 user nova-compute[74247]: DEBUG os_vif [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:bb:be,bridge_name='br-int',has_traffic_filtering=True,id=8cb168df-92d2-4ecc-946a-7d9075f75561,network=Network(f12e9b98-2724-4b9c-a299-7286c163458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb168df-92') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:30:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8cb168df-92, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:30:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:30:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=918291ee-5589-4b3c-82af-c65f8117a761) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:30:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:13 user nova-compute[74247]: INFO os_vif [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:bb:be,bridge_name='br-int',has_traffic_filtering=True,id=8cb168df-92d2-4ecc-946a-7d9075f75561,network=Network(f12e9b98-2724-4b9c-a299-7286c163458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb168df-92')
Oct 16 18:30:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 18:30:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MHBuxbDs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:30:13 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:30:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:30:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:30:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:13 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c5a10f-acba-4265-b6c4-0645cfdd0331]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 18:30:13 user nova-compute[74247]: No targets found.
Oct 16 18:30:13 user nova-compute[74247]: iSNS:
Oct 16 18:30:13 user nova-compute[74247]: No targets found.
Oct 16 18:30:13 user nova-compute[74247]: STATIC:
Oct 16 18:30:13 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6
Oct 16 18:30:13 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:30:13 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:30:13 user nova-compute[74247]: FIRMWARE:
Oct 16 18:30:13 user nova-compute[74247]: No targets found.
Oct 16 18:30:13 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:30:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 18:30:13 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 18:30:13 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 18:30:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 18:30:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:13 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4666a98e-00b4-420e-b79a-7b32c0a32b53]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:13 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96ce5e6-7f00-4685-92d3-54d392c510bb]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:30:13 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:30:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:30:13 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:30:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe07815f250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6'): ({'sdb'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 18:30:13 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Removing single pathed devices sdb {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 18:30:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:13 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a944efa5-c919-4ade-aff0-ab21f4bca44a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:14 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[684a8458-6802-4be1-b14b-334868bf51c3]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:14 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Flushing IO for device /dev/sdb {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 18:30:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:14 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3992da1-8058-44f9-be18-d2bd36ba7209]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:14 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 18:30:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:14 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[13087cb9-6c7d-4520-9041-0a6c6807fd00]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:14 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 18:30:14 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] SCSI volumes sdb have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 18:30:14 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 18:30:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:14 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f818dfbc-b542-4e12-ba55-c0a9c3b24f22]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:14 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:30:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:14 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1f7e71-250c-4b5d-a314-b19a42762a80]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:14 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6, portal: 172.16.0.220,3260]
Oct 16 18:30:14 user nova-compute[74247]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6, portal: 172.16.0.220,3260] successful.
Oct 16 18:30:14 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:30:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:14 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd646e5c-5349-43e8-b66a-59e77c262747]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:14 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:30:14 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.266s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:30:14 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] <== disconnect_volume: return (268ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:30:14 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 18:30:15 user nova-compute[74247]: DEBUG nova.compute.manager [req-ec40cb19-60f2-4e8e-8d01-ec0d03d39ac2 req-1786f7ac-98b4-4553-bb21-b34f368c7725 service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] Received event network-vif-plugged-8cb168df-92d2-4ecc-946a-7d9075f75561 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:30:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-ec40cb19-60f2-4e8e-8d01-ec0d03d39ac2 req-1786f7ac-98b4-4553-bb21-b34f368c7725 service nova] Acquiring lock "a686ee86-272c-47be-8801-9c1500af272f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:30:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-ec40cb19-60f2-4e8e-8d01-ec0d03d39ac2 req-1786f7ac-98b4-4553-bb21-b34f368c7725 service nova] Lock "a686ee86-272c-47be-8801-9c1500af272f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:30:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-ec40cb19-60f2-4e8e-8d01-ec0d03d39ac2 req-1786f7ac-98b4-4553-bb21-b34f368c7725 service nova] Lock "a686ee86-272c-47be-8801-9c1500af272f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:30:15 user nova-compute[74247]: DEBUG nova.compute.manager [req-ec40cb19-60f2-4e8e-8d01-ec0d03d39ac2 req-1786f7ac-98b4-4553-bb21-b34f368c7725 service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] No waiting events found dispatching network-vif-plugged-8cb168df-92d2-4ecc-946a-7d9075f75561 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:30:15 user nova-compute[74247]: WARNING nova.compute.manager [req-ec40cb19-60f2-4e8e-8d01-ec0d03d39ac2 req-1786f7ac-98b4-4553-bb21-b34f368c7725 service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] Received unexpected event network-vif-plugged-8cb168df-92d2-4ecc-946a-7d9075f75561 for instance with vm_state resized and task_state resize_reverting.
Oct 16 18:30:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:16 user nova-compute[74247]: INFO nova.compute.manager [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Took 17.62 seconds to detach 1 volumes for instance.
Oct 16 18:30:16 user nova-compute[74247]: DEBUG nova.compute.manager [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] [instance: 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b] Deleting volume: 3ab08fda-c4e7-456c-8003-24c8bfb6c688 {{(pid=74247) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KFNyGMIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:30:16 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:30:16 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:30:16 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:30:16 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:30:16 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:30:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6228541-bf71-49f6-9e6a-9c4fe0e89685]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 18:30:16 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec673ad0-d9ae-41a9-baf7-ec2b6b0b92ec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313] added
Oct 16 18:30:16 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[19160d2b-aa93-43a4-ae52-db6c18039637]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad412b0-961a-4203-a569-df5fd1560bf3]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KFNyGMIq {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KFNyGMIq" returned: 0 in 0.026s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff6c89d-e6bb-46e6-8bab-8c6b9ef5f5ce]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KFNyGMIq'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f85939-1536-47f2-b211-4c7ff4e97971]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5076f9a2-a0ad-4a36-ad35-59b5c45bb9fa]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 16 18:30:16 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 16 18:30:16 user nova-compute[74247]:  {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:30:16 user nova-compute[74247]: WARNING os_brick.initiator.connectors.iscsi [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 16 18:30:16 user nova-compute[74247]: 
Oct 16 18:30:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3394d7-ee25-458c-a107-24416a8be809]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313, portal: 172.16.0.220,3260]
Oct 16 18:30:16 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313, portal: 172.16.0.220,3260] successful.
Oct 16 18:30:16 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b1c285-fb16-41e2-8660-b4df0fe16f13]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebc7c0e-1b91-47b0-ba59-4d49f7b6170d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:30:16 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:30:16 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc52649e-ae49-4954-ae58-df1150a20661]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:30:16 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KFNyGMIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:30:17 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:30:17 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:30:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.419s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:30:17 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Deleted allocations for instance 73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b
Oct 16 18:30:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-328b3f1f-6b45-4d21-9120-d67ed1c0dcaf tempest-ServerActionsV293TestJSON-1771639004 tempest-ServerActionsV293TestJSON-1771639004-project-member] Lock "73f6cb3d-2c2b-4561-bbb0-f3f5cef3778b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 21.342s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:30:17 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:30:17 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26133313733383166', 'path': '/dev/sdb'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:30:17 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133313733383166', 'path': '/dev/sdb'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:30:17 user nova-compute[74247]: DEBUG nova.objects.instance [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lazy-loading 'flavor' on Instance uuid bbec99d1-82a3-4e4d-a3ae-17e00821bee1 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:30:18 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 18:30:18 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:30:18 user nova-compute[74247]:   <source dev="/dev/sdb"/>
Oct 16 18:30:18 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:30:18 user nova-compute[74247]:   <serial>91e22910-3fb9-43fd-ac65-70fb0215b313</serial>
Oct 16 18:30:18 user nova-compute[74247]: </disk>
Oct 16 18:30:18 user nova-compute[74247]:  {{(pid=74247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 18:30:18 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:30:18 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:30:18 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] No VIF found with MAC fa:16:3e:d4:26:c0, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:30:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-7ddb3fa6-64dd-4cea-8408-ae8fa7dbeebc tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "bbec99d1-82a3-4e4d-a3ae-17e00821bee1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 42.518s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:30:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:19 user nova-compute[74247]: INFO nova.compute.manager [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Rebuilding instance
Oct 16 18:30:19 user nova-compute[74247]: DEBUG nova.compute.manager [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:30:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:20 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._sync_power_states {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:30:20 user nova-compute[74247]: DEBUG nova.compute.manager [req-222dfcdc-c039-4127-9eb9-326a751f4b64 req-6d38c032-8605-4573-8edb-f312b287a3a0 service nova] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Received event network-vif-unplugged-db973a04-4ef6-40c2-a694-c7a12631bc59 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:30:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-222dfcdc-c039-4127-9eb9-326a751f4b64 req-6d38c032-8605-4573-8edb-f312b287a3a0 service nova] Acquiring lock "bbec99d1-82a3-4e4d-a3ae-17e00821bee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:30:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-222dfcdc-c039-4127-9eb9-326a751f4b64 req-6d38c032-8605-4573-8edb-f312b287a3a0 service nova] Lock "bbec99d1-82a3-4e4d-a3ae-17e00821bee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:30:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-222dfcdc-c039-4127-9eb9-326a751f4b64 req-6d38c032-8605-4573-8edb-f312b287a3a0 service nova] Lock "bbec99d1-82a3-4e4d-a3ae-17e00821bee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:30:20 user nova-compute[74247]: DEBUG nova.compute.manager [req-222dfcdc-c039-4127-9eb9-326a751f4b64 req-6d38c032-8605-4573-8edb-f312b287a3a0 service nova] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] No waiting events found dispatching network-vif-unplugged-db973a04-4ef6-40c2-a694-c7a12631bc59 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:30:20 user nova-compute[74247]: WARNING nova.compute.manager [req-222dfcdc-c039-4127-9eb9-326a751f4b64 req-6d38c032-8605-4573-8edb-f312b287a3a0 service nova] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Received unexpected event network-vif-unplugged-db973a04-4ef6-40c2-a694-c7a12631bc59 for instance with vm_state active and task_state rebuilding.
Oct 16 18:30:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:20 user nova-compute[74247]: WARNING nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] While synchronizing instance power states, found 8 instances in the database and 6 instances on the hypervisor.
Oct 16 18:30:20 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Triggering sync for uuid b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d {{(pid=74247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 18:30:20 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Triggering sync for uuid e37fbc27-3404-479a-be08-4d590391cf30 {{(pid=74247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 18:30:20 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Triggering sync for uuid a686ee86-272c-47be-8801-9c1500af272f {{(pid=74247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 18:30:20 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Triggering sync for uuid 4daa6370-2cdf-4668-b66b-e10196377c9c {{(pid=74247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 18:30:20 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Triggering sync for uuid bbec99d1-82a3-4e4d-a3ae-17e00821bee1 {{(pid=74247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 18:30:20 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Triggering sync for uuid 7c17a25b-6818-48fa-b406-638dbf1845d4 {{(pid=74247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 18:30:20 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Triggering sync for uuid 7fa3da6f-ba9f-4752-901a-933427fcbda8 {{(pid=74247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 18:30:20 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Triggering sync for uuid d4c23a0a-d5cb-4893-9a40-4586e98a2535 {{(pid=74247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 18:30:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:30:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:30:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "e37fbc27-3404-479a-be08-4d590391cf30" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:30:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "e37fbc27-3404-479a-be08-4d590391cf30" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:30:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "a686ee86-272c-47be-8801-9c1500af272f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:30:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "a686ee86-272c-47be-8801-9c1500af272f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:30:20 user nova-compute[74247]: INFO nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: a686ee86-272c-47be-8801-9c1500af272f] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Oct 16 18:30:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "a686ee86-272c-47be-8801-9c1500af272f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:30:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "4daa6370-2cdf-4668-b66b-e10196377c9c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:30:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "4daa6370-2cdf-4668-b66b-e10196377c9c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:30:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "bbec99d1-82a3-4e4d-a3ae-17e00821bee1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:30:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "bbec99d1-82a3-4e4d-a3ae-17e00821bee1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:30:20 user nova-compute[74247]: INFO nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] During sync_power_state the instance has a pending task (rebuilding). Skip.
Oct 16 18:30:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "bbec99d1-82a3-4e4d-a3ae-17e00821bee1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:30:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "7c17a25b-6818-48fa-b406-638dbf1845d4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:30:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "7c17a25b-6818-48fa-b406-638dbf1845d4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:30:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "7fa3da6f-ba9f-4752-901a-933427fcbda8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:30:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "d4c23a0a-d5cb-4893-9a40-4586e98a2535" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:30:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "d4c23a0a-d5cb-4893-9a40-4586e98a2535" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:30:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "4daa6370-2cdf-4668-b66b-e10196377c9c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:30:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.100s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:30:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "7c17a25b-6818-48fa-b406-638dbf1845d4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.117s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:30:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "d4c23a0a-d5cb-4893-9a40-4586e98a2535" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.117s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:30:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "e37fbc27-3404-479a-be08-4d590391cf30" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.124s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:30:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:20 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Instance destroyed successfully.
Oct 16 18:30:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:20 user nova-compute[74247]: INFO nova.compute.manager [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Detaching volume 91e22910-3fb9-43fd-ac65-70fb0215b313
Oct 16 18:30:20 user nova-compute[74247]: INFO nova.virt.block_device [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Attempting to driver detach volume 91e22910-3fb9-43fd-ac65-70fb0215b313 from mountpoint /dev/vdb
Oct 16 18:30:20 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Attempting to detach device vdb from instance bbec99d1-82a3-4e4d-a3ae-17e00821bee1 from the persistent domain config. {{(pid=74247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 18:30:20 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 18:30:20 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:30:20 user nova-compute[74247]:   <source dev="/dev/sdb"/>
Oct 16 18:30:20 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:30:20 user nova-compute[74247]:   <serial>91e22910-3fb9-43fd-ac65-70fb0215b313</serial>
Oct 16 18:30:20 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 18:30:20 user nova-compute[74247]: </disk>
Oct 16 18:30:20 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:30:20 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Successfully detached device vdb from instance bbec99d1-82a3-4e4d-a3ae-17e00821bee1 from the persistent domain config.
Oct 16 18:30:21 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KFNyGMIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:30:21 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 16 18:30:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a61b25-2f39-468e-b1a5-d7ef3ee79f2f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 18:30:21 user nova-compute[74247]: No targets found.
Oct 16 18:30:21 user nova-compute[74247]: iSNS:
Oct 16 18:30:21 user nova-compute[74247]: No targets found.
Oct 16 18:30:21 user nova-compute[74247]: STATIC:
Oct 16 18:30:21 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313
Oct 16 18:30:21 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:30:21 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:30:21 user nova-compute[74247]: FIRMWARE:
Oct 16 18:30:21 user nova-compute[74247]: No targets found.
Oct 16 18:30:21 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 18:30:21 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 18:30:21 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e92692-2fd1-4903-8945-e79a30b53045]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1499db9-f97a-47b9-aae1-65decc4fe433]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:30:21 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:30:21 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe07815e0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313'): ({'sdb'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Removing single pathed devices sdb {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f46b002-ad54-4319-ac49-884913e08510]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[09603315-009f-4ea6-ac03-d05481e8088c]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Flushing IO for device /dev/sdb {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d3ff4c-98d2-4661-9702-95c76b0c6f4d]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cea294c-e2f2-42aa-99f4-773b105fa096]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] SCSI volumes sdb have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec20627e-d23b-423a-bf74-8deb42bc411c]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4ce4dd-4bf3-406f-8d56-fa6c241a037b]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313, portal: 172.16.0.220,3260]
Oct 16 18:30:21 user nova-compute[74247]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313, portal: 172.16.0.220,3260] successful.
Oct 16 18:30:21 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9862f7e1-275d-428a-be93-afb35a81882f]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] <== disconnect_volume: return (303ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:30:21 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 18:30:21 user nova-compute[74247]: INFO nova.virt.block_device [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Booting with volume 012ad1ce-7193-4cf7-918c-d9cf4b9beba2 at /dev/vdc
Oct 16 18:30:22 user nova-compute[74247]: DEBUG os_brick.utils [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[047c982a-6ef4-416b-b6bb-045620faf746]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a06f26-e38e-401a-b767-2518fbbc8020]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG nova.compute.manager [req-9445d923-11ac-4936-b54b-3a8092be57a6 req-8bb3a65e-1e2c-4336-9d7d-91329cd1fa70 service nova] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Received event network-vif-plugged-db973a04-4ef6-40c2-a694-c7a12631bc59 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9445d923-11ac-4936-b54b-3a8092be57a6 req-8bb3a65e-1e2c-4336-9d7d-91329cd1fa70 service nova] Acquiring lock "bbec99d1-82a3-4e4d-a3ae-17e00821bee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9445d923-11ac-4936-b54b-3a8092be57a6 req-8bb3a65e-1e2c-4336-9d7d-91329cd1fa70 service nova] Lock "bbec99d1-82a3-4e4d-a3ae-17e00821bee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9445d923-11ac-4936-b54b-3a8092be57a6 req-8bb3a65e-1e2c-4336-9d7d-91329cd1fa70 service nova] Lock "bbec99d1-82a3-4e4d-a3ae-17e00821bee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG nova.compute.manager [req-9445d923-11ac-4936-b54b-3a8092be57a6 req-8bb3a65e-1e2c-4336-9d7d-91329cd1fa70 service nova] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] No waiting events found dispatching network-vif-plugged-db973a04-4ef6-40c2-a694-c7a12631bc59 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:30:22 user nova-compute[74247]: WARNING nova.compute.manager [req-9445d923-11ac-4936-b54b-3a8092be57a6 req-8bb3a65e-1e2c-4336-9d7d-91329cd1fa70 service nova] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Received unexpected event network-vif-plugged-db973a04-4ef6-40c2-a694-c7a12631bc59 for instance with vm_state active and task_state rebuilding.
Oct 16 18:30:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[88cc9782-cf9b-4f80-9407-fab431d8279d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aba89f3-be90-4750-97eb-e092b94c4223]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:30:22 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 18:30:22 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a8a065-6f59-40f9-a251-e45e5c920cb0]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG os_brick.utils [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Updating existing volume attachment record: 0fe49f83-fb82-484a-a958-6d2006833847 {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 18:30:22 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Instance destroyed successfully.
Oct 16 18:30:22 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:27:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1420825392',display_name='tempest-ServerActionsTestOtherA-server-584745225',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1420825392',id=13,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/3EvcYxSkv6EajRRkIzaFJ7f6uQhbqAKTds5ThHn386Pv+2tTgzyep551R0scho5zPYioOvrd00bJSB88s5K62otshFm+0x2KfMMxvYgCDs49Lx6Y3dzbzd3EgGqdZmw==',key_name='tempest-keypair-461314413',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:27:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='42bd3eb752f04fd48dfe0623fdf2fe9f',ramdisk_id='',reservation_id='r-vea0fn6c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-291765974',owner_user_name='tempest-ServerActionsTestOtherA-291765974-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:30:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3635a30f06234f0d9a8e0604c25f1208',uuid=bbec99d1-82a3-4e4d-a3ae-17e00821bee1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db973a04-4ef6-40c2-a694-c7a12631bc59", "address": "fa:16:3e:d4:26:c0", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb973a04-4e", "ovs_interfaceid": "db973a04-4ef6-40c2-a694-c7a12631bc59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Converting VIF {"id": "db973a04-4ef6-40c2-a694-c7a12631bc59", "address": "fa:16:3e:d4:26:c0", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb973a04-4e", "ovs_interfaceid": "db973a04-4ef6-40c2-a694-c7a12631bc59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:26:c0,bridge_name='br-int',has_traffic_filtering=True,id=db973a04-4ef6-40c2-a694-c7a12631bc59,network=Network(0a61bae1-2607-4e42-b573-e74ac3edf09a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb973a04-4e') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG os_vif [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:26:c0,bridge_name='br-int',has_traffic_filtering=True,id=db973a04-4ef6-40c2-a694-c7a12631bc59,network=Network(0a61bae1-2607-4e42-b573-e74ac3edf09a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb973a04-4e') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb973a04-4e, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6dfae2e1-599d-4000-bf4b-6aa7b1c574c7) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:22 user nova-compute[74247]: INFO os_vif [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:26:c0,bridge_name='br-int',has_traffic_filtering=True,id=db973a04-4ef6-40c2-a694-c7a12631bc59,network=Network(0a61bae1-2607-4e42-b573-e74ac3edf09a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb973a04-4e')
Oct 16 18:30:22 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KFNyGMIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:30:22 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 16 18:30:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[59fac28d-65f2-44f7-9447-0f52a191ddc1]: Unexpected error while running command.
Oct 16 18:30:22 user nova-compute[74247]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 16 18:30:22 user nova-compute[74247]: Exit code: 21
Oct 16 18:30:22 user nova-compute[74247]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 16 18:30:22 user nova-compute[74247]: Stderr: '' {{(pid=85128) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Oct 16 18:30:22 user nova-compute[74247]: Traceback (most recent call last):
Oct 16 18:30:22 user nova-compute[74247]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Oct 16 18:30:22 user nova-compute[74247]:     ret = func(*f_args, **f_kwargs)
Oct 16 18:30:22 user nova-compute[74247]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Oct 16 18:30:22 user nova-compute[74247]:     return func(*args, **kwargs)
Oct 16 18:30:22 user nova-compute[74247]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Oct 16 18:30:22 user nova-compute[74247]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Oct 16 18:30:22 user nova-compute[74247]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Oct 16 18:30:22 user nova-compute[74247]:     return putils.execute(on_execute=on_execute,
Oct 16 18:30:22 user nova-compute[74247]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Oct 16 18:30:22 user nova-compute[74247]:     raise ProcessExecutionError(exit_code=_returncode,
Oct 16 18:30:22 user nova-compute[74247]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 16 18:30:22 user nova-compute[74247]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 16 18:30:22 user nova-compute[74247]: Exit code: 21
Oct 16 18:30:22 user nova-compute[74247]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 16 18:30:22 user nova-compute[74247]: Stderr: ''
Oct 16 18:30:22 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fac28d-65f2-44f7-9447-0f52a191ddc1]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:22 user nova-compute[74247]: ERROR os_brick.initiator.connectors.iscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 16 18:30:22 user nova-compute[74247]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 16 18:30:22 user nova-compute[74247]: Exit code: 21
Oct 16 18:30:22 user nova-compute[74247]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 16 18:30:22 user nova-compute[74247]: Stderr: ''
Oct 16 18:30:22 user nova-compute[74247]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Oct 16 18:30:22 user nova-compute[74247]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/nova/nova/compute/manager.py", line 4131, in _do_rebuild_instance
Oct 16 18:30:22 user nova-compute[74247]: ERROR os_brick.initiator.connectors.iscsi     self.driver.rebuild(**kwargs)
Oct 16 18:30:22 user nova-compute[74247]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/nova/nova/virt/driver.py", line 384, in rebuild
Oct 16 18:30:22 user nova-compute[74247]: ERROR os_brick.initiator.connectors.iscsi     raise NotImplementedError()
Oct 16 18:30:22 user nova-compute[74247]: ERROR os_brick.initiator.connectors.iscsi NotImplementedError
Oct 16 18:30:22 user nova-compute[74247]: ERROR os_brick.initiator.connectors.iscsi 
Oct 16 18:30:22 user nova-compute[74247]: ERROR os_brick.initiator.connectors.iscsi During handling of the above exception, another exception occurred:
Oct 16 18:30:22 user nova-compute[74247]: ERROR os_brick.initiator.connectors.iscsi 
Oct 16 18:30:22 user nova-compute[74247]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Oct 16 18:30:22 user nova-compute[74247]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Oct 16 18:30:22 user nova-compute[74247]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Oct 16 18:30:22 user nova-compute[74247]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Oct 16 18:30:22 user nova-compute[74247]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Oct 16 18:30:22 user nova-compute[74247]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Oct 16 18:30:22 user nova-compute[74247]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Oct 16 18:30:22 user nova-compute[74247]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Oct 16 18:30:22 user nova-compute[74247]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Oct 16 18:30:22 user nova-compute[74247]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Oct 16 18:30:22 user nova-compute[74247]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Oct 16 18:30:22 user nova-compute[74247]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Oct 16 18:30:22 user nova-compute[74247]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Oct 16 18:30:22 user nova-compute[74247]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Oct 16 18:30:22 user nova-compute[74247]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Oct 16 18:30:22 user nova-compute[74247]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 16 18:30:22 user nova-compute[74247]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Oct 16 18:30:22 user nova-compute[74247]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Oct 16 18:30:22 user nova-compute[74247]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 16 18:30:22 user nova-compute[74247]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Oct 16 18:30:22 user nova-compute[74247]: ERROR os_brick.initiator.connectors.iscsi 
Oct 16 18:30:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=74247) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.029s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] <== disconnect_volume: return (31ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 18:30:22 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Deleting instance files /opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1_del
Oct 16 18:30:22 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Deletion of /opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1_del complete
Oct 16 18:30:22 user nova-compute[74247]: INFO nova.virt.block_device [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Booting with volume 91e22910-3fb9-43fd-ac65-70fb0215b313 at /dev/vdb
Oct 16 18:30:22 user nova-compute[74247]: DEBUG os_brick.utils [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[20540d98-f776-428f-bcf9-51a03b1b53f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cdb1b0c-34fa-4a8f-9a09-54a1ffdbab33]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b929628c-a4b6-4fab-be3d-2522154fc650]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee55dd0c-3ca8-4378-abd1-925afe16fa5a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:30:22 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 18:30:22 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ba5293-8981-4832-a760-1a7d7bac3721]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG os_brick.utils [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:30:22 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Updating existing volume attachment record: 72b84dd4-ad35-484f-8151-30239cf2f3eb {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 18:30:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:32 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:30:32 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:30:32 user nova-compute[74247]: DEBUG nova.objects.instance [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lazy-loading 'migration_context' on Instance uuid a686ee86-272c-47be-8801-9c1500af272f {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:30:32 user nova-compute[74247]: DEBUG nova.objects.base [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Object Instance<a686ee86-272c-47be-8801-9c1500af272f> lazy-loaded attributes: resources,migration_context {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:30:32 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:30:32 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:30:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.431s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:30:33 user nova-compute[74247]: INFO nova.compute.manager [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Swapping old allocation on dict_keys(['7b8a7b7b-c686-4162-903b-700fbc4d7273']) held by migration 5f5d97b0-24f7-49fa-a306-467fe63e51f3 for instance
Oct 16 18:30:33 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Overwriting current allocation {'allocations': {'7b8a7b7b-c686-4162-903b-700fbc4d7273': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 20}}, 'project_id': '973c8310858e4e1dafbc2fa926995940', 'user_id': '2b6734bfca1e4bf5b3c75d06eb471220', 'consumer_generation': 1} on consumer a686ee86-272c-47be-8801-9c1500af272f {{(pid=74247) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Oct 16 18:30:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Acquiring lock "refresh_cache-a686ee86-272c-47be-8801-9c1500af272f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:30:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Acquired lock "refresh_cache-a686ee86-272c-47be-8801-9c1500af272f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:30:33 user nova-compute[74247]: DEBUG nova.network.neutron [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:30:33 user nova-compute[74247]: DEBUG nova.network.neutron [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Updating instance_info_cache with network_info: [{"id": "8cb168df-92d2-4ecc-946a-7d9075f75561", "address": "fa:16:3e:9d:bb:be", "network": {"id": "f12e9b98-2724-4b9c-a299-7286c163458c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1410604293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973c8310858e4e1dafbc2fa926995940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb168df-92", "ovs_interfaceid": "8cb168df-92d2-4ecc-946a-7d9075f75561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:30:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Releasing lock "refresh_cache-a686ee86-272c-47be-8801-9c1500af272f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:30:33 user nova-compute[74247]: DEBUG os_brick.utils [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:30:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:33 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ff2ffb-75c7-4a04-a6cd-027a63e2305c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:34 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fab8f2-3266-41de-9516-8630c487b42d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:34 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[34121fb2-aa38-4217-bb2b-7cc7d55bfe1e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:34 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[74dac805-59ff-40fc-806c-d03b857430a3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:30:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 18:30:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:30:34 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 18:30:34 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[43223a8a-b01f-4806-9b13-a0b09ecaf61e]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:30:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 18:30:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 18:30:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 18:30:34 user nova-compute[74247]: DEBUG os_brick.utils [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:30:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:37 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:44 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:46 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "cddf4842-1c25-4cc8-914e-af30849e4d6c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:30:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "cddf4842-1c25-4cc8-914e-af30849e4d6c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:30:47 user nova-compute[74247]: DEBUG nova.compute.manager [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 18:30:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:30:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:30:47 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:30:47 user nova-compute[74247]: INFO nova.compute.claims [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Claim successful on node user
Oct 16 18:30:48 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:30:48 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:30:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.470s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:30:48 user nova-compute[74247]: DEBUG nova.compute.manager [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 18:30:48 user nova-compute[74247]: DEBUG nova.compute.manager [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 18:30:48 user nova-compute[74247]: DEBUG nova.network.neutron [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 18:30:48 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 18:30:48 user nova-compute[74247]: DEBUG nova.compute.manager [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 18:30:48 user nova-compute[74247]: DEBUG nova.policy [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b01d3e5d2fcb40bc92c3d2fe1236d509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce6164a392e4cc2a027d12c49145e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 18:30:48 user nova-compute[74247]: DEBUG nova.compute.manager [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 18:30:48 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:30:48 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Creating image(s)
Oct 16 18:30:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "/opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:30:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "/opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:30:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "/opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:30:48 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:48 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.173s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "37399febbd18f60b85fd0f833558f6a3539ab231" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:30:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:30:48 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:49 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.203s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:49 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk 1073741824 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:49 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk 1073741824" returned: 0 in 0.059s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:30:49 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:49 user nova-compute[74247]: DEBUG nova.network.neutron [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Successfully created port: badc9f06-cef7-46bf-8b74-5d53401021f5 {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:30:49 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.187s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:49 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk. size=1073741824 {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 18:30:49 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:30:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:49 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:30:49 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Cannot resize image /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk to a smaller size. {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 18:30:49 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 18:30:49 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Ensure instance console log exists: /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:30:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:30:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:30:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:30:49 user nova-compute[74247]: DEBUG nova.network.neutron [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Successfully updated port: badc9f06-cef7-46bf-8b74-5d53401021f5 {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:30:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "refresh_cache-cddf4842-1c25-4cc8-914e-af30849e4d6c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:30:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquired lock "refresh_cache-cddf4842-1c25-4cc8-914e-af30849e4d6c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:30:49 user nova-compute[74247]: DEBUG nova.network.neutron [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG nova.compute.manager [req-20abe7b6-1029-4ecf-aa85-2ba136fc5e4f req-f3b9f60f-6bd0-430e-997f-4b035e9ca525 service nova] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Received event network-changed-badc9f06-cef7-46bf-8b74-5d53401021f5 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG nova.compute.manager [req-20abe7b6-1029-4ecf-aa85-2ba136fc5e4f req-f3b9f60f-6bd0-430e-997f-4b035e9ca525 service nova] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Refreshing instance network info cache due to event network-changed-badc9f06-cef7-46bf-8b74-5d53401021f5. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-20abe7b6-1029-4ecf-aa85-2ba136fc5e4f req-f3b9f60f-6bd0-430e-997f-4b035e9ca525 service nova] Acquiring lock "refresh_cache-cddf4842-1c25-4cc8-914e-af30849e4d6c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG nova.network.neutron [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG nova.network.neutron [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Updating instance_info_cache with network_info: [{"id": "badc9f06-cef7-46bf-8b74-5d53401021f5", "address": "fa:16:3e:c8:ea:de", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbadc9f06-ce", "ovs_interfaceid": "badc9f06-cef7-46bf-8b74-5d53401021f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Releasing lock "refresh_cache-cddf4842-1c25-4cc8-914e-af30849e4d6c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG nova.compute.manager [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Instance network_info: |[{"id": "badc9f06-cef7-46bf-8b74-5d53401021f5", "address": "fa:16:3e:c8:ea:de", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbadc9f06-ce", "ovs_interfaceid": "badc9f06-cef7-46bf-8b74-5d53401021f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-20abe7b6-1029-4ecf-aa85-2ba136fc5e4f req-f3b9f60f-6bd0-430e-997f-4b035e9ca525 service nova] Acquired lock "refresh_cache-cddf4842-1c25-4cc8-914e-af30849e4d6c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG nova.network.neutron [req-20abe7b6-1029-4ecf-aa85-2ba136fc5e4f req-f3b9f60f-6bd0-430e-997f-4b035e9ca525 service nova] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Refreshing network info cache for port badc9f06-cef7-46bf-8b74-5d53401021f5 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Start _get_guest_xml network_info=[{"id": "badc9f06-cef7-46bf-8b74-5d53401021f5", "address": "fa:16:3e:c8:ea:de", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbadc9f06-ce", "ovs_interfaceid": "badc9f06-cef7-46bf-8b74-5d53401021f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': '83126bb1-29f5-42fe-8620-72ab0797f776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:30:50 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:30:50 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:30:50 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:30:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1242575206',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1242575206',id=17,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bce6164a392e4cc2a027d12c49145e6d',ramdisk_id='',reservation_id='r-c8ezkq53',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-656520712',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:30:49Z,user_data=None,user_id='b01d3e5d2fcb40bc92c3d2fe1236d509',uuid=cddf4842-1c25-4cc8-914e-af30849e4d6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "badc9f06-cef7-46bf-8b74-5d53401021f5", "address": "fa:16:3e:c8:ea:de", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbadc9f06-ce", "ovs_interfaceid": "badc9f06-cef7-46bf-8b74-5d53401021f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Converting VIF {"id": "badc9f06-cef7-46bf-8b74-5d53401021f5", "address": "fa:16:3e:c8:ea:de", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbadc9f06-ce", "ovs_interfaceid": "badc9f06-cef7-46bf-8b74-5d53401021f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:ea:de,bridge_name='br-int',has_traffic_filtering=True,id=badc9f06-cef7-46bf-8b74-5d53401021f5,network=Network(2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbadc9f06-ce') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG nova.objects.instance [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lazy-loading 'pci_devices' on Instance uuid cddf4842-1c25-4cc8-914e-af30849e4d6c {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:30:50 user nova-compute[74247]:   <uuid>cddf4842-1c25-4cc8-914e-af30849e4d6c</uuid>
Oct 16 18:30:50 user nova-compute[74247]:   <name>instance-00000011</name>
Oct 16 18:30:50 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:30:50 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:30:50 user nova-compute[74247]:   <metadata>
Oct 16 18:30:50 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:30:50 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:30:50 user nova-compute[74247]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1242575206</nova:name>
Oct 16 18:30:50 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:30:50</nova:creationTime>
Oct 16 18:30:50 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:30:50 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:30:50 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:30:50 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:30:50 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:30:50 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:30:50 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:30:50 user nova-compute[74247]:       <nova:owner>
Oct 16 18:30:50 user nova-compute[74247]:         <nova:user uuid="b01d3e5d2fcb40bc92c3d2fe1236d509">tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member</nova:user>
Oct 16 18:30:50 user nova-compute[74247]:         <nova:project uuid="bce6164a392e4cc2a027d12c49145e6d">tempest-ServerBootFromVolumeStableRescueTest-656520712</nova:project>
Oct 16 18:30:50 user nova-compute[74247]:       </nova:owner>
Oct 16 18:30:50 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:30:50 user nova-compute[74247]:       <nova:ports>
Oct 16 18:30:50 user nova-compute[74247]:         <nova:port uuid="badc9f06-cef7-46bf-8b74-5d53401021f5">
Oct 16 18:30:50 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 16 18:30:50 user nova-compute[74247]:         </nova:port>
Oct 16 18:30:50 user nova-compute[74247]:       </nova:ports>
Oct 16 18:30:50 user nova-compute[74247]:     </nova:instance>
Oct 16 18:30:50 user nova-compute[74247]:   </metadata>
Oct 16 18:30:50 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:30:50 user nova-compute[74247]:     <system>
Oct 16 18:30:50 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:30:50 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:30:50 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:30:50 user nova-compute[74247]:       <entry name="serial">cddf4842-1c25-4cc8-914e-af30849e4d6c</entry>
Oct 16 18:30:50 user nova-compute[74247]:       <entry name="uuid">cddf4842-1c25-4cc8-914e-af30849e4d6c</entry>
Oct 16 18:30:50 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:30:50 user nova-compute[74247]:     </system>
Oct 16 18:30:50 user nova-compute[74247]:   </sysinfo>
Oct 16 18:30:50 user nova-compute[74247]:   <os>
Oct 16 18:30:50 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:30:50 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:30:50 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:30:50 user nova-compute[74247]:   </os>
Oct 16 18:30:50 user nova-compute[74247]:   <features>
Oct 16 18:30:50 user nova-compute[74247]:     <acpi/>
Oct 16 18:30:50 user nova-compute[74247]:     <apic/>
Oct 16 18:30:50 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:30:50 user nova-compute[74247]:   </features>
Oct 16 18:30:50 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:30:50 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:30:50 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:30:50 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:30:50 user nova-compute[74247]:   </clock>
Oct 16 18:30:50 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:30:50 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:30:50 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:30:50 user nova-compute[74247]:   </cpu>
Oct 16 18:30:50 user nova-compute[74247]:   <devices>
Oct 16 18:30:50 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:30:50 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:30:50 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk"/>
Oct 16 18:30:50 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:30:50 user nova-compute[74247]:     </disk>
Oct 16 18:30:50 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:30:50 user nova-compute[74247]:       <mac address="fa:16:3e:c8:ea:de"/>
Oct 16 18:30:50 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:30:50 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:30:50 user nova-compute[74247]:       <target dev="tapbadc9f06-ce"/>
Oct 16 18:30:50 user nova-compute[74247]:     </interface>
Oct 16 18:30:50 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:30:50 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/console.log" append="off"/>
Oct 16 18:30:50 user nova-compute[74247]:     </serial>
Oct 16 18:30:50 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:30:50 user nova-compute[74247]:     <video>
Oct 16 18:30:50 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:30:50 user nova-compute[74247]:     </video>
Oct 16 18:30:50 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:30:50 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:30:50 user nova-compute[74247]:     </rng>
Oct 16 18:30:50 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:30:50 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:30:50 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:30:50 user nova-compute[74247]:     </memballoon>
Oct 16 18:30:50 user nova-compute[74247]:   </devices>
Oct 16 18:30:50 user nova-compute[74247]: </domain>
Oct 16 18:30:50 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:30:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1242575206',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1242575206',id=17,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bce6164a392e4cc2a027d12c49145e6d',ramdisk_id='',reservation_id='r-c8ezkq53',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-656520712',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:30:49Z,user_data=None,user_id='b01d3e5d2fcb40bc92c3d2fe1236d509',uuid=cddf4842-1c25-4cc8-914e-af30849e4d6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "badc9f06-cef7-46bf-8b74-5d53401021f5", "address": "fa:16:3e:c8:ea:de", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbadc9f06-ce", "ovs_interfaceid": "badc9f06-cef7-46bf-8b74-5d53401021f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Converting VIF {"id": "badc9f06-cef7-46bf-8b74-5d53401021f5", "address": "fa:16:3e:c8:ea:de", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbadc9f06-ce", "ovs_interfaceid": "badc9f06-cef7-46bf-8b74-5d53401021f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:ea:de,bridge_name='br-int',has_traffic_filtering=True,id=badc9f06-cef7-46bf-8b74-5d53401021f5,network=Network(2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbadc9f06-ce') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG os_vif [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:ea:de,bridge_name='br-int',has_traffic_filtering=True,id=badc9f06-cef7-46bf-8b74-5d53401021f5,network=Network(2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbadc9f06-ce') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6ee20fa6-819a-5023-bf78-64292ab9e9e3', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbadc9f06-ce, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbadc9f06-ce, col_values=(('qos', UUID('54669093-5c46-4295-807b-d2adee1a2069')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbadc9f06-ce, col_values=(('external_ids', {'iface-id': 'badc9f06-cef7-46bf-8b74-5d53401021f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:ea:de', 'vm-uuid': 'cddf4842-1c25-4cc8-914e-af30849e4d6c'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:50 user nova-compute[74247]: INFO os_vif [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:ea:de,bridge_name='br-int',has_traffic_filtering=True,id=badc9f06-cef7-46bf-8b74-5d53401021f5,network=Network(2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbadc9f06-ce')
Oct 16 18:30:50 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] No VIF found with MAC fa:16:3e:c8:ea:de, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG nova.network.neutron [req-20abe7b6-1029-4ecf-aa85-2ba136fc5e4f req-f3b9f60f-6bd0-430e-997f-4b035e9ca525 service nova] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Updated VIF entry in instance network info cache for port badc9f06-cef7-46bf-8b74-5d53401021f5. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG nova.network.neutron [req-20abe7b6-1029-4ecf-aa85-2ba136fc5e4f req-f3b9f60f-6bd0-430e-997f-4b035e9ca525 service nova] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Updating instance_info_cache with network_info: [{"id": "badc9f06-cef7-46bf-8b74-5d53401021f5", "address": "fa:16:3e:c8:ea:de", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbadc9f06-ce", "ovs_interfaceid": "badc9f06-cef7-46bf-8b74-5d53401021f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-20abe7b6-1029-4ecf-aa85-2ba136fc5e4f req-f3b9f60f-6bd0-430e-997f-4b035e9ca525 service nova] Releasing lock "refresh_cache-cddf4842-1c25-4cc8-914e-af30849e4d6c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:30:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:52 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:52 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:52 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:52 user nova-compute[74247]: DEBUG nova.compute.manager [req-5db6dce3-2650-42e5-9645-cb2a7bf10d51 req-2e5855eb-b32a-4b52-ac72-07cbd9f8aa8b service nova] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Received event network-vif-plugged-badc9f06-cef7-46bf-8b74-5d53401021f5 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:30:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-5db6dce3-2650-42e5-9645-cb2a7bf10d51 req-2e5855eb-b32a-4b52-ac72-07cbd9f8aa8b service nova] Acquiring lock "cddf4842-1c25-4cc8-914e-af30849e4d6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:30:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-5db6dce3-2650-42e5-9645-cb2a7bf10d51 req-2e5855eb-b32a-4b52-ac72-07cbd9f8aa8b service nova] Lock "cddf4842-1c25-4cc8-914e-af30849e4d6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:30:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-5db6dce3-2650-42e5-9645-cb2a7bf10d51 req-2e5855eb-b32a-4b52-ac72-07cbd9f8aa8b service nova] Lock "cddf4842-1c25-4cc8-914e-af30849e4d6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:30:52 user nova-compute[74247]: DEBUG nova.compute.manager [req-5db6dce3-2650-42e5-9645-cb2a7bf10d51 req-2e5855eb-b32a-4b52-ac72-07cbd9f8aa8b service nova] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] No waiting events found dispatching network-vif-plugged-badc9f06-cef7-46bf-8b74-5d53401021f5 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:30:52 user nova-compute[74247]: WARNING nova.compute.manager [req-5db6dce3-2650-42e5-9645-cb2a7bf10d51 req-2e5855eb-b32a-4b52-ac72-07cbd9f8aa8b service nova] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Received unexpected event network-vif-plugged-badc9f06-cef7-46bf-8b74-5d53401021f5 for instance with vm_state building and task_state spawning.
Oct 16 18:30:52 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:52 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:52 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:52 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:30:53 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:30:53 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:30:53 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:30:54 user nova-compute[74247]: DEBUG nova.compute.manager [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:30:54 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:30:54 user nova-compute[74247]: DEBUG nova.compute.manager [req-9c5228d6-0b7b-4697-9cdd-d1053f457c03 req-47c2e2c4-26d5-4cfc-9843-46e40dd774a5 service nova] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Received event network-vif-plugged-badc9f06-cef7-46bf-8b74-5d53401021f5 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:30:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9c5228d6-0b7b-4697-9cdd-d1053f457c03 req-47c2e2c4-26d5-4cfc-9843-46e40dd774a5 service nova] Acquiring lock "cddf4842-1c25-4cc8-914e-af30849e4d6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:30:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9c5228d6-0b7b-4697-9cdd-d1053f457c03 req-47c2e2c4-26d5-4cfc-9843-46e40dd774a5 service nova] Lock "cddf4842-1c25-4cc8-914e-af30849e4d6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:30:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9c5228d6-0b7b-4697-9cdd-d1053f457c03 req-47c2e2c4-26d5-4cfc-9843-46e40dd774a5 service nova] Lock "cddf4842-1c25-4cc8-914e-af30849e4d6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:30:54 user nova-compute[74247]: DEBUG nova.compute.manager [req-9c5228d6-0b7b-4697-9cdd-d1053f457c03 req-47c2e2c4-26d5-4cfc-9843-46e40dd774a5 service nova] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] No waiting events found dispatching network-vif-plugged-badc9f06-cef7-46bf-8b74-5d53401021f5 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:30:54 user nova-compute[74247]: WARNING nova.compute.manager [req-9c5228d6-0b7b-4697-9cdd-d1053f457c03 req-47c2e2c4-26d5-4cfc-9843-46e40dd774a5 service nova] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Received unexpected event network-vif-plugged-badc9f06-cef7-46bf-8b74-5d53401021f5 for instance with vm_state building and task_state spawning.
Oct 16 18:30:54 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Instance spawned successfully.
Oct 16 18:30:54 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 18:30:54 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:30:54 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:30:54 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:30:54 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:30:54 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:30:54 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:30:54 user nova-compute[74247]: INFO nova.compute.manager [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Took 5.79 seconds to spawn the instance on the hypervisor.
Oct 16 18:30:54 user nova-compute[74247]: DEBUG nova.compute.manager [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:30:54 user nova-compute[74247]: INFO nova.compute.manager [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Took 6.67 seconds to build instance.
Oct 16 18:30:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0a4403eb-3719-46c7-ae31-975368eef97e tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "cddf4842-1c25-4cc8-914e-af30849e4d6c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.777s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:30:54 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:30:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:55 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:30:55 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 18:30:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "refresh_cache-e37fbc27-3404-479a-be08-4d590391cf30" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:30:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquired lock "refresh_cache-e37fbc27-3404-479a-be08-4d590391cf30" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:30:55 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Forcefully refreshing network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 18:30:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:56 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Updating instance_info_cache with network_info: [{"id": "634511f9-ce96-4fe6-8bfc-51846e4dcb4f", "address": "fa:16:3e:d2:d2:f4", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634511f9-ce", "ovs_interfaceid": "634511f9-ce96-4fe6-8bfc-51846e4dcb4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:30:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Releasing lock "refresh_cache-e37fbc27-3404-479a-be08-4d590391cf30" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:30:56 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Updated the network info_cache for instance {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 18:30:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:30:59 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:31:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:00 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:31:00 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 18:31:00 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:31:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:31:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:31:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:31:00 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 18:31:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:01 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:01 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:01 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:01 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4daa6370-2cdf-4668-b66b-e10196377c9c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:01 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4daa6370-2cdf-4668-b66b-e10196377c9c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:01 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4daa6370-2cdf-4668-b66b-e10196377c9c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:01 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4daa6370-2cdf-4668-b66b-e10196377c9c/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:01 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:01 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:01 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:02 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:31:02 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Creating image(s)
Oct 16 18:31:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "/opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:31:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "/opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:31:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "/opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:31:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c23a0a-d5cb-4893-9a40-4586e98a2535/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.195s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "37399febbd18f60b85fd0f833558f6a3539ab231" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:31:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:31:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c23a0a-d5cb-4893-9a40-4586e98a2535/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c23a0a-d5cb-4893-9a40-4586e98a2535/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "d6367b6d-1bc2-4472-b0c4-07baec4a28b0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:31:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "d6367b6d-1bc2-4472-b0c4-07baec4a28b0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:31:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.277s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/disk 1073741824 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:02 user nova-compute[74247]: DEBUG nova.compute.manager [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 18:31:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c23a0a-d5cb-4893-9a40-4586e98a2535/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/disk 1073741824" returned: 0 in 0.057s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.338s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:31:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:31:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:31:02 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:31:02 user nova-compute[74247]: INFO nova.compute.claims [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Claim successful on node user
Oct 16 18:31:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.184s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:02 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/disk. size=1073741824 {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 18:31:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Cannot resize image /opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/disk to a smaller size. {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Ensure instance console log exists: /opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Start _get_guest_xml network_info=[{"id": "db973a04-4ef6-40c2-a694-c7a12631bc59", "address": "fa:16:3e:d4:26:c0", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb973a04-4e", "ovs_interfaceid": "db973a04-4ef6-40c2-a694-c7a12631bc59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': '83126bb1-29f5-42fe-8620-72ab0797f776'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KFNyGMIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bbec99d1-82a3-4e4d-a3ae-17e00821bee1', 'attached_at': '', 'detached_at': '', 'volume_id': '91e22910-3fb9-43fd-ac65-70fb0215b313', 'serial': '91e22910-3fb9-43fd-ac65-70fb0215b313'}, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '72b84dd4-ad35-484f-8151-30239cf2f3eb', 'guest_format': None, 'volume_type': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:31:03 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 16 18:31:03 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 16 18:31:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG nova.objects.instance [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lazy-loading 'vcpu_model' on Instance uuid bbec99d1-82a3-4e4d-a3ae-17e00821bee1 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KFNyGMIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:31:03 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 16 18:31:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:31:03 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 16 18:31:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:31:03 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:31:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef06ef8b-28fa-43d8-a2e4-54ae491fee14]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 18:31:03 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.032s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5f5d27-5be6-490f-928e-4bbea449c2cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313] added
Oct 16 18:31:03 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafdc709-6b27-4fbd-a017-22f4661cf177]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4b24b5-1c08-49ee-9a4c-137695bf7fd5]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KFNyGMIq {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KFNyGMIq" returned: 0 in 0.025s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[603b64e5-0800-4eb8-b5c2-2c7a0e2e20f5]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KFNyGMIq'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0fedc0-10f2-4f88-8249-195ea3921cc5]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.027s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d79954c-7fce-490b-b6bd-13ac883af97c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 16 18:31:03 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 16 18:31:03 user nova-compute[74247]:  {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:31:03 user nova-compute[74247]: WARNING os_brick.initiator.connectors.iscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 16 18:31:03 user nova-compute[74247]: : NotImplementedError
Oct 16 18:31:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c3b7c2-f027-41c9-a550-0ca0a4a2d963]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313, portal: 172.16.0.220,3260]
Oct 16 18:31:03 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313, portal: 172.16.0.220,3260] successful.
Oct 16 18:31:03 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb739d3-970b-44cd-a921-12aec6223909]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b107994-ac74-430c-9b89-08b5d5ba0ada]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:31:03 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:31:03 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.491s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.028s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ec992f-8a3b-4a64-aec3-52700483d4ca]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KFNyGMIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.998s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG nova.compute.manager [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 18:31:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk --force-share --output=json" returned: 0 in 0.297s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:04 user nova-compute[74247]: DEBUG nova.compute.manager [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 18:31:04 user nova-compute[74247]: DEBUG nova.network.neutron [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 18:31:04 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:31:04 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:31:04 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=8109MB free_disk=25.272762298583984GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 18:31:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:31:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:31:04 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 18:31:04 user nova-compute[74247]: DEBUG nova.compute.manager [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 18:31:04 user nova-compute[74247]: DEBUG nova.policy [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5bd70613da1f489f86227655ff364795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96ced9d4c0c474fbc7edeed6f73324a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 18:31:04 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:31:04 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance e37fbc27-3404-479a-be08-4d590391cf30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:31:04 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 4daa6370-2cdf-4668-b66b-e10196377c9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:31:04 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance bbec99d1-82a3-4e4d-a3ae-17e00821bee1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:31:04 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 7c17a25b-6818-48fa-b406-638dbf1845d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:31:04 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance a686ee86-272c-47be-8801-9c1500af272f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:31:04 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 7fa3da6f-ba9f-4752-901a-933427fcbda8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:31:04 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance d4c23a0a-d5cb-4893-9a40-4586e98a2535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:31:04 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance cddf4842-1c25-4cc8-914e-af30849e4d6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:31:04 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance d6367b6d-1bc2-4472-b0c4-07baec4a28b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:31:04 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 18:31:04 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 18:31:04 user nova-compute[74247]: DEBUG nova.compute.manager [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 18:31:04 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:31:04 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Creating image(s)
Oct 16 18:31:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "/opt/stack/data/nova/instances/d6367b6d-1bc2-4472-b0c4-07baec4a28b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:31:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "/opt/stack/data/nova/instances/d6367b6d-1bc2-4472-b0c4-07baec4a28b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:31:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "/opt/stack/data/nova/instances/d6367b6d-1bc2-4472-b0c4-07baec4a28b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:31:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:04 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.551s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:31:04 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] <== connect_volume: return (1555ms) {'type': 'block', 'scsi_wwn': '26133313733383166', 'path': '/dev/sdb'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:31:04 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133313733383166', 'path': '/dev/sdb'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:31:04 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T18:27:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1420825392',display_name='tempest-ServerActionsTestOtherA-server-584745225',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1420825392',id=13,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/3EvcYxSkv6EajRRkIzaFJ7f6uQhbqAKTds5ThHn386Pv+2tTgzyep551R0scho5zPYioOvrd00bJSB88s5K62otshFm+0x2KfMMxvYgCDs49Lx6Y3dzbzd3EgGqdZmw==',key_name='tempest-keypair-461314413',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:27:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='42bd3eb752f04fd48dfe0623fdf2fe9f',ramdisk_id='',reservation_id='r-vea0fn6c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-291765974',owner_user_name='tempest-ServerActionsTestOtherA-291765974-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:30:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3635a30f06234f0d9a8e0604c25f1208',uuid=bbec99d1-82a3-4e4d-a3ae-17e00821bee1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db973a04-4ef6-40c2-a694-c7a12631bc59", "address": "fa:16:3e:d4:26:c0", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb973a04-4e", "ovs_interfaceid": "db973a04-4ef6-40c2-a694-c7a12631bc59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:31:04 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Converting VIF {"id": "db973a04-4ef6-40c2-a694-c7a12631bc59", "address": "fa:16:3e:d4:26:c0", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb973a04-4e", "ovs_interfaceid": "db973a04-4ef6-40c2-a694-c7a12631bc59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:31:04 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:26:c0,bridge_name='br-int',has_traffic_filtering=True,id=db973a04-4ef6-40c2-a694-c7a12631bc59,network=Network(0a61bae1-2607-4e42-b573-e74ac3edf09a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb973a04-4e') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:31:04 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:31:04 user nova-compute[74247]:   <uuid>bbec99d1-82a3-4e4d-a3ae-17e00821bee1</uuid>
Oct 16 18:31:04 user nova-compute[74247]:   <name>instance-0000000d</name>
Oct 16 18:31:04 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:31:04 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:31:04 user nova-compute[74247]:   <metadata>
Oct 16 18:31:04 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:31:04 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:31:04 user nova-compute[74247]:       <nova:name>tempest-ServerActionsTestOtherA-server-584745225</nova:name>
Oct 16 18:31:04 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:31:03</nova:creationTime>
Oct 16 18:31:04 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:31:04 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:31:04 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:31:04 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:31:04 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:31:04 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:31:04 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:31:04 user nova-compute[74247]:       <nova:owner>
Oct 16 18:31:04 user nova-compute[74247]:         <nova:user uuid="3635a30f06234f0d9a8e0604c25f1208">tempest-ServerActionsTestOtherA-291765974-project-member</nova:user>
Oct 16 18:31:04 user nova-compute[74247]:         <nova:project uuid="42bd3eb752f04fd48dfe0623fdf2fe9f">tempest-ServerActionsTestOtherA-291765974</nova:project>
Oct 16 18:31:04 user nova-compute[74247]:       </nova:owner>
Oct 16 18:31:04 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:31:04 user nova-compute[74247]:       <nova:ports>
Oct 16 18:31:04 user nova-compute[74247]:         <nova:port uuid="db973a04-4ef6-40c2-a694-c7a12631bc59">
Oct 16 18:31:04 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 16 18:31:04 user nova-compute[74247]:         </nova:port>
Oct 16 18:31:04 user nova-compute[74247]:       </nova:ports>
Oct 16 18:31:04 user nova-compute[74247]:     </nova:instance>
Oct 16 18:31:04 user nova-compute[74247]:   </metadata>
Oct 16 18:31:04 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:31:04 user nova-compute[74247]:     <system>
Oct 16 18:31:04 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:31:04 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:31:04 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:31:04 user nova-compute[74247]:       <entry name="serial">bbec99d1-82a3-4e4d-a3ae-17e00821bee1</entry>
Oct 16 18:31:04 user nova-compute[74247]:       <entry name="uuid">bbec99d1-82a3-4e4d-a3ae-17e00821bee1</entry>
Oct 16 18:31:04 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:31:04 user nova-compute[74247]:     </system>
Oct 16 18:31:04 user nova-compute[74247]:   </sysinfo>
Oct 16 18:31:04 user nova-compute[74247]:   <os>
Oct 16 18:31:04 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:31:04 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:31:04 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:31:04 user nova-compute[74247]:   </os>
Oct 16 18:31:04 user nova-compute[74247]:   <features>
Oct 16 18:31:04 user nova-compute[74247]:     <acpi/>
Oct 16 18:31:04 user nova-compute[74247]:     <apic/>
Oct 16 18:31:04 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:31:04 user nova-compute[74247]:   </features>
Oct 16 18:31:04 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:31:04 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:31:04 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:31:04 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:31:04 user nova-compute[74247]:   </clock>
Oct 16 18:31:04 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:31:04 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:31:04 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:31:04 user nova-compute[74247]:   </cpu>
Oct 16 18:31:04 user nova-compute[74247]:   <devices>
Oct 16 18:31:04 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:31:04 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:31:04 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/disk"/>
Oct 16 18:31:04 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:31:04 user nova-compute[74247]:     </disk>
Oct 16 18:31:04 user nova-compute[74247]:     <disk type="block" device="disk">
Oct 16 18:31:04 user nova-compute[74247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:31:04 user nova-compute[74247]:       <source dev="/dev/sdb"/>
Oct 16 18:31:04 user nova-compute[74247]:       <target dev="vdb" bus="virtio"/>
Oct 16 18:31:04 user nova-compute[74247]:       <serial>91e22910-3fb9-43fd-ac65-70fb0215b313</serial>
Oct 16 18:31:04 user nova-compute[74247]:     </disk>
Oct 16 18:31:04 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:31:04 user nova-compute[74247]:       <mac address="fa:16:3e:d4:26:c0"/>
Oct 16 18:31:04 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:31:04 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:31:04 user nova-compute[74247]:       <target dev="tapdb973a04-4e"/>
Oct 16 18:31:04 user nova-compute[74247]:     </interface>
Oct 16 18:31:04 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:31:04 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/console.log" append="off"/>
Oct 16 18:31:04 user nova-compute[74247]:     </serial>
Oct 16 18:31:04 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:31:04 user nova-compute[74247]:     <video>
Oct 16 18:31:04 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:31:04 user nova-compute[74247]:     </video>
Oct 16 18:31:04 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:31:04 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:31:04 user nova-compute[74247]:     </rng>
Oct 16 18:31:04 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:31:04 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:31:04 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:31:04 user nova-compute[74247]:     </memballoon>
Oct 16 18:31:04 user nova-compute[74247]:   </devices>
Oct 16 18:31:04 user nova-compute[74247]: </domain>
Oct 16 18:31:04 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:31:04 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T18:27:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1420825392',display_name='tempest-ServerActionsTestOtherA-server-584745225',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1420825392',id=13,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/3EvcYxSkv6EajRRkIzaFJ7f6uQhbqAKTds5ThHn386Pv+2tTgzyep551R0scho5zPYioOvrd00bJSB88s5K62otshFm+0x2KfMMxvYgCDs49Lx6Y3dzbzd3EgGqdZmw==',key_name='tempest-keypair-461314413',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:27:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='42bd3eb752f04fd48dfe0623fdf2fe9f',ramdisk_id='',reservation_id='r-vea0fn6c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-291765974',owner_user_name='tempest-ServerActionsTestOtherA-291765974-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:30:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3635a30f06234f0d9a8e0604c25f1208',uuid=bbec99d1-82a3-4e4d-a3ae-17e00821bee1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db973a04-4ef6-40c2-a694-c7a12631bc59", "address": "fa:16:3e:d4:26:c0", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb973a04-4e", "ovs_interfaceid": "db973a04-4ef6-40c2-a694-c7a12631bc59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:31:04 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Converting VIF {"id": "db973a04-4ef6-40c2-a694-c7a12631bc59", "address": "fa:16:3e:d4:26:c0", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb973a04-4e", "ovs_interfaceid": "db973a04-4ef6-40c2-a694-c7a12631bc59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:31:04 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:26:c0,bridge_name='br-int',has_traffic_filtering=True,id=db973a04-4ef6-40c2-a694-c7a12631bc59,network=Network(0a61bae1-2607-4e42-b573-e74ac3edf09a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb973a04-4e') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:31:04 user nova-compute[74247]: DEBUG os_vif [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:26:c0,bridge_name='br-int',has_traffic_filtering=True,id=db973a04-4ef6-40c2-a694-c7a12631bc59,network=Network(0a61bae1-2607-4e42-b573-e74ac3edf09a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb973a04-4e') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:31:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:31:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dfd79c7b-9294-5f6e-9568-19298ce85084', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:31:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb973a04-4e, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdb973a04-4e, col_values=(('qos', UUID('0d3b27c6-9402-4b2d-bc10-191219e67685')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdb973a04-4e, col_values=(('external_ids', {'iface-id': 'db973a04-4ef6-40c2-a694-c7a12631bc59', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:26:c0', 'vm-uuid': 'bbec99d1-82a3-4e4d-a3ae-17e00821bee1'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:31:04 user nova-compute[74247]: INFO os_vif [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:26:c0,bridge_name='br-int',has_traffic_filtering=True,id=db973a04-4ef6-40c2-a694-c7a12631bc59,network=Network(0a61bae1-2607-4e42-b573-e74ac3edf09a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb973a04-4e')
Oct 16 18:31:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.264s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "37399febbd18f60b85fd0f833558f6a3539ab231" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:31:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:31:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:31:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:31:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] No VIF found with MAC fa:16:3e:d4:26:c0, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:31:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.185s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/d6367b6d-1bc2-4472-b0c4-07baec4a28b0/disk 1073741824 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/d6367b6d-1bc2-4472-b0c4-07baec4a28b0/disk 1073741824" returned: 0 in 0.068s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:31:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:05 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:31:05 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:31:05 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 18:31:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.906s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:31:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.220s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:05 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d6367b6d-1bc2-4472-b0c4-07baec4a28b0/disk. size=1073741824 {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 18:31:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6367b6d-1bc2-4472-b0c4-07baec4a28b0/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:05 user nova-compute[74247]: DEBUG nova.network.neutron [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Successfully created port: c53d6d53-a35d-4efe-bdf2-021991dd4187 {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:31:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6367b6d-1bc2-4472-b0c4-07baec4a28b0/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:05 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Cannot resize image /opt/stack/data/nova/instances/d6367b6d-1bc2-4472-b0c4-07baec4a28b0/disk to a smaller size. {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 18:31:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 18:31:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Ensure instance console log exists: /opt/stack/data/nova/instances/d6367b6d-1bc2-4472-b0c4-07baec4a28b0/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:31:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:31:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:31:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:31:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG nova.network.neutron [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Successfully updated port: c53d6d53-a35d-4efe-bdf2-021991dd4187 {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "refresh_cache-d6367b6d-1bc2-4472-b0c4-07baec4a28b0" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquired lock "refresh_cache-d6367b6d-1bc2-4472-b0c4-07baec4a28b0" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG nova.network.neutron [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG nova.compute.manager [req-465373f9-bc18-4409-806e-3a8d6662d872 req-ca37ff5d-98a3-4b24-94a5-0fae86c464e1 service nova] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Received event network-changed-c53d6d53-a35d-4efe-bdf2-021991dd4187 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG nova.compute.manager [req-465373f9-bc18-4409-806e-3a8d6662d872 req-ca37ff5d-98a3-4b24-94a5-0fae86c464e1 service nova] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Refreshing instance network info cache due to event network-changed-c53d6d53-a35d-4efe-bdf2-021991dd4187. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-465373f9-bc18-4409-806e-3a8d6662d872 req-ca37ff5d-98a3-4b24-94a5-0fae86c464e1 service nova] Acquiring lock "refresh_cache-d6367b6d-1bc2-4472-b0c4-07baec4a28b0" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG nova.network.neutron [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG nova.network.neutron [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Updating instance_info_cache with network_info: [{"id": "c53d6d53-a35d-4efe-bdf2-021991dd4187", "address": "fa:16:3e:8d:4e:52", "network": {"id": "fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1988491128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96ced9d4c0c474fbc7edeed6f73324a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53d6d53-a3", "ovs_interfaceid": "c53d6d53-a35d-4efe-bdf2-021991dd4187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Releasing lock "refresh_cache-d6367b6d-1bc2-4472-b0c4-07baec4a28b0" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG nova.compute.manager [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Instance network_info: |[{"id": "c53d6d53-a35d-4efe-bdf2-021991dd4187", "address": "fa:16:3e:8d:4e:52", "network": {"id": "fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1988491128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96ced9d4c0c474fbc7edeed6f73324a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53d6d53-a3", "ovs_interfaceid": "c53d6d53-a35d-4efe-bdf2-021991dd4187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-465373f9-bc18-4409-806e-3a8d6662d872 req-ca37ff5d-98a3-4b24-94a5-0fae86c464e1 service nova] Acquired lock "refresh_cache-d6367b6d-1bc2-4472-b0c4-07baec4a28b0" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG nova.network.neutron [req-465373f9-bc18-4409-806e-3a8d6662d872 req-ca37ff5d-98a3-4b24-94a5-0fae86c464e1 service nova] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Refreshing network info cache for port c53d6d53-a35d-4efe-bdf2-021991dd4187 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Start _get_guest_xml network_info=[{"id": "c53d6d53-a35d-4efe-bdf2-021991dd4187", "address": "fa:16:3e:8d:4e:52", "network": {"id": "fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1988491128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96ced9d4c0c474fbc7edeed6f73324a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53d6d53-a3", "ovs_interfaceid": "c53d6d53-a35d-4efe-bdf2-021991dd4187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': '83126bb1-29f5-42fe-8620-72ab0797f776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:31:06 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:31:06 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:31:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:31:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-780524516',display_name='tempest-AttachVolumeNegativeTest-server-780524516',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-780524516',id=18,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcJzJ4m4jJd+lqljax9w+rFGLRh6QlObdC1juC+X3B+S0d5hXVOIROpvDPn+wvwKnx30ZVTJB9AbEHI+k71bTneJQ2yLIrDDYQVw8nRXIfSWVAgHdridjdyx2XdcCh34Q==',key_name='tempest-keypair-1204285490',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c96ced9d4c0c474fbc7edeed6f73324a',ramdisk_id='',reservation_id='r-h13wezrn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1731725928',owner_user_name='tempest-AttachVolumeNegativeTest-1731725928-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:31:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bd70613da1f489f86227655ff364795',uuid=d6367b6d-1bc2-4472-b0c4-07baec4a28b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c53d6d53-a35d-4efe-bdf2-021991dd4187", "address": "fa:16:3e:8d:4e:52", "network": {"id": "fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1988491128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96ced9d4c0c474fbc7edeed6f73324a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53d6d53-a3", "ovs_interfaceid": "c53d6d53-a35d-4efe-bdf2-021991dd4187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Converting VIF {"id": "c53d6d53-a35d-4efe-bdf2-021991dd4187", "address": "fa:16:3e:8d:4e:52", "network": {"id": "fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1988491128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96ced9d4c0c474fbc7edeed6f73324a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53d6d53-a3", "ovs_interfaceid": "c53d6d53-a35d-4efe-bdf2-021991dd4187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:4e:52,bridge_name='br-int',has_traffic_filtering=True,id=c53d6d53-a35d-4efe-bdf2-021991dd4187,network=Network(fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc53d6d53-a3') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG nova.objects.instance [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lazy-loading 'pci_devices' on Instance uuid d6367b6d-1bc2-4472-b0c4-07baec4a28b0 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:31:06 user nova-compute[74247]:   <uuid>d6367b6d-1bc2-4472-b0c4-07baec4a28b0</uuid>
Oct 16 18:31:06 user nova-compute[74247]:   <name>instance-00000012</name>
Oct 16 18:31:06 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:31:06 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:31:06 user nova-compute[74247]:   <metadata>
Oct 16 18:31:06 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:31:06 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:31:06 user nova-compute[74247]:       <nova:name>tempest-AttachVolumeNegativeTest-server-780524516</nova:name>
Oct 16 18:31:06 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:31:06</nova:creationTime>
Oct 16 18:31:06 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:31:06 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:31:06 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:31:06 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:31:06 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:31:06 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:31:06 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:31:06 user nova-compute[74247]:       <nova:owner>
Oct 16 18:31:06 user nova-compute[74247]:         <nova:user uuid="5bd70613da1f489f86227655ff364795">tempest-AttachVolumeNegativeTest-1731725928-project-member</nova:user>
Oct 16 18:31:06 user nova-compute[74247]:         <nova:project uuid="c96ced9d4c0c474fbc7edeed6f73324a">tempest-AttachVolumeNegativeTest-1731725928</nova:project>
Oct 16 18:31:06 user nova-compute[74247]:       </nova:owner>
Oct 16 18:31:06 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:31:06 user nova-compute[74247]:       <nova:ports>
Oct 16 18:31:06 user nova-compute[74247]:         <nova:port uuid="c53d6d53-a35d-4efe-bdf2-021991dd4187">
Oct 16 18:31:06 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 16 18:31:06 user nova-compute[74247]:         </nova:port>
Oct 16 18:31:06 user nova-compute[74247]:       </nova:ports>
Oct 16 18:31:06 user nova-compute[74247]:     </nova:instance>
Oct 16 18:31:06 user nova-compute[74247]:   </metadata>
Oct 16 18:31:06 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:31:06 user nova-compute[74247]:     <system>
Oct 16 18:31:06 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:31:06 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:31:06 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:31:06 user nova-compute[74247]:       <entry name="serial">d6367b6d-1bc2-4472-b0c4-07baec4a28b0</entry>
Oct 16 18:31:06 user nova-compute[74247]:       <entry name="uuid">d6367b6d-1bc2-4472-b0c4-07baec4a28b0</entry>
Oct 16 18:31:06 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:31:06 user nova-compute[74247]:     </system>
Oct 16 18:31:06 user nova-compute[74247]:   </sysinfo>
Oct 16 18:31:06 user nova-compute[74247]:   <os>
Oct 16 18:31:06 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:31:06 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:31:06 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:31:06 user nova-compute[74247]:   </os>
Oct 16 18:31:06 user nova-compute[74247]:   <features>
Oct 16 18:31:06 user nova-compute[74247]:     <acpi/>
Oct 16 18:31:06 user nova-compute[74247]:     <apic/>
Oct 16 18:31:06 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:31:06 user nova-compute[74247]:   </features>
Oct 16 18:31:06 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:31:06 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:31:06 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:31:06 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:31:06 user nova-compute[74247]:   </clock>
Oct 16 18:31:06 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:31:06 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:31:06 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:31:06 user nova-compute[74247]:   </cpu>
Oct 16 18:31:06 user nova-compute[74247]:   <devices>
Oct 16 18:31:06 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:31:06 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:31:06 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/d6367b6d-1bc2-4472-b0c4-07baec4a28b0/disk"/>
Oct 16 18:31:06 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:31:06 user nova-compute[74247]:     </disk>
Oct 16 18:31:06 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:31:06 user nova-compute[74247]:       <mac address="fa:16:3e:8d:4e:52"/>
Oct 16 18:31:06 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:31:06 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:31:06 user nova-compute[74247]:       <target dev="tapc53d6d53-a3"/>
Oct 16 18:31:06 user nova-compute[74247]:     </interface>
Oct 16 18:31:06 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:31:06 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/d6367b6d-1bc2-4472-b0c4-07baec4a28b0/console.log" append="off"/>
Oct 16 18:31:06 user nova-compute[74247]:     </serial>
Oct 16 18:31:06 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:31:06 user nova-compute[74247]:     <video>
Oct 16 18:31:06 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:31:06 user nova-compute[74247]:     </video>
Oct 16 18:31:06 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:31:06 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:31:06 user nova-compute[74247]:     </rng>
Oct 16 18:31:06 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:31:06 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:31:06 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:31:06 user nova-compute[74247]:     </memballoon>
Oct 16 18:31:06 user nova-compute[74247]:   </devices>
Oct 16 18:31:06 user nova-compute[74247]: </domain>
Oct 16 18:31:06 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:31:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-780524516',display_name='tempest-AttachVolumeNegativeTest-server-780524516',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-780524516',id=18,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcJzJ4m4jJd+lqljax9w+rFGLRh6QlObdC1juC+X3B+S0d5hXVOIROpvDPn+wvwKnx30ZVTJB9AbEHI+k71bTneJQ2yLIrDDYQVw8nRXIfSWVAgHdridjdyx2XdcCh34Q==',key_name='tempest-keypair-1204285490',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c96ced9d4c0c474fbc7edeed6f73324a',ramdisk_id='',reservation_id='r-h13wezrn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1731725928',owner_user_name='tempest-AttachVolumeNegativeTest-1731725928-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:31:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bd70613da1f489f86227655ff364795',uuid=d6367b6d-1bc2-4472-b0c4-07baec4a28b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c53d6d53-a35d-4efe-bdf2-021991dd4187", "address": "fa:16:3e:8d:4e:52", "network": {"id": "fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1988491128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96ced9d4c0c474fbc7edeed6f73324a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53d6d53-a3", "ovs_interfaceid": "c53d6d53-a35d-4efe-bdf2-021991dd4187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Converting VIF {"id": "c53d6d53-a35d-4efe-bdf2-021991dd4187", "address": "fa:16:3e:8d:4e:52", "network": {"id": "fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1988491128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96ced9d4c0c474fbc7edeed6f73324a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53d6d53-a3", "ovs_interfaceid": "c53d6d53-a35d-4efe-bdf2-021991dd4187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:4e:52,bridge_name='br-int',has_traffic_filtering=True,id=c53d6d53-a35d-4efe-bdf2-021991dd4187,network=Network(fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc53d6d53-a3') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG os_vif [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:4e:52,bridge_name='br-int',has_traffic_filtering=True,id=c53d6d53-a35d-4efe-bdf2-021991dd4187,network=Network(fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc53d6d53-a3') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG nova.compute.manager [req-74f53d78-1a33-4733-845c-b847ef3b98bf req-d904df8f-ff02-4d41-882d-3923966a566c service nova] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Received event network-vif-plugged-db973a04-4ef6-40c2-a694-c7a12631bc59 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-74f53d78-1a33-4733-845c-b847ef3b98bf req-d904df8f-ff02-4d41-882d-3923966a566c service nova] Acquiring lock "bbec99d1-82a3-4e4d-a3ae-17e00821bee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-74f53d78-1a33-4733-845c-b847ef3b98bf req-d904df8f-ff02-4d41-882d-3923966a566c service nova] Lock "bbec99d1-82a3-4e4d-a3ae-17e00821bee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-74f53d78-1a33-4733-845c-b847ef3b98bf req-d904df8f-ff02-4d41-882d-3923966a566c service nova] Lock "bbec99d1-82a3-4e4d-a3ae-17e00821bee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG nova.compute.manager [req-74f53d78-1a33-4733-845c-b847ef3b98bf req-d904df8f-ff02-4d41-882d-3923966a566c service nova] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] No waiting events found dispatching network-vif-plugged-db973a04-4ef6-40c2-a694-c7a12631bc59 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:31:06 user nova-compute[74247]: WARNING nova.compute.manager [req-74f53d78-1a33-4733-845c-b847ef3b98bf req-d904df8f-ff02-4d41-882d-3923966a566c service nova] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Received unexpected event network-vif-plugged-db973a04-4ef6-40c2-a694-c7a12631bc59 for instance with vm_state active and task_state rebuild_spawning.
Oct 16 18:31:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ad96340a-e0f5-51a5-953e-393b0a83d4a6', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc53d6d53-a3, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc53d6d53-a3, col_values=(('qos', UUID('743c928f-8663-47b2-a354-201c829f3b8b')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc53d6d53-a3, col_values=(('external_ids', {'iface-id': 'c53d6d53-a35d-4efe-bdf2-021991dd4187', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:4e:52', 'vm-uuid': 'd6367b6d-1bc2-4472-b0c4-07baec4a28b0'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:06 user nova-compute[74247]: INFO os_vif [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:4e:52,bridge_name='br-int',has_traffic_filtering=True,id=c53d6d53-a35d-4efe-bdf2-021991dd4187,network=Network(fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc53d6d53-a3')
Oct 16 18:31:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:31:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] No VIF found with MAC fa:16:3e:8d:4e:52, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:31:07 user nova-compute[74247]: DEBUG nova.network.neutron [req-465373f9-bc18-4409-806e-3a8d6662d872 req-ca37ff5d-98a3-4b24-94a5-0fae86c464e1 service nova] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Updated VIF entry in instance network info cache for port c53d6d53-a35d-4efe-bdf2-021991dd4187. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:31:07 user nova-compute[74247]: DEBUG nova.network.neutron [req-465373f9-bc18-4409-806e-3a8d6662d872 req-ca37ff5d-98a3-4b24-94a5-0fae86c464e1 service nova] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Updating instance_info_cache with network_info: [{"id": "c53d6d53-a35d-4efe-bdf2-021991dd4187", "address": "fa:16:3e:8d:4e:52", "network": {"id": "fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1988491128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96ced9d4c0c474fbc7edeed6f73324a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53d6d53-a3", "ovs_interfaceid": "c53d6d53-a35d-4efe-bdf2-021991dd4187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:31:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-465373f9-bc18-4409-806e-3a8d6662d872 req-ca37ff5d-98a3-4b24-94a5-0fae86c464e1 service nova] Releasing lock "refresh_cache-d6367b6d-1bc2-4472-b0c4-07baec4a28b0" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:31:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:08 user nova-compute[74247]: DEBUG nova.compute.manager [req-5cb7185a-3847-463e-b7d3-50653378d958 req-76bd16c2-4d25-49f1-82ea-5639ffe8b551 service nova] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Received event network-vif-plugged-db973a04-4ef6-40c2-a694-c7a12631bc59 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:31:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-5cb7185a-3847-463e-b7d3-50653378d958 req-76bd16c2-4d25-49f1-82ea-5639ffe8b551 service nova] Acquiring lock "bbec99d1-82a3-4e4d-a3ae-17e00821bee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:31:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-5cb7185a-3847-463e-b7d3-50653378d958 req-76bd16c2-4d25-49f1-82ea-5639ffe8b551 service nova] Lock "bbec99d1-82a3-4e4d-a3ae-17e00821bee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:31:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-5cb7185a-3847-463e-b7d3-50653378d958 req-76bd16c2-4d25-49f1-82ea-5639ffe8b551 service nova] Lock "bbec99d1-82a3-4e4d-a3ae-17e00821bee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:31:08 user nova-compute[74247]: DEBUG nova.compute.manager [req-5cb7185a-3847-463e-b7d3-50653378d958 req-76bd16c2-4d25-49f1-82ea-5639ffe8b551 service nova] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] No waiting events found dispatching network-vif-plugged-db973a04-4ef6-40c2-a694-c7a12631bc59 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:31:08 user nova-compute[74247]: WARNING nova.compute.manager [req-5cb7185a-3847-463e-b7d3-50653378d958 req-76bd16c2-4d25-49f1-82ea-5639ffe8b551 service nova] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Received unexpected event network-vif-plugged-db973a04-4ef6-40c2-a694-c7a12631bc59 for instance with vm_state active and task_state rebuild_spawning.
Oct 16 18:31:09 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Starting finish_revert_migration {{(pid=74247) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG nova.compute.manager [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:31:09 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Creating image(s)
Oct 16 18:31:09 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Did not create local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Ensure instance console log exists: /opt/stack/data/nova/instances/7fa3da6f-ba9f-4752-901a-933427fcbda8/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Start _get_guest_xml network_info=[{"id": "a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11", "address": "fa:16:3e:7e:13:34", "network": {"id": "43dd1e8a-1185-462c-9421-d0d7b2d90334", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1360889325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ea7e01-7e", "ovs_interfaceid": "a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40eb3a07-e825-44ad-9077-c1880b1e8768", "address": "fa:16:3e:ef:f1:d7", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40eb3a07-e8", "ovs_interfaceid": "40eb3a07-e825-44ad-9077-c1880b1e8768", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2813ff58-0b02-4da1-8774-ad7452da7d78", "address": "fa:16:3e:56:f0:e9", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2813ff58-0b", "ovs_interfaceid": "2813ff58-0b02-4da1-8774-ad7452da7d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec", "address": "fa:16:3e:32:8d:af", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dbd4bf3-bf", "ovs_interfaceid": "1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5", "address": "fa:16:3e:73:c9:16", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9f5274-68", "ovs_interfaceid": "2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a815917f-f1ec-48f2-b272-97bf2ad1d6cd", "address": "fa:16:3e:22:3b:ee", "network": {"id": "20ec901d-4e30-4c4a-ab56-7d57878cfdcc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1805797092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa815917f-f1", "ovs_interfaceid": "a815917f-f1ec-48f2-b272-97bf2ad1d6cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23684bac-dba0-4fdd-80d3-750ed2a77731", "address": "fa:16:3e:46:79:42", "network": {"id": "20ec901d-4e30-4c4a-ab56-7d57878cfdcc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1805797092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23684bac-db", "ovs_interfaceid": "23684bac-dba0-4fdd-80d3-750ed2a77731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GwyhIJsQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7fa3da6f-ba9f-4752-901a-933427fcbda8', 'attached_at': '', 'detached_at': '', 'volume_id': '2e2502cf-023d-406e-8618-c7c75907ae93', 'serial': '2e2502cf-023d-406e-8618-c7c75907ae93'}, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '54fc3012-b619-4d95-9958-d9335f609b18', 'guest_format': None, 'volume_type': None}, {'mount_device': '/dev/vdb', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LwIOgWPD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7fa3da6f-ba9f-4752-901a-933427fcbda8', 'attached_at': '', 'detached_at': '', 'volume_id': 'e8274378-306d-460c-82c3-abda468dd73a', 'serial': 'e8274378-306d-460c-82c3-abda468dd73a'}, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'b92e0cf8-9ad5-421e-857d-7853d210bfca', 'guest_format': None, 'volume_type': None}, {'mount_device': '/dev/vdc', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BykpOTxh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7fa3da6f-ba9f-4752-901a-933427fcbda8', 'attached_at': '', 'detached_at': '', 'volume_id': '012ad1ce-7193-4cf7-918c-d9cf4b9beba2', 'serial': '012ad1ce-7193-4cf7-918c-d9cf4b9beba2'}, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '0fe49f83-fb82-484a-a958-6d2006833847', 'guest_format': None, 'volume_type': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Start _get_guest_xml network_info=[{"id": "8cb168df-92d2-4ecc-946a-7d9075f75561", "address": "fa:16:3e:9d:bb:be", "network": {"id": "f12e9b98-2724-4b9c-a299-7286c163458c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1410604293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973c8310858e4e1dafbc2fa926995940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb168df-92", "ovs_interfaceid": "8cb168df-92d2-4ecc-946a-7d9075f75561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': '83126bb1-29f5-42fe-8620-72ab0797f776'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MHBuxbDs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'a686ee86-272c-47be-8801-9c1500af272f', 'attached_at': '2023-10-16T18:31:09.000000', 'detached_at': '', 'volume_id': '8223babc-be85-42b1-899b-b21e077ad7c6', 'serial': '8223babc-be85-42b1-899b-b21e077ad7c6'}, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '013b93a9-524e-48f3-8f3b-168ea1813373', 'guest_format': None, 'volume_type': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:31:09 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:31:09 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:31:09 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:31:09 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:31:09 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GwyhIJsQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:31:09 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:31:09 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:31:09 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:31:09 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:31:09 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:31:09 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG nova.objects.instance [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lazy-loading 'vcpu_model' on Instance uuid a686ee86-272c-47be-8801-9c1500af272f {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MHBuxbDs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:31:09 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:31:09 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[be58d676-3a70-41b8-824f-fb41be8df528]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 18:31:09 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6683d4-33d9-4ead-8312-c9947eacce02]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93] added
Oct 16 18:31:09 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e768794b-d916-4a36-9b8b-774c5f5954ed]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad057334-83dd-468a-980b-00b139fa11d8]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GwyhIJsQ {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GwyhIJsQ" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ef6335-18e3-4b39-bf06-043b0da8a65f]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GwyhIJsQ'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[93de84c0-6021-423f-97a6-6543491e8e76]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d847525-a321-4903-98e9-efc1c7208c8e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:31:09 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:31:09 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff45b29-a09c-41d4-8dcf-80d23c90c45b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93, portal: 172.16.0.220,3260]
Oct 16 18:31:09 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93, portal: 172.16.0.220,3260] successful.
Oct 16 18:31:09 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc7b4c1-cd95-413c-a1a1-8cef389410af]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8720d648-3ac8-494b-9aee-d221bb0f6539]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:31:09 user nova-compute[74247]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)
Oct 16 18:31:09 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:31:09 user nova-compute[74247]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)
Oct 16 18:31:09 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.373s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c749b50a-5f8b-4d1c-be77-029cb79f82a4]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:31:09 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GwyhIJsQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG nova.compute.manager [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:31:10 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Instance spawned successfully.
Oct 16 18:31:10 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG nova.compute.manager [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG nova.objects.instance [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74247) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-cc3b6ca2-3f61-42f3-94f1-f0dc910e0891 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.085s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.410s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '26266356138663631', 'path': '/dev/sdc'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266356138663631', 'path': '/dev/sdc'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.360s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:31:10 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:31:10 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:31:10 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:31:10 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25fa18a-bfd9-4e5a-ab08-bf5163e9ba4e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 18:31:10 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LwIOgWPD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:31:10 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:31:10 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cde80d-a45b-45e6-ad79-92d3b1413df0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6] added
Oct 16 18:31:10 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5060c1-42a7-4ec4-b2da-25e5f326b8bc]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3d863e-491f-430b-adc2-65470fb5d6ea]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MHBuxbDs {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MHBuxbDs" returned: 0 in 0.025s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60fd3a7-c485-4ddb-8e87-29d5eced4a2f]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MHBuxbDs'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ec1d91-c7f7-453f-8f5c-be619ca99242]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d6185f-8ce5-469a-862d-35fa16012c88]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:31:10 user nova-compute[74247]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)
Oct 16 18:31:10 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:31:10 user nova-compute[74247]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)
Oct 16 18:31:10 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[441d80a8-5a93-4b41-98a3-4a55172260f9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6, portal: 172.16.0.220,3260]
Oct 16 18:31:10 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6, portal: 172.16.0.220,3260] successful.
Oct 16 18:31:10 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[302988e7-42ad-448f-af68-385fe5e35f79]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca3d218-2072-4862-83e7-aafee3906583]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:31:10 user nova-compute[74247]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)
Oct 16 18:31:10 user nova-compute[74247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:31:10 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:31:10 user nova-compute[74247]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)
Oct 16 18:31:10 user nova-compute[74247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:31:10 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c194fa-87d6-44e9-b149-59ad702a80d6]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: None {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG nova.compute.manager [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:31:10 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Instance spawned successfully.
Oct 16 18:31:10 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:31:10 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:31:11 user nova-compute[74247]: DEBUG nova.compute.manager [req-7cd6dc85-0b38-4a1c-8fb8-a30445e8fd0b req-63d1d1b7-5894-461f-be5c-7c86edae1c93 service nova] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Received event network-vif-plugged-c53d6d53-a35d-4efe-bdf2-021991dd4187 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:31:11 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7cd6dc85-0b38-4a1c-8fb8-a30445e8fd0b req-63d1d1b7-5894-461f-be5c-7c86edae1c93 service nova] Acquiring lock "d6367b6d-1bc2-4472-b0c4-07baec4a28b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:31:11 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7cd6dc85-0b38-4a1c-8fb8-a30445e8fd0b req-63d1d1b7-5894-461f-be5c-7c86edae1c93 service nova] Lock "d6367b6d-1bc2-4472-b0c4-07baec4a28b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:31:11 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7cd6dc85-0b38-4a1c-8fb8-a30445e8fd0b req-63d1d1b7-5894-461f-be5c-7c86edae1c93 service nova] Lock "d6367b6d-1bc2-4472-b0c4-07baec4a28b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:31:11 user nova-compute[74247]: DEBUG nova.compute.manager [req-7cd6dc85-0b38-4a1c-8fb8-a30445e8fd0b req-63d1d1b7-5894-461f-be5c-7c86edae1c93 service nova] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] No waiting events found dispatching network-vif-plugged-c53d6d53-a35d-4efe-bdf2-021991dd4187 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:31:11 user nova-compute[74247]: WARNING nova.compute.manager [req-7cd6dc85-0b38-4a1c-8fb8-a30445e8fd0b req-63d1d1b7-5894-461f-be5c-7c86edae1c93 service nova] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Received unexpected event network-vif-plugged-c53d6d53-a35d-4efe-bdf2-021991dd4187 for instance with vm_state building and task_state spawning.
Oct 16 18:31:11 user nova-compute[74247]: DEBUG nova.compute.manager [req-7cd6dc85-0b38-4a1c-8fb8-a30445e8fd0b req-63d1d1b7-5894-461f-be5c-7c86edae1c93 service nova] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Received event network-vif-plugged-c53d6d53-a35d-4efe-bdf2-021991dd4187 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:31:11 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7cd6dc85-0b38-4a1c-8fb8-a30445e8fd0b req-63d1d1b7-5894-461f-be5c-7c86edae1c93 service nova] Acquiring lock "d6367b6d-1bc2-4472-b0c4-07baec4a28b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:31:11 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7cd6dc85-0b38-4a1c-8fb8-a30445e8fd0b req-63d1d1b7-5894-461f-be5c-7c86edae1c93 service nova] Lock "d6367b6d-1bc2-4472-b0c4-07baec4a28b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:31:11 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7cd6dc85-0b38-4a1c-8fb8-a30445e8fd0b req-63d1d1b7-5894-461f-be5c-7c86edae1c93 service nova] Lock "d6367b6d-1bc2-4472-b0c4-07baec4a28b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:31:11 user nova-compute[74247]: DEBUG nova.compute.manager [req-7cd6dc85-0b38-4a1c-8fb8-a30445e8fd0b req-63d1d1b7-5894-461f-be5c-7c86edae1c93 service nova] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] No waiting events found dispatching network-vif-plugged-c53d6d53-a35d-4efe-bdf2-021991dd4187 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:31:11 user nova-compute[74247]: WARNING nova.compute.manager [req-7cd6dc85-0b38-4a1c-8fb8-a30445e8fd0b req-63d1d1b7-5894-461f-be5c-7c86edae1c93 service nova] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Received unexpected event network-vif-plugged-c53d6d53-a35d-4efe-bdf2-021991dd4187 for instance with vm_state building and task_state spawning.
Oct 16 18:31:11 user nova-compute[74247]: INFO nova.compute.manager [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Took 6.30 seconds to spawn the instance on the hypervisor.
Oct 16 18:31:11 user nova-compute[74247]: DEBUG nova.compute.manager [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:31:11 user nova-compute[74247]: INFO nova.compute.manager [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Took 8.34 seconds to build instance.
Oct 16 18:31:11 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-45e76afd-b476-4f40-acea-d30272ae8b00 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "d6367b6d-1bc2-4472-b0c4-07baec4a28b0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.576s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:31:11 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:31:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MHBuxbDs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:31:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:31:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] <== connect_volume: return (2716ms) {'type': 'block', 'scsi_wwn': '23533613635316535', 'path': '/dev/sdd'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:31:11 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533613635316535', 'path': '/dev/sdd'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:31:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.325s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:31:11 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:31:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:31:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:31:11 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:31:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a -p 172.16.0.220:3260" returned: 21 in 0.065s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d0cdac-2bdc-40f5-9ac5-d804e3ecae34]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 18:31:11 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:11 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:24:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-208936177',display_name='tempest-ServerActionsTestOtherB-server-208936177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-208936177',id=4,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIs9LtanBEbN6S6UJgwgQipMcrzgCgmqD+MSXO/I2jlCfUtIcGHYoW9tgqCxpGH6Qd6bb/kDDqj9dBay7WvsSTTn0A8mddCk4+U9BnAHzFohZU35eWuYV7ckMsEqil5fw==',key_name='tempest-keypair-447758938',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:29:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='973c8310858e4e1dafbc2fa926995940',ramdisk_id='',reservation_id='r-2wkxxe7p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-650770368',owner_user_name='tempest-ServerActionsTestOtherB-650770368-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:30:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b6734bfca1e4bf5b3c75d06eb471220',uuid=a686ee86-272c-47be-8801-9c1500af272f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "8cb168df-92d2-4ecc-946a-7d9075f75561", "address": "fa:16:3e:9d:bb:be", "network": {"id": "f12e9b98-2724-4b9c-a299-7286c163458c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1410604293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973c8310858e4e1dafbc2fa926995940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb168df-92", "ovs_interfaceid": "8cb168df-92d2-4ecc-946a-7d9075f75561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:31:11 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Converting VIF {"id": "8cb168df-92d2-4ecc-946a-7d9075f75561", "address": "fa:16:3e:9d:bb:be", "network": {"id": "f12e9b98-2724-4b9c-a299-7286c163458c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1410604293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973c8310858e4e1dafbc2fa926995940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb168df-92", "ovs_interfaceid": "8cb168df-92d2-4ecc-946a-7d9075f75561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:31:11 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:bb:be,bridge_name='br-int',has_traffic_filtering=True,id=8cb168df-92d2-4ecc-946a-7d9075f75561,network=Network(f12e9b98-2724-4b9c-a299-7286c163458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb168df-92') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:31:11 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:31:11 user nova-compute[74247]:   <uuid>a686ee86-272c-47be-8801-9c1500af272f</uuid>
Oct 16 18:31:11 user nova-compute[74247]:   <name>instance-00000004</name>
Oct 16 18:31:11 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:31:11 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:31:11 user nova-compute[74247]:   <metadata>
Oct 16 18:31:11 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:31:11 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:31:11 user nova-compute[74247]:       <nova:name>tempest-ServerActionsTestOtherB-server-208936177</nova:name>
Oct 16 18:31:11 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:31:09</nova:creationTime>
Oct 16 18:31:11 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:31:11 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:31:11 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:31:11 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:31:11 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:31:11 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:31:11 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:31:11 user nova-compute[74247]:       <nova:owner>
Oct 16 18:31:11 user nova-compute[74247]:         <nova:user uuid="2b6734bfca1e4bf5b3c75d06eb471220">tempest-ServerActionsTestOtherB-650770368-project-member</nova:user>
Oct 16 18:31:11 user nova-compute[74247]:         <nova:project uuid="973c8310858e4e1dafbc2fa926995940">tempest-ServerActionsTestOtherB-650770368</nova:project>
Oct 16 18:31:11 user nova-compute[74247]:       </nova:owner>
Oct 16 18:31:11 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:31:11 user nova-compute[74247]:       <nova:ports>
Oct 16 18:31:11 user nova-compute[74247]:         <nova:port uuid="8cb168df-92d2-4ecc-946a-7d9075f75561">
Oct 16 18:31:11 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 16 18:31:11 user nova-compute[74247]:         </nova:port>
Oct 16 18:31:11 user nova-compute[74247]:       </nova:ports>
Oct 16 18:31:11 user nova-compute[74247]:     </nova:instance>
Oct 16 18:31:11 user nova-compute[74247]:   </metadata>
Oct 16 18:31:11 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:31:11 user nova-compute[74247]:     <system>
Oct 16 18:31:11 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:31:11 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:31:11 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:31:11 user nova-compute[74247]:       <entry name="serial">a686ee86-272c-47be-8801-9c1500af272f</entry>
Oct 16 18:31:11 user nova-compute[74247]:       <entry name="uuid">a686ee86-272c-47be-8801-9c1500af272f</entry>
Oct 16 18:31:11 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:31:11 user nova-compute[74247]:     </system>
Oct 16 18:31:11 user nova-compute[74247]:   </sysinfo>
Oct 16 18:31:11 user nova-compute[74247]:   <os>
Oct 16 18:31:11 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:31:11 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:31:11 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:31:11 user nova-compute[74247]:   </os>
Oct 16 18:31:11 user nova-compute[74247]:   <features>
Oct 16 18:31:11 user nova-compute[74247]:     <acpi/>
Oct 16 18:31:11 user nova-compute[74247]:     <apic/>
Oct 16 18:31:11 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:31:11 user nova-compute[74247]:   </features>
Oct 16 18:31:11 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:31:11 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:31:11 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:31:11 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:31:11 user nova-compute[74247]:   </clock>
Oct 16 18:31:11 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:31:11 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:31:11 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:31:11 user nova-compute[74247]:   </cpu>
Oct 16 18:31:11 user nova-compute[74247]:   <devices>
Oct 16 18:31:11 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:31:11 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:31:11 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk"/>
Oct 16 18:31:11 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:31:11 user nova-compute[74247]:     </disk>
Oct 16 18:31:11 user nova-compute[74247]:     <disk type="block" device="disk">
Oct 16 18:31:11 user nova-compute[74247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:31:11 user nova-compute[74247]:       <source dev="/dev/sdd"/>
Oct 16 18:31:11 user nova-compute[74247]:       <target dev="vdb" bus="virtio"/>
Oct 16 18:31:11 user nova-compute[74247]:       <serial>8223babc-be85-42b1-899b-b21e077ad7c6</serial>
Oct 16 18:31:11 user nova-compute[74247]:     </disk>
Oct 16 18:31:11 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:31:11 user nova-compute[74247]:       <mac address="fa:16:3e:9d:bb:be"/>
Oct 16 18:31:11 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:31:11 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:31:11 user nova-compute[74247]:       <target dev="tap8cb168df-92"/>
Oct 16 18:31:11 user nova-compute[74247]:     </interface>
Oct 16 18:31:11 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:31:11 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/console.log" append="off"/>
Oct 16 18:31:11 user nova-compute[74247]:     </serial>
Oct 16 18:31:11 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:31:11 user nova-compute[74247]:     <video>
Oct 16 18:31:11 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:31:11 user nova-compute[74247]:     </video>
Oct 16 18:31:11 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:31:11 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:31:11 user nova-compute[74247]:     </rng>
Oct 16 18:31:11 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:31:11 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:31:11 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:31:11 user nova-compute[74247]:     </memballoon>
Oct 16 18:31:11 user nova-compute[74247]:   </devices>
Oct 16 18:31:11 user nova-compute[74247]: </domain>
Oct 16 18:31:11 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:31:11 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:24:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-208936177',display_name='tempest-ServerActionsTestOtherB-server-208936177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-208936177',id=4,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIs9LtanBEbN6S6UJgwgQipMcrzgCgmqD+MSXO/I2jlCfUtIcGHYoW9tgqCxpGH6Qd6bb/kDDqj9dBay7WvsSTTn0A8mddCk4+U9BnAHzFohZU35eWuYV7ckMsEqil5fw==',key_name='tempest-keypair-447758938',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:29:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='973c8310858e4e1dafbc2fa926995940',ramdisk_id='',reservation_id='r-2wkxxe7p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-650770368',owner_user_name='tempest-ServerActionsTestOtherB-650770368-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:30:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b6734bfca1e4bf5b3c75d06eb471220',uuid=a686ee86-272c-47be-8801-9c1500af272f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "8cb168df-92d2-4ecc-946a-7d9075f75561", "address": "fa:16:3e:9d:bb:be", "network": {"id": "f12e9b98-2724-4b9c-a299-7286c163458c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1410604293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973c8310858e4e1dafbc2fa926995940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb168df-92", "ovs_interfaceid": "8cb168df-92d2-4ecc-946a-7d9075f75561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:31:11 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Converting VIF {"id": "8cb168df-92d2-4ecc-946a-7d9075f75561", "address": "fa:16:3e:9d:bb:be", "network": {"id": "f12e9b98-2724-4b9c-a299-7286c163458c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1410604293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973c8310858e4e1dafbc2fa926995940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb168df-92", "ovs_interfaceid": "8cb168df-92d2-4ecc-946a-7d9075f75561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:31:11 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:bb:be,bridge_name='br-int',has_traffic_filtering=True,id=8cb168df-92d2-4ecc-946a-7d9075f75561,network=Network(f12e9b98-2724-4b9c-a299-7286c163458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb168df-92') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:31:11 user nova-compute[74247]: DEBUG os_vif [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:bb:be,bridge_name='br-int',has_traffic_filtering=True,id=8cb168df-92d2-4ecc-946a-7d9075f75561,network=Network(f12e9b98-2724-4b9c-a299-7286c163458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb168df-92') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:31:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:31:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '22752197-763b-5756-87e8-d7d5bf2f7f5c', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:31:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2baf9a25-c0c6-4833-ab58-a036bfe3b49e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a] added
Oct 16 18:31:11 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8cb168df-92, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8cb168df-92, col_values=(('qos', UUID('81494996-c339-4f28-8523-0f0bd6271f38')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8cb168df-92, col_values=(('external_ids', {'iface-id': '8cb168df-92d2-4ecc-946a-7d9075f75561', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:bb:be', 'vm-uuid': 'a686ee86-272c-47be-8801-9c1500af272f'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:12 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:31:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:12 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1e8ee0-c93c-4306-a73a-1b5401fae0fd]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:12 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:12 user nova-compute[74247]: INFO os_vif [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:bb:be,bridge_name='br-int',has_traffic_filtering=True,id=8cb168df-92d2-4ecc-946a-7d9075f75561,network=Network(f12e9b98-2724-4b9c-a299-7286c163458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb168df-92')
Oct 16 18:31:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:12 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d085ee-40a6-4b42-a85e-a26cabb4c991]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LwIOgWPD {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LwIOgWPD" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:12 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f820149-dc72-4a8f-96fb-8294374650b8]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LwIOgWPD'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:12 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3f82b3-fcd5-4325-9fbd-c73db3ece0fb]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:12 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[923a8ca7-ccd0-4b51-96ab-bdbf286300b8]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:31:12 user nova-compute[74247]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)
Oct 16 18:31:12 user nova-compute[74247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:31:12 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:31:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:31:12 user nova-compute[74247]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)
Oct 16 18:31:12 user nova-compute[74247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:31:12 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:31:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:12 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7376b2bb-4748-4dae-82b5-fcf6d6108bf3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a, portal: 172.16.0.220,3260]
Oct 16 18:31:12 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a, portal: 172.16.0.220,3260] successful.
Oct 16 18:31:12 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:12 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee2f656-33f0-44b9-976b-dfa5eb140b69]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:12 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac03164-3e47-4957-98a8-4eb3645e3ecb]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:31:12 user nova-compute[74247]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)
Oct 16 18:31:12 user nova-compute[74247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:31:12 user nova-compute[74247]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a (non-flash)
Oct 16 18:31:12 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:31:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:31:12 user nova-compute[74247]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)
Oct 16 18:31:12 user nova-compute[74247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:31:12 user nova-compute[74247]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a (non-flash)
Oct 16 18:31:12 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:31:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.365s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:31:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:31:12 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] HCTL ('36', '-', '-', 0) found on session 18 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:31:12 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:31:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.027s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:12 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da6739e-94ef-4c17-8eb6-9a291023f421]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:12 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Searching for a device in session 18 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:31:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LwIOgWPD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.412s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] <== connect_volume: return (2737ms) {'type': 'block', 'scsi_wwn': '23066653839353164', 'path': '/dev/sde'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066653839353164', 'path': '/dev/sde'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BykpOTxh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:31:13 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:31:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:31:13 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:31:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:31:13 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:31:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1848138-9708-4d82-9ef6-9366c2f0564d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 18:31:13 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[54bd707a-5f8d-4c2f-923c-9a9c724e5dbf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2] added
Oct 16 18:31:13 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-addc655e-f2a7-462c-983d-078d2e7523b0 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Acquiring lock "4daa6370-2cdf-4668-b66b-e10196377c9c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-addc655e-f2a7-462c-983d-078d2e7523b0 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lock "4daa6370-2cdf-4668-b66b-e10196377c9c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-addc655e-f2a7-462c-983d-078d2e7523b0 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Acquiring lock "4daa6370-2cdf-4668-b66b-e10196377c9c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-addc655e-f2a7-462c-983d-078d2e7523b0 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lock "4daa6370-2cdf-4668-b66b-e10196377c9c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-addc655e-f2a7-462c-983d-078d2e7523b0 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lock "4daa6370-2cdf-4668-b66b-e10196377c9c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:13 user nova-compute[74247]: INFO nova.compute.manager [None req-addc655e-f2a7-462c-983d-078d2e7523b0 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Terminating instance
Oct 16 18:31:13 user nova-compute[74247]: DEBUG nova.compute.manager [None req-addc655e-f2a7-462c-983d-078d2e7523b0 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfadb62-9fab-45c1-9cbe-2d3a24893859]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df8aefe-ab80-48fd-bc49-0e34e0314588]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BykpOTxh {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BykpOTxh" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[861628fd-0ff6-4c6b-8a76-c443eb6ce1ea]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BykpOTxh'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b3c8ea-01e4-4e51-a104-39dd5317f8d0]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa9566e-fb1a-4509-957b-7fb8bea330b7]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:31:13 user nova-compute[74247]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)
Oct 16 18:31:13 user nova-compute[74247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:31:13 user nova-compute[74247]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a (non-flash)
Oct 16 18:31:13 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:31:13 user nova-compute[74247]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)
Oct 16 18:31:13 user nova-compute[74247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:31:13 user nova-compute[74247]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a (non-flash)
Oct 16 18:31:13 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 -p 172.16.0.220:3260 --login" returned: 0 in 0.109s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbd2d9a-e4f2-42f7-8efd-8a2feb2cf512]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2, portal: 172.16.0.220,3260]
Oct 16 18:31:13 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2, portal: 172.16.0.220,3260] successful.
Oct 16 18:31:13 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.037s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f35808-7a12-4211-be58-9a47e7d303af]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[06056f5a-4384-4caf-8720-44670fcf7e5f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:31:13 user nova-compute[74247]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)
Oct 16 18:31:13 user nova-compute[74247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:31:13 user nova-compute[74247]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a (non-flash)
Oct 16 18:31:13 user nova-compute[74247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 (non-flash)
Oct 16 18:31:13 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:31:13 user nova-compute[74247]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)
Oct 16 18:31:13 user nova-compute[74247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:31:13 user nova-compute[74247]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a (non-flash)
Oct 16 18:31:13 user nova-compute[74247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 (non-flash)
Oct 16 18:31:13 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.438s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] HCTL ('37', '-', '-', 0) found on session 19 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c207e4bb-577e-4046-aed5-a1e162090b15]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Searching for a device in session 19 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BykpOTxh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG nova.compute.manager [req-650780fe-e333-4762-84f1-95a40a198921 req-c14b86c5-24aa-483d-ac54-57db5f0c6d9a service nova] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Received event network-vif-unplugged-4d30f22d-4337-41a7-965d-f9c172049b00 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-650780fe-e333-4762-84f1-95a40a198921 req-c14b86c5-24aa-483d-ac54-57db5f0c6d9a service nova] Acquiring lock "4daa6370-2cdf-4668-b66b-e10196377c9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-650780fe-e333-4762-84f1-95a40a198921 req-c14b86c5-24aa-483d-ac54-57db5f0c6d9a service nova] Lock "4daa6370-2cdf-4668-b66b-e10196377c9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-650780fe-e333-4762-84f1-95a40a198921 req-c14b86c5-24aa-483d-ac54-57db5f0c6d9a service nova] Lock "4daa6370-2cdf-4668-b66b-e10196377c9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG nova.compute.manager [req-650780fe-e333-4762-84f1-95a40a198921 req-c14b86c5-24aa-483d-ac54-57db5f0c6d9a service nova] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] No waiting events found dispatching network-vif-unplugged-4d30f22d-4337-41a7-965d-f9c172049b00 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:31:13 user nova-compute[74247]: DEBUG nova.compute.manager [req-650780fe-e333-4762-84f1-95a40a198921 req-c14b86c5-24aa-483d-ac54-57db5f0c6d9a service nova] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Received event network-vif-unplugged-4d30f22d-4337-41a7-965d-f9c172049b00 for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:31:14 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Instance destroyed successfully.
Oct 16 18:31:14 user nova-compute[74247]: DEBUG nova.objects.instance [None req-addc655e-f2a7-462c-983d-078d2e7523b0 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lazy-loading 'resources' on Instance uuid 4daa6370-2cdf-4668-b66b-e10196377c9c {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-addc655e-f2a7-462c-983d-078d2e7523b0 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:24:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-528949113',display_name='tempest-VolumesAdminNegativeTest-server-528949113',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-528949113',id=5,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnWj0kTccSUuG+Cod4Y8YciINAbiWWLzLSpl9VvH4EWQajwqUGJNtystAW7W9SNQlfXx+5kVtmecquwGCWqZ3WtKSe65ztNfV8zzS2HR27pPWFgZ/8Z1HFKpUZWuxrdwQ==',key_name='tempest-keypair-1517866332',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:24:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42df518506b24ac5bedd9d75b15fa9b7',ramdisk_id='',reservation_id='r-90ke86el',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1972822081',owner_user_name='tempest-VolumesAdminNegativeTest-1972822081-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:24:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc992e02d7424d11b144101559cbc8ef',uuid=4daa6370-2cdf-4668-b66b-e10196377c9c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d30f22d-4337-41a7-965d-f9c172049b00", "address": "fa:16:3e:5c:05:1d", "network": {"id": "8451dc81-ded8-462e-a394-f5cd774f684b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1470365086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42df518506b24ac5bedd9d75b15fa9b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d30f22d-43", "ovs_interfaceid": "4d30f22d-4337-41a7-965d-f9c172049b00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-addc655e-f2a7-462c-983d-078d2e7523b0 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Converting VIF {"id": "4d30f22d-4337-41a7-965d-f9c172049b00", "address": "fa:16:3e:5c:05:1d", "network": {"id": "8451dc81-ded8-462e-a394-f5cd774f684b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1470365086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42df518506b24ac5bedd9d75b15fa9b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d30f22d-43", "ovs_interfaceid": "4d30f22d-4337-41a7-965d-f9c172049b00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-addc655e-f2a7-462c-983d-078d2e7523b0 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:05:1d,bridge_name='br-int',has_traffic_filtering=True,id=4d30f22d-4337-41a7-965d-f9c172049b00,network=Network(8451dc81-ded8-462e-a394-f5cd774f684b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d30f22d-43') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG os_vif [None req-addc655e-f2a7-462c-983d-078d2e7523b0 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:05:1d,bridge_name='br-int',has_traffic_filtering=True,id=4d30f22d-4337-41a7-965d-f9c172049b00,network=Network(8451dc81-ded8-462e-a394-f5cd774f684b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d30f22d-43') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d30f22d-43, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d70751d1-1d39-4c47-9b4a-bc049a19ca88) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:31:14 user nova-compute[74247]: INFO os_vif [None req-addc655e-f2a7-462c-983d-078d2e7523b0 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:05:1d,bridge_name='br-int',has_traffic_filtering=True,id=4d30f22d-4337-41a7-965d-f9c172049b00,network=Network(8451dc81-ded8-462e-a394-f5cd774f684b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d30f22d-43')
Oct 16 18:31:14 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-addc655e-f2a7-462c-983d-078d2e7523b0 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Deleting instance files /opt/stack/data/nova/instances/4daa6370-2cdf-4668-b66b-e10196377c9c_del
Oct 16 18:31:14 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-addc655e-f2a7-462c-983d-078d2e7523b0 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Deletion of /opt/stack/data/nova/instances/4daa6370-2cdf-4668-b66b-e10196377c9c_del complete
Oct 16 18:31:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:14 user nova-compute[74247]: INFO nova.compute.manager [None req-addc655e-f2a7-462c-983d-078d2e7523b0 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Took 1.31 seconds to destroy the instance on the hypervisor.
Oct 16 18:31:14 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-addc655e-f2a7-462c-983d-078d2e7523b0 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.490s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] <== connect_volume: return (1492ms) {'type': 'block', 'scsi_wwn': '23364663731306638', 'path': '/dev/sdf'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364663731306638', 'path': '/dev/sdf'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T18:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1643831507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1643831507',id=15,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBhF0sANZ/03xGnSsBlEhP5xqrLOn5YswxiMH0tVkN+k8phJyrEolhCxz6XLBZpBa0d6HcDDQLwP5W1UWE8yHjqqf3zr4EZl5QHQHaRViQLiasvsmm1YXaTvkU2/aD2JQ==',key_name='tempest-keypair-1285773862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b90038686fba435a8e52f00df40b3ebb',ramdisk_id='',reservation_id='r-61ak5fxw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-758290026',owner_user_name='tempest-TaggedBootDevicesTest_v242-758290026-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:29:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7ccba53dfe84ade9e0ce346b9eb3420',uuid=7fa3da6f-ba9f-4752-901a-933427fcbda8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11", "address": "fa:16:3e:7e:13:34", "network": {"id": "43dd1e8a-1185-462c-9421-d0d7b2d90334", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1360889325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ea7e01-7e", "ovs_interfaceid": "a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Converting VIF {"id": "a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11", "address": "fa:16:3e:7e:13:34", "network": {"id": "43dd1e8a-1185-462c-9421-d0d7b2d90334", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1360889325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ea7e01-7e", "ovs_interfaceid": "a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:13:34,bridge_name='br-int',has_traffic_filtering=True,id=a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11,network=Network(43dd1e8a-1185-462c-9421-d0d7b2d90334),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4ea7e01-7e') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T18:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1643831507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1643831507',id=15,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBhF0sANZ/03xGnSsBlEhP5xqrLOn5YswxiMH0tVkN+k8phJyrEolhCxz6XLBZpBa0d6HcDDQLwP5W1UWE8yHjqqf3zr4EZl5QHQHaRViQLiasvsmm1YXaTvkU2/aD2JQ==',key_name='tempest-keypair-1285773862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b90038686fba435a8e52f00df40b3ebb',ramdisk_id='',reservation_id='r-61ak5fxw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-758290026',owner_user_name='tempest-TaggedBootDevicesTest_v242-758290026-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:29:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7ccba53dfe84ade9e0ce346b9eb3420',uuid=7fa3da6f-ba9f-4752-901a-933427fcbda8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40eb3a07-e825-44ad-9077-c1880b1e8768", "address": "fa:16:3e:ef:f1:d7", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40eb3a07-e8", "ovs_interfaceid": "40eb3a07-e825-44ad-9077-c1880b1e8768", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Converting VIF {"id": "40eb3a07-e825-44ad-9077-c1880b1e8768", "address": "fa:16:3e:ef:f1:d7", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40eb3a07-e8", "ovs_interfaceid": "40eb3a07-e825-44ad-9077-c1880b1e8768", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:f1:d7,bridge_name='br-int',has_traffic_filtering=True,id=40eb3a07-e825-44ad-9077-c1880b1e8768,network=Network(ac267af4-73e2-437a-b1a6-e0ae2497cad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap40eb3a07-e8') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T18:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1643831507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1643831507',id=15,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBhF0sANZ/03xGnSsBlEhP5xqrLOn5YswxiMH0tVkN+k8phJyrEolhCxz6XLBZpBa0d6HcDDQLwP5W1UWE8yHjqqf3zr4EZl5QHQHaRViQLiasvsmm1YXaTvkU2/aD2JQ==',key_name='tempest-keypair-1285773862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b90038686fba435a8e52f00df40b3ebb',ramdisk_id='',reservation_id='r-61ak5fxw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-758290026',owner_user_name='tempest-TaggedBootDevicesTest_v242-758290026-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:29:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7ccba53dfe84ade9e0ce346b9eb3420',uuid=7fa3da6f-ba9f-4752-901a-933427fcbda8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2813ff58-0b02-4da1-8774-ad7452da7d78", "address": "fa:16:3e:56:f0:e9", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2813ff58-0b", "ovs_interfaceid": "2813ff58-0b02-4da1-8774-ad7452da7d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Converting VIF {"id": "2813ff58-0b02-4da1-8774-ad7452da7d78", "address": "fa:16:3e:56:f0:e9", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2813ff58-0b", "ovs_interfaceid": "2813ff58-0b02-4da1-8774-ad7452da7d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:f0:e9,bridge_name='br-int',has_traffic_filtering=True,id=2813ff58-0b02-4da1-8774-ad7452da7d78,network=Network(ac267af4-73e2-437a-b1a6-e0ae2497cad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2813ff58-0b') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T18:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1643831507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1643831507',id=15,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBhF0sANZ/03xGnSsBlEhP5xqrLOn5YswxiMH0tVkN+k8phJyrEolhCxz6XLBZpBa0d6HcDDQLwP5W1UWE8yHjqqf3zr4EZl5QHQHaRViQLiasvsmm1YXaTvkU2/aD2JQ==',key_name='tempest-keypair-1285773862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b90038686fba435a8e52f00df40b3ebb',ramdisk_id='',reservation_id='r-61ak5fxw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-758290026',owner_user_name='tempest-TaggedBootDevicesTest_v242-758290026-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:29:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7ccba53dfe84ade9e0ce346b9eb3420',uuid=7fa3da6f-ba9f-4752-901a-933427fcbda8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec", "address": "fa:16:3e:32:8d:af", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dbd4bf3-bf", "ovs_interfaceid": "1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Converting VIF {"id": "1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec", "address": "fa:16:3e:32:8d:af", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dbd4bf3-bf", "ovs_interfaceid": "1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:8d:af,bridge_name='br-int',has_traffic_filtering=True,id=1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec,network=Network(ac267af4-73e2-437a-b1a6-e0ae2497cad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dbd4bf3-bf') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T18:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1643831507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1643831507',id=15,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBhF0sANZ/03xGnSsBlEhP5xqrLOn5YswxiMH0tVkN+k8phJyrEolhCxz6XLBZpBa0d6HcDDQLwP5W1UWE8yHjqqf3zr4EZl5QHQHaRViQLiasvsmm1YXaTvkU2/aD2JQ==',key_name='tempest-keypair-1285773862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b90038686fba435a8e52f00df40b3ebb',ramdisk_id='',reservation_id='r-61ak5fxw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-758290026',owner_user_name='tempest-TaggedBootDevicesTest_v242-758290026-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:29:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7ccba53dfe84ade9e0ce346b9eb3420',uuid=7fa3da6f-ba9f-4752-901a-933427fcbda8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5", "address": "fa:16:3e:73:c9:16", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9f5274-68", "ovs_interfaceid": "2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Converting VIF {"id": "2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5", "address": "fa:16:3e:73:c9:16", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9f5274-68", "ovs_interfaceid": "2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:c9:16,bridge_name='br-int',has_traffic_filtering=True,id=2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5,network=Network(ac267af4-73e2-437a-b1a6-e0ae2497cad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f9f5274-68') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T18:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1643831507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1643831507',id=15,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBhF0sANZ/03xGnSsBlEhP5xqrLOn5YswxiMH0tVkN+k8phJyrEolhCxz6XLBZpBa0d6HcDDQLwP5W1UWE8yHjqqf3zr4EZl5QHQHaRViQLiasvsmm1YXaTvkU2/aD2JQ==',key_name='tempest-keypair-1285773862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b90038686fba435a8e52f00df40b3ebb',ramdisk_id='',reservation_id='r-61ak5fxw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-758290026',owner_user_name='tempest-TaggedBootDevicesTest_v242-758290026-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:29:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7ccba53dfe84ade9e0ce346b9eb3420',uuid=7fa3da6f-ba9f-4752-901a-933427fcbda8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a815917f-f1ec-48f2-b272-97bf2ad1d6cd", "address": "fa:16:3e:22:3b:ee", "network": {"id": "20ec901d-4e30-4c4a-ab56-7d57878cfdcc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1805797092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa815917f-f1", "ovs_interfaceid": "a815917f-f1ec-48f2-b272-97bf2ad1d6cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Converting VIF {"id": "a815917f-f1ec-48f2-b272-97bf2ad1d6cd", "address": "fa:16:3e:22:3b:ee", "network": {"id": "20ec901d-4e30-4c4a-ab56-7d57878cfdcc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1805797092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa815917f-f1", "ovs_interfaceid": "a815917f-f1ec-48f2-b272-97bf2ad1d6cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:3b:ee,bridge_name='br-int',has_traffic_filtering=True,id=a815917f-f1ec-48f2-b272-97bf2ad1d6cd,network=Network(20ec901d-4e30-4c4a-ab56-7d57878cfdcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa815917f-f1') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T18:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1643831507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1643831507',id=15,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBhF0sANZ/03xGnSsBlEhP5xqrLOn5YswxiMH0tVkN+k8phJyrEolhCxz6XLBZpBa0d6HcDDQLwP5W1UWE8yHjqqf3zr4EZl5QHQHaRViQLiasvsmm1YXaTvkU2/aD2JQ==',key_name='tempest-keypair-1285773862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b90038686fba435a8e52f00df40b3ebb',ramdisk_id='',reservation_id='r-61ak5fxw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-758290026',owner_user_name='tempest-TaggedBootDevicesTest_v242-758290026-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:29:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7ccba53dfe84ade9e0ce346b9eb3420',uuid=7fa3da6f-ba9f-4752-901a-933427fcbda8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23684bac-dba0-4fdd-80d3-750ed2a77731", "address": "fa:16:3e:46:79:42", "network": {"id": "20ec901d-4e30-4c4a-ab56-7d57878cfdcc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1805797092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23684bac-db", "ovs_interfaceid": "23684bac-dba0-4fdd-80d3-750ed2a77731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Converting VIF {"id": "23684bac-dba0-4fdd-80d3-750ed2a77731", "address": "fa:16:3e:46:79:42", "network": {"id": "20ec901d-4e30-4c4a-ab56-7d57878cfdcc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1805797092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23684bac-db", "ovs_interfaceid": "23684bac-dba0-4fdd-80d3-750ed2a77731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:79:42,bridge_name='br-int',has_traffic_filtering=True,id=23684bac-dba0-4fdd-80d3-750ed2a77731,network=Network(20ec901d-4e30-4c4a-ab56-7d57878cfdcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23684bac-db') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG nova.objects.instance [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Lazy-loading 'pci_devices' on Instance uuid 7fa3da6f-ba9f-4752-901a-933427fcbda8 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:31:14 user nova-compute[74247]:   <uuid>7fa3da6f-ba9f-4752-901a-933427fcbda8</uuid>
Oct 16 18:31:14 user nova-compute[74247]:   <name>instance-0000000f</name>
Oct 16 18:31:14 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:31:14 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:31:14 user nova-compute[74247]:   <metadata>
Oct 16 18:31:14 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:31:14 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:31:14 user nova-compute[74247]:       <nova:name>tempest-device-tagging-server-1643831507</nova:name>
Oct 16 18:31:14 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:31:09</nova:creationTime>
Oct 16 18:31:14 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:31:14 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:31:14 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:31:14 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:31:14 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:31:14 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:31:14 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:31:14 user nova-compute[74247]:       <nova:owner>
Oct 16 18:31:14 user nova-compute[74247]:         <nova:user uuid="e7ccba53dfe84ade9e0ce346b9eb3420">tempest-TaggedBootDevicesTest_v242-758290026-project-member</nova:user>
Oct 16 18:31:14 user nova-compute[74247]:         <nova:project uuid="b90038686fba435a8e52f00df40b3ebb">tempest-TaggedBootDevicesTest_v242-758290026</nova:project>
Oct 16 18:31:14 user nova-compute[74247]:       </nova:owner>
Oct 16 18:31:14 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:31:14 user nova-compute[74247]:       <nova:ports>
Oct 16 18:31:14 user nova-compute[74247]:         <nova:port uuid="a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11">
Oct 16 18:31:14 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 16 18:31:14 user nova-compute[74247]:         </nova:port>
Oct 16 18:31:14 user nova-compute[74247]:         <nova:port uuid="40eb3a07-e825-44ad-9077-c1880b1e8768">
Oct 16 18:31:14 user nova-compute[74247]:           <nova:ip type="fixed" address="10.1.1.89" ipVersion="4"/>
Oct 16 18:31:14 user nova-compute[74247]:         </nova:port>
Oct 16 18:31:14 user nova-compute[74247]:         <nova:port uuid="2813ff58-0b02-4da1-8774-ad7452da7d78">
Oct 16 18:31:14 user nova-compute[74247]:           <nova:ip type="fixed" address="10.1.1.82" ipVersion="4"/>
Oct 16 18:31:14 user nova-compute[74247]:         </nova:port>
Oct 16 18:31:14 user nova-compute[74247]:         <nova:port uuid="1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec">
Oct 16 18:31:14 user nova-compute[74247]:           <nova:ip type="fixed" address="10.1.1.167" ipVersion="4"/>
Oct 16 18:31:14 user nova-compute[74247]:         </nova:port>
Oct 16 18:31:14 user nova-compute[74247]:         <nova:port uuid="2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5">
Oct 16 18:31:14 user nova-compute[74247]:           <nova:ip type="fixed" address="10.1.1.83" ipVersion="4"/>
Oct 16 18:31:14 user nova-compute[74247]:         </nova:port>
Oct 16 18:31:14 user nova-compute[74247]:         <nova:port uuid="a815917f-f1ec-48f2-b272-97bf2ad1d6cd">
Oct 16 18:31:14 user nova-compute[74247]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 16 18:31:14 user nova-compute[74247]:         </nova:port>
Oct 16 18:31:14 user nova-compute[74247]:         <nova:port uuid="23684bac-dba0-4fdd-80d3-750ed2a77731">
Oct 16 18:31:14 user nova-compute[74247]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 16 18:31:14 user nova-compute[74247]:         </nova:port>
Oct 16 18:31:14 user nova-compute[74247]:       </nova:ports>
Oct 16 18:31:14 user nova-compute[74247]:     </nova:instance>
Oct 16 18:31:14 user nova-compute[74247]:   </metadata>
Oct 16 18:31:14 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:31:14 user nova-compute[74247]:     <system>
Oct 16 18:31:14 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:31:14 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:31:14 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:31:14 user nova-compute[74247]:       <entry name="serial">7fa3da6f-ba9f-4752-901a-933427fcbda8</entry>
Oct 16 18:31:14 user nova-compute[74247]:       <entry name="uuid">7fa3da6f-ba9f-4752-901a-933427fcbda8</entry>
Oct 16 18:31:14 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:31:14 user nova-compute[74247]:     </system>
Oct 16 18:31:14 user nova-compute[74247]:   </sysinfo>
Oct 16 18:31:14 user nova-compute[74247]:   <os>
Oct 16 18:31:14 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:31:14 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:31:14 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:31:14 user nova-compute[74247]:   </os>
Oct 16 18:31:14 user nova-compute[74247]:   <features>
Oct 16 18:31:14 user nova-compute[74247]:     <acpi/>
Oct 16 18:31:14 user nova-compute[74247]:     <apic/>
Oct 16 18:31:14 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:31:14 user nova-compute[74247]:   </features>
Oct 16 18:31:14 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:31:14 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:31:14 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:31:14 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:31:14 user nova-compute[74247]:   </clock>
Oct 16 18:31:14 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:31:14 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:31:14 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:31:14 user nova-compute[74247]:   </cpu>
Oct 16 18:31:14 user nova-compute[74247]:   <devices>
Oct 16 18:31:14 user nova-compute[74247]:     <disk type="file" device="cdrom">
Oct 16 18:31:14 user nova-compute[74247]:       <driver name="qemu" type="raw" cache="none"/>
Oct 16 18:31:14 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/7fa3da6f-ba9f-4752-901a-933427fcbda8/disk.config"/>
Oct 16 18:31:14 user nova-compute[74247]:       <target dev="hda" bus="ide"/>
Oct 16 18:31:14 user nova-compute[74247]:     </disk>
Oct 16 18:31:14 user nova-compute[74247]:     <disk type="block" device="disk">
Oct 16 18:31:14 user nova-compute[74247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:31:14 user nova-compute[74247]:       <source dev="/dev/sdc"/>
Oct 16 18:31:14 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:31:14 user nova-compute[74247]:       <serial>2e2502cf-023d-406e-8618-c7c75907ae93</serial>
Oct 16 18:31:14 user nova-compute[74247]:     </disk>
Oct 16 18:31:14 user nova-compute[74247]:     <disk type="block" device="disk">
Oct 16 18:31:14 user nova-compute[74247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:31:14 user nova-compute[74247]:       <source dev="/dev/sde"/>
Oct 16 18:31:14 user nova-compute[74247]:       <target dev="vdb" bus="virtio"/>
Oct 16 18:31:14 user nova-compute[74247]:       <serial>e8274378-306d-460c-82c3-abda468dd73a</serial>
Oct 16 18:31:14 user nova-compute[74247]:     </disk>
Oct 16 18:31:14 user nova-compute[74247]:     <disk type="block" device="disk">
Oct 16 18:31:14 user nova-compute[74247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:31:14 user nova-compute[74247]:       <source dev="/dev/sdf"/>
Oct 16 18:31:14 user nova-compute[74247]:       <target dev="vdc" bus="virtio"/>
Oct 16 18:31:14 user nova-compute[74247]:       <serial>012ad1ce-7193-4cf7-918c-d9cf4b9beba2</serial>
Oct 16 18:31:14 user nova-compute[74247]:     </disk>
Oct 16 18:31:14 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:31:14 user nova-compute[74247]:       <mac address="fa:16:3e:7e:13:34"/>
Oct 16 18:31:14 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:31:14 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:31:14 user nova-compute[74247]:       <target dev="tapa4ea7e01-7e"/>
Oct 16 18:31:14 user nova-compute[74247]:     </interface>
Oct 16 18:31:14 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:31:14 user nova-compute[74247]:       <mac address="fa:16:3e:ef:f1:d7"/>
Oct 16 18:31:14 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:31:14 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:31:14 user nova-compute[74247]:       <target dev="tap40eb3a07-e8"/>
Oct 16 18:31:14 user nova-compute[74247]:     </interface>
Oct 16 18:31:14 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:31:14 user nova-compute[74247]:       <mac address="fa:16:3e:56:f0:e9"/>
Oct 16 18:31:14 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:31:14 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:31:14 user nova-compute[74247]:       <target dev="tap2813ff58-0b"/>
Oct 16 18:31:14 user nova-compute[74247]:     </interface>
Oct 16 18:31:14 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:31:14 user nova-compute[74247]:       <mac address="fa:16:3e:32:8d:af"/>
Oct 16 18:31:14 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:31:14 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:31:14 user nova-compute[74247]:       <target dev="tap1dbd4bf3-bf"/>
Oct 16 18:31:14 user nova-compute[74247]:     </interface>
Oct 16 18:31:14 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:31:14 user nova-compute[74247]:       <mac address="fa:16:3e:73:c9:16"/>
Oct 16 18:31:14 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:31:14 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:31:14 user nova-compute[74247]:       <target dev="tap2f9f5274-68"/>
Oct 16 18:31:14 user nova-compute[74247]:     </interface>
Oct 16 18:31:14 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:31:14 user nova-compute[74247]:       <mac address="fa:16:3e:22:3b:ee"/>
Oct 16 18:31:14 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:31:14 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:31:14 user nova-compute[74247]:       <target dev="tapa815917f-f1"/>
Oct 16 18:31:14 user nova-compute[74247]:     </interface>
Oct 16 18:31:14 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:31:14 user nova-compute[74247]:       <mac address="fa:16:3e:46:79:42"/>
Oct 16 18:31:14 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:31:14 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:31:14 user nova-compute[74247]:       <target dev="tap23684bac-db"/>
Oct 16 18:31:14 user nova-compute[74247]:     </interface>
Oct 16 18:31:14 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:31:14 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/7fa3da6f-ba9f-4752-901a-933427fcbda8/console.log" append="off"/>
Oct 16 18:31:14 user nova-compute[74247]:     </serial>
Oct 16 18:31:14 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:31:14 user nova-compute[74247]:     <video>
Oct 16 18:31:14 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:31:14 user nova-compute[74247]:     </video>
Oct 16 18:31:14 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:31:14 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:31:14 user nova-compute[74247]:     </rng>
Oct 16 18:31:14 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:31:14 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:31:14 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:31:14 user nova-compute[74247]:     </memballoon>
Oct 16 18:31:14 user nova-compute[74247]:   </devices>
Oct 16 18:31:14 user nova-compute[74247]: </domain>
Oct 16 18:31:14 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T18:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1643831507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1643831507',id=15,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBhF0sANZ/03xGnSsBlEhP5xqrLOn5YswxiMH0tVkN+k8phJyrEolhCxz6XLBZpBa0d6HcDDQLwP5W1UWE8yHjqqf3zr4EZl5QHQHaRViQLiasvsmm1YXaTvkU2/aD2JQ==',key_name='tempest-keypair-1285773862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b90038686fba435a8e52f00df40b3ebb',ramdisk_id='',reservation_id='r-61ak5fxw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-758290026',owner_user_name='tempest-TaggedBootDevicesTest_v242-758290026-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:29:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7ccba53dfe84ade9e0ce346b9eb3420',uuid=7fa3da6f-ba9f-4752-901a-933427fcbda8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11", "address": "fa:16:3e:7e:13:34", "network": {"id": "43dd1e8a-1185-462c-9421-d0d7b2d90334", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1360889325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ea7e01-7e", "ovs_interfaceid": "a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Converting VIF {"id": "a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11", "address": "fa:16:3e:7e:13:34", "network": {"id": "43dd1e8a-1185-462c-9421-d0d7b2d90334", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1360889325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ea7e01-7e", "ovs_interfaceid": "a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:13:34,bridge_name='br-int',has_traffic_filtering=True,id=a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11,network=Network(43dd1e8a-1185-462c-9421-d0d7b2d90334),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4ea7e01-7e') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG os_vif [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:13:34,bridge_name='br-int',has_traffic_filtering=True,id=a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11,network=Network(43dd1e8a-1185-462c-9421-d0d7b2d90334),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4ea7e01-7e') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '55dc728a-4a59-5668-871b-28314fb201aa', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa4ea7e01-7e, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa4ea7e01-7e, col_values=(('qos', UUID('12941255-b2f1-4cbb-8ec2-16c62bc54c32')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa4ea7e01-7e, col_values=(('external_ids', {'iface-id': 'a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:13:34', 'vm-uuid': '7fa3da6f-ba9f-4752-901a-933427fcbda8'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:14 user nova-compute[74247]: INFO os_vif [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:13:34,bridge_name='br-int',has_traffic_filtering=True,id=a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11,network=Network(43dd1e8a-1185-462c-9421-d0d7b2d90334),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4ea7e01-7e')
Oct 16 18:31:14 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T18:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1643831507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1643831507',id=15,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBhF0sANZ/03xGnSsBlEhP5xqrLOn5YswxiMH0tVkN+k8phJyrEolhCxz6XLBZpBa0d6HcDDQLwP5W1UWE8yHjqqf3zr4EZl5QHQHaRViQLiasvsmm1YXaTvkU2/aD2JQ==',key_name='tempest-keypair-1285773862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b90038686fba435a8e52f00df40b3ebb',ramdisk_id='',reservation_id='r-61ak5fxw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-758290026',owner_user_name='tempest-TaggedBootDevicesTest_v242-758290026-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:29:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7ccba53dfe84ade9e0ce346b9eb3420',uuid=7fa3da6f-ba9f-4752-901a-933427fcbda8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40eb3a07-e825-44ad-9077-c1880b1e8768", "address": "fa:16:3e:ef:f1:d7", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40eb3a07-e8", "ovs_interfaceid": "40eb3a07-e825-44ad-9077-c1880b1e8768", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Converting VIF {"id": "40eb3a07-e825-44ad-9077-c1880b1e8768", "address": "fa:16:3e:ef:f1:d7", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40eb3a07-e8", "ovs_interfaceid": "40eb3a07-e825-44ad-9077-c1880b1e8768", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:f1:d7,bridge_name='br-int',has_traffic_filtering=True,id=40eb3a07-e825-44ad-9077-c1880b1e8768,network=Network(ac267af4-73e2-437a-b1a6-e0ae2497cad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap40eb3a07-e8') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG os_vif [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:f1:d7,bridge_name='br-int',has_traffic_filtering=True,id=40eb3a07-e825-44ad-9077-c1880b1e8768,network=Network(ac267af4-73e2-437a-b1a6-e0ae2497cad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap40eb3a07-e8') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e7609946-d64b-543b-983c-bc970c8e237b', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap40eb3a07-e8, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap40eb3a07-e8, col_values=(('qos', UUID('d7cda069-3118-4b9e-b0e8-163260849804')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap40eb3a07-e8, col_values=(('external_ids', {'iface-id': '40eb3a07-e825-44ad-9077-c1880b1e8768', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:f1:d7', 'vm-uuid': '7fa3da6f-ba9f-4752-901a-933427fcbda8'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:15 user nova-compute[74247]: INFO os_vif [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:f1:d7,bridge_name='br-int',has_traffic_filtering=True,id=40eb3a07-e825-44ad-9077-c1880b1e8768,network=Network(ac267af4-73e2-437a-b1a6-e0ae2497cad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap40eb3a07-e8')
Oct 16 18:31:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T18:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1643831507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1643831507',id=15,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBhF0sANZ/03xGnSsBlEhP5xqrLOn5YswxiMH0tVkN+k8phJyrEolhCxz6XLBZpBa0d6HcDDQLwP5W1UWE8yHjqqf3zr4EZl5QHQHaRViQLiasvsmm1YXaTvkU2/aD2JQ==',key_name='tempest-keypair-1285773862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b90038686fba435a8e52f00df40b3ebb',ramdisk_id='',reservation_id='r-61ak5fxw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-758290026',owner_user_name='tempest-TaggedBootDevicesTest_v242-758290026-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:29:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7ccba53dfe84ade9e0ce346b9eb3420',uuid=7fa3da6f-ba9f-4752-901a-933427fcbda8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2813ff58-0b02-4da1-8774-ad7452da7d78", "address": "fa:16:3e:56:f0:e9", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2813ff58-0b", "ovs_interfaceid": "2813ff58-0b02-4da1-8774-ad7452da7d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Converting VIF {"id": "2813ff58-0b02-4da1-8774-ad7452da7d78", "address": "fa:16:3e:56:f0:e9", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2813ff58-0b", "ovs_interfaceid": "2813ff58-0b02-4da1-8774-ad7452da7d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:f0:e9,bridge_name='br-int',has_traffic_filtering=True,id=2813ff58-0b02-4da1-8774-ad7452da7d78,network=Network(ac267af4-73e2-437a-b1a6-e0ae2497cad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2813ff58-0b') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG os_vif [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:f0:e9,bridge_name='br-int',has_traffic_filtering=True,id=2813ff58-0b02-4da1-8774-ad7452da7d78,network=Network(ac267af4-73e2-437a-b1a6-e0ae2497cad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2813ff58-0b') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '04163ded-5879-5245-9b22-11d70e2728b0', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2813ff58-0b, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2813ff58-0b, col_values=(('qos', UUID('e58d90f0-f491-4950-9029-c63bd9f63a05')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2813ff58-0b, col_values=(('external_ids', {'iface-id': '2813ff58-0b02-4da1-8774-ad7452da7d78', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:f0:e9', 'vm-uuid': '7fa3da6f-ba9f-4752-901a-933427fcbda8'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:15 user nova-compute[74247]: INFO os_vif [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:f0:e9,bridge_name='br-int',has_traffic_filtering=True,id=2813ff58-0b02-4da1-8774-ad7452da7d78,network=Network(ac267af4-73e2-437a-b1a6-e0ae2497cad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2813ff58-0b')
Oct 16 18:31:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T18:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1643831507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1643831507',id=15,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBhF0sANZ/03xGnSsBlEhP5xqrLOn5YswxiMH0tVkN+k8phJyrEolhCxz6XLBZpBa0d6HcDDQLwP5W1UWE8yHjqqf3zr4EZl5QHQHaRViQLiasvsmm1YXaTvkU2/aD2JQ==',key_name='tempest-keypair-1285773862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b90038686fba435a8e52f00df40b3ebb',ramdisk_id='',reservation_id='r-61ak5fxw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-758290026',owner_user_name='tempest-TaggedBootDevicesTest_v242-758290026-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:29:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7ccba53dfe84ade9e0ce346b9eb3420',uuid=7fa3da6f-ba9f-4752-901a-933427fcbda8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec", "address": "fa:16:3e:32:8d:af", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dbd4bf3-bf", "ovs_interfaceid": "1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Converting VIF {"id": "1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec", "address": "fa:16:3e:32:8d:af", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dbd4bf3-bf", "ovs_interfaceid": "1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:8d:af,bridge_name='br-int',has_traffic_filtering=True,id=1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec,network=Network(ac267af4-73e2-437a-b1a6-e0ae2497cad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dbd4bf3-bf') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG os_vif [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:8d:af,bridge_name='br-int',has_traffic_filtering=True,id=1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec,network=Network(ac267af4-73e2-437a-b1a6-e0ae2497cad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dbd4bf3-bf') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '846faf7f-6535-5232-b118-b77a48eda0e2', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1dbd4bf3-bf, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1dbd4bf3-bf, col_values=(('qos', UUID('be468974-d9be-43f9-8ddb-11e972368d36')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1dbd4bf3-bf, col_values=(('external_ids', {'iface-id': '1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:8d:af', 'vm-uuid': '7fa3da6f-ba9f-4752-901a-933427fcbda8'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:15 user nova-compute[74247]: INFO os_vif [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:8d:af,bridge_name='br-int',has_traffic_filtering=True,id=1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec,network=Network(ac267af4-73e2-437a-b1a6-e0ae2497cad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dbd4bf3-bf')
Oct 16 18:31:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T18:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1643831507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1643831507',id=15,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBhF0sANZ/03xGnSsBlEhP5xqrLOn5YswxiMH0tVkN+k8phJyrEolhCxz6XLBZpBa0d6HcDDQLwP5W1UWE8yHjqqf3zr4EZl5QHQHaRViQLiasvsmm1YXaTvkU2/aD2JQ==',key_name='tempest-keypair-1285773862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b90038686fba435a8e52f00df40b3ebb',ramdisk_id='',reservation_id='r-61ak5fxw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-758290026',owner_user_name='tempest-TaggedBootDevicesTest_v242-758290026-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:29:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7ccba53dfe84ade9e0ce346b9eb3420',uuid=7fa3da6f-ba9f-4752-901a-933427fcbda8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5", "address": "fa:16:3e:73:c9:16", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9f5274-68", "ovs_interfaceid": "2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Converting VIF {"id": "2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5", "address": "fa:16:3e:73:c9:16", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9f5274-68", "ovs_interfaceid": "2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:c9:16,bridge_name='br-int',has_traffic_filtering=True,id=2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5,network=Network(ac267af4-73e2-437a-b1a6-e0ae2497cad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f9f5274-68') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG os_vif [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:c9:16,bridge_name='br-int',has_traffic_filtering=True,id=2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5,network=Network(ac267af4-73e2-437a-b1a6-e0ae2497cad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f9f5274-68') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e763d001-e92c-52ef-8842-4b0b90195b4d', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f9f5274-68, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2f9f5274-68, col_values=(('qos', UUID('16ff2474-4d18-480d-af52-33cda6e779a5')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2f9f5274-68, col_values=(('external_ids', {'iface-id': '2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:c9:16', 'vm-uuid': '7fa3da6f-ba9f-4752-901a-933427fcbda8'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:15 user nova-compute[74247]: INFO os_vif [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:c9:16,bridge_name='br-int',has_traffic_filtering=True,id=2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5,network=Network(ac267af4-73e2-437a-b1a6-e0ae2497cad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f9f5274-68')
Oct 16 18:31:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T18:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1643831507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1643831507',id=15,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBhF0sANZ/03xGnSsBlEhP5xqrLOn5YswxiMH0tVkN+k8phJyrEolhCxz6XLBZpBa0d6HcDDQLwP5W1UWE8yHjqqf3zr4EZl5QHQHaRViQLiasvsmm1YXaTvkU2/aD2JQ==',key_name='tempest-keypair-1285773862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b90038686fba435a8e52f00df40b3ebb',ramdisk_id='',reservation_id='r-61ak5fxw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-758290026',owner_user_name='tempest-TaggedBootDevicesTest_v242-758290026-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:29:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7ccba53dfe84ade9e0ce346b9eb3420',uuid=7fa3da6f-ba9f-4752-901a-933427fcbda8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a815917f-f1ec-48f2-b272-97bf2ad1d6cd", "address": "fa:16:3e:22:3b:ee", "network": {"id": "20ec901d-4e30-4c4a-ab56-7d57878cfdcc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1805797092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa815917f-f1", "ovs_interfaceid": "a815917f-f1ec-48f2-b272-97bf2ad1d6cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Converting VIF {"id": "a815917f-f1ec-48f2-b272-97bf2ad1d6cd", "address": "fa:16:3e:22:3b:ee", "network": {"id": "20ec901d-4e30-4c4a-ab56-7d57878cfdcc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1805797092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa815917f-f1", "ovs_interfaceid": "a815917f-f1ec-48f2-b272-97bf2ad1d6cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:3b:ee,bridge_name='br-int',has_traffic_filtering=True,id=a815917f-f1ec-48f2-b272-97bf2ad1d6cd,network=Network(20ec901d-4e30-4c4a-ab56-7d57878cfdcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa815917f-f1') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG os_vif [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:3b:ee,bridge_name='br-int',has_traffic_filtering=True,id=a815917f-f1ec-48f2-b272-97bf2ad1d6cd,network=Network(20ec901d-4e30-4c4a-ab56-7d57878cfdcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa815917f-f1') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5a576e54-ed4d-5eb9-9c47-3b3bc0411d45', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa815917f-f1, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa815917f-f1, col_values=(('qos', UUID('f0bcead6-3f24-4517-a3c6-61b9a8c0d083')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa815917f-f1, col_values=(('external_ids', {'iface-id': 'a815917f-f1ec-48f2-b272-97bf2ad1d6cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:3b:ee', 'vm-uuid': '7fa3da6f-ba9f-4752-901a-933427fcbda8'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:15 user nova-compute[74247]: INFO os_vif [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:3b:ee,bridge_name='br-int',has_traffic_filtering=True,id=a815917f-f1ec-48f2-b272-97bf2ad1d6cd,network=Network(20ec901d-4e30-4c4a-ab56-7d57878cfdcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa815917f-f1')
Oct 16 18:31:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T18:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1643831507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1643831507',id=15,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBhF0sANZ/03xGnSsBlEhP5xqrLOn5YswxiMH0tVkN+k8phJyrEolhCxz6XLBZpBa0d6HcDDQLwP5W1UWE8yHjqqf3zr4EZl5QHQHaRViQLiasvsmm1YXaTvkU2/aD2JQ==',key_name='tempest-keypair-1285773862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b90038686fba435a8e52f00df40b3ebb',ramdisk_id='',reservation_id='r-61ak5fxw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-758290026',owner_user_name='tempest-TaggedBootDevicesTest_v242-758290026-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:29:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7ccba53dfe84ade9e0ce346b9eb3420',uuid=7fa3da6f-ba9f-4752-901a-933427fcbda8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23684bac-dba0-4fdd-80d3-750ed2a77731", "address": "fa:16:3e:46:79:42", "network": {"id": "20ec901d-4e30-4c4a-ab56-7d57878cfdcc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1805797092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23684bac-db", "ovs_interfaceid": "23684bac-dba0-4fdd-80d3-750ed2a77731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Converting VIF {"id": "23684bac-dba0-4fdd-80d3-750ed2a77731", "address": "fa:16:3e:46:79:42", "network": {"id": "20ec901d-4e30-4c4a-ab56-7d57878cfdcc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1805797092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23684bac-db", "ovs_interfaceid": "23684bac-dba0-4fdd-80d3-750ed2a77731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:79:42,bridge_name='br-int',has_traffic_filtering=True,id=23684bac-dba0-4fdd-80d3-750ed2a77731,network=Network(20ec901d-4e30-4c4a-ab56-7d57878cfdcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23684bac-db') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG os_vif [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:79:42,bridge_name='br-int',has_traffic_filtering=True,id=23684bac-dba0-4fdd-80d3-750ed2a77731,network=Network(20ec901d-4e30-4c4a-ab56-7d57878cfdcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23684bac-db') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd2859f95-09c5-5c7c-94c6-c929fe95a678', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23684bac-db, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap23684bac-db, col_values=(('qos', UUID('aaedf15e-a3f9-47f4-81d9-7e088dd0933e')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap23684bac-db, col_values=(('external_ids', {'iface-id': '23684bac-dba0-4fdd-80d3-750ed2a77731', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:79:42', 'vm-uuid': '7fa3da6f-ba9f-4752-901a-933427fcbda8'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:15 user nova-compute[74247]: INFO os_vif [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:79:42,bridge_name='br-int',has_traffic_filtering=True,id=23684bac-dba0-4fdd-80d3-750ed2a77731,network=Network(20ec901d-4e30-4c4a-ab56-7d57878cfdcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23684bac-db')
Oct 16 18:31:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] No BDM found with device name hda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] No VIF found with MAC fa:16:3e:7e:13:34, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] No VIF found with MAC fa:16:3e:73:c9:16, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:31:15 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Using config drive
Oct 16 18:31:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:15 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:31:16 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Took 1.27 seconds to deallocate network for instance.
Oct 16 18:31:16 user nova-compute[74247]: DEBUG nova.compute.manager [req-857265bd-e8ba-4d83-a7a8-10f1adacbc3a req-1ea646ee-80de-4f88-a09b-6bde8bedb8fd service nova] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Received event network-vif-deleted-4d30f22d-4337-41a7-965d-f9c172049b00 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:31:16 user nova-compute[74247]: INFO nova.compute.manager [req-857265bd-e8ba-4d83-a7a8-10f1adacbc3a req-1ea646ee-80de-4f88-a09b-6bde8bedb8fd service nova] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Neutron deleted interface 4d30f22d-4337-41a7-965d-f9c172049b00; detaching it from the instance and deleting it from the info cache
Oct 16 18:31:16 user nova-compute[74247]: DEBUG nova.network.neutron [req-857265bd-e8ba-4d83-a7a8-10f1adacbc3a req-1ea646ee-80de-4f88-a09b-6bde8bedb8fd service nova] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:31:16 user nova-compute[74247]: DEBUG nova.compute.manager [req-fb494b7d-13ff-4be2-b6d3-0255ee4a85c3 req-58abe789-7c38-40b6-b220-ea044e78b909 service nova] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Received event network-vif-plugged-4d30f22d-4337-41a7-965d-f9c172049b00 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:31:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-fb494b7d-13ff-4be2-b6d3-0255ee4a85c3 req-58abe789-7c38-40b6-b220-ea044e78b909 service nova] Acquiring lock "4daa6370-2cdf-4668-b66b-e10196377c9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:31:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-fb494b7d-13ff-4be2-b6d3-0255ee4a85c3 req-58abe789-7c38-40b6-b220-ea044e78b909 service nova] Lock "4daa6370-2cdf-4668-b66b-e10196377c9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:31:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-fb494b7d-13ff-4be2-b6d3-0255ee4a85c3 req-58abe789-7c38-40b6-b220-ea044e78b909 service nova] Lock "4daa6370-2cdf-4668-b66b-e10196377c9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:31:16 user nova-compute[74247]: DEBUG nova.compute.manager [req-fb494b7d-13ff-4be2-b6d3-0255ee4a85c3 req-58abe789-7c38-40b6-b220-ea044e78b909 service nova] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] No waiting events found dispatching network-vif-plugged-4d30f22d-4337-41a7-965d-f9c172049b00 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:31:16 user nova-compute[74247]: WARNING nova.compute.manager [req-fb494b7d-13ff-4be2-b6d3-0255ee4a85c3 req-58abe789-7c38-40b6-b220-ea044e78b909 service nova] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Received unexpected event network-vif-plugged-4d30f22d-4337-41a7-965d-f9c172049b00 for instance with vm_state active and task_state deleting.
Oct 16 18:31:16 user nova-compute[74247]: DEBUG nova.compute.manager [req-fb494b7d-13ff-4be2-b6d3-0255ee4a85c3 req-58abe789-7c38-40b6-b220-ea044e78b909 service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] Received event network-vif-plugged-8cb168df-92d2-4ecc-946a-7d9075f75561 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:31:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-fb494b7d-13ff-4be2-b6d3-0255ee4a85c3 req-58abe789-7c38-40b6-b220-ea044e78b909 service nova] Acquiring lock "a686ee86-272c-47be-8801-9c1500af272f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:31:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-fb494b7d-13ff-4be2-b6d3-0255ee4a85c3 req-58abe789-7c38-40b6-b220-ea044e78b909 service nova] Lock "a686ee86-272c-47be-8801-9c1500af272f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:31:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-fb494b7d-13ff-4be2-b6d3-0255ee4a85c3 req-58abe789-7c38-40b6-b220-ea044e78b909 service nova] Lock "a686ee86-272c-47be-8801-9c1500af272f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:31:16 user nova-compute[74247]: DEBUG nova.compute.manager [req-fb494b7d-13ff-4be2-b6d3-0255ee4a85c3 req-58abe789-7c38-40b6-b220-ea044e78b909 service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] No waiting events found dispatching network-vif-plugged-8cb168df-92d2-4ecc-946a-7d9075f75561 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:31:16 user nova-compute[74247]: WARNING nova.compute.manager [req-fb494b7d-13ff-4be2-b6d3-0255ee4a85c3 req-58abe789-7c38-40b6-b220-ea044e78b909 service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] Received unexpected event network-vif-plugged-8cb168df-92d2-4ecc-946a-7d9075f75561 for instance with vm_state resized and task_state resize_reverting.
Oct 16 18:31:16 user nova-compute[74247]: DEBUG nova.compute.manager [req-fb494b7d-13ff-4be2-b6d3-0255ee4a85c3 req-58abe789-7c38-40b6-b220-ea044e78b909 service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] Received event network-vif-plugged-8cb168df-92d2-4ecc-946a-7d9075f75561 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:31:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-fb494b7d-13ff-4be2-b6d3-0255ee4a85c3 req-58abe789-7c38-40b6-b220-ea044e78b909 service nova] Acquiring lock "a686ee86-272c-47be-8801-9c1500af272f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:31:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-fb494b7d-13ff-4be2-b6d3-0255ee4a85c3 req-58abe789-7c38-40b6-b220-ea044e78b909 service nova] Lock "a686ee86-272c-47be-8801-9c1500af272f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:31:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-fb494b7d-13ff-4be2-b6d3-0255ee4a85c3 req-58abe789-7c38-40b6-b220-ea044e78b909 service nova] Lock "a686ee86-272c-47be-8801-9c1500af272f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:31:16 user nova-compute[74247]: DEBUG nova.compute.manager [req-fb494b7d-13ff-4be2-b6d3-0255ee4a85c3 req-58abe789-7c38-40b6-b220-ea044e78b909 service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] No waiting events found dispatching network-vif-plugged-8cb168df-92d2-4ecc-946a-7d9075f75561 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:31:16 user nova-compute[74247]: WARNING nova.compute.manager [req-fb494b7d-13ff-4be2-b6d3-0255ee4a85c3 req-58abe789-7c38-40b6-b220-ea044e78b909 service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] Received unexpected event network-vif-plugged-8cb168df-92d2-4ecc-946a-7d9075f75561 for instance with vm_state resized and task_state resize_reverting.
Oct 16 18:31:16 user nova-compute[74247]: DEBUG nova.compute.manager [req-857265bd-e8ba-4d83-a7a8-10f1adacbc3a req-1ea646ee-80de-4f88-a09b-6bde8bedb8fd service nova] [instance: 4daa6370-2cdf-4668-b66b-e10196377c9c] Detach interface failed, port_id=4d30f22d-4337-41a7-965d-f9c172049b00, reason: Instance 4daa6370-2cdf-4668-b66b-e10196377c9c could not be found. {{(pid=74247) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 18:31:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-addc655e-f2a7-462c-983d-078d2e7523b0 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:31:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-addc655e-f2a7-462c-983d-078d2e7523b0 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:31:16 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Creating config drive at /opt/stack/data/nova/instances/7fa3da6f-ba9f-4752-901a-933427fcbda8/disk.config
Oct 16 18:31:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7fa3da6f-ba9f-4752-901a-933427fcbda8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpi3maxzqg {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7fa3da6f-ba9f-4752-901a-933427fcbda8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpi3maxzqg" returned: 0 in 0.061s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:16 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-addc655e-f2a7-462c-983d-078d2e7523b0 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:31:16 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-addc655e-f2a7-462c-983d-078d2e7523b0 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:31:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-addc655e-f2a7-462c-983d-078d2e7523b0 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.612s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:31:16 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-addc655e-f2a7-462c-983d-078d2e7523b0 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Deleted allocations for instance 4daa6370-2cdf-4668-b66b-e10196377c9c
Oct 16 18:31:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-addc655e-f2a7-462c-983d-078d2e7523b0 tempest-VolumesAdminNegativeTest-1972822081 tempest-VolumesAdminNegativeTest-1972822081-project-member] Lock "4daa6370-2cdf-4668-b66b-e10196377c9c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.502s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:31:17 user nova-compute[74247]: DEBUG nova.compute.manager [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:31:17 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: a686ee86-272c-47be-8801-9c1500af272f] Instance running successfully.
Oct 16 18:31:17 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] finish_revert_migration finished successfully. {{(pid=74247) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Oct 16 18:31:17 user nova-compute[74247]: INFO nova.compute.manager [None req-80f0bd67-8844-4385-9370-c9bd0597ee05 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Updating instance to original state: 'active'
Oct 16 18:31:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:18 user nova-compute[74247]: DEBUG nova.compute.manager [req-7ed94c68-7e10-48f6-80b3-f4a7115ede87 req-a720edf1-c217-4a52-b6c4-6098ef46a99f service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-vif-plugged-a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:31:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7ed94c68-7e10-48f6-80b3-f4a7115ede87 req-a720edf1-c217-4a52-b6c4-6098ef46a99f service nova] Acquiring lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:31:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7ed94c68-7e10-48f6-80b3-f4a7115ede87 req-a720edf1-c217-4a52-b6c4-6098ef46a99f service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:31:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7ed94c68-7e10-48f6-80b3-f4a7115ede87 req-a720edf1-c217-4a52-b6c4-6098ef46a99f service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:31:18 user nova-compute[74247]: DEBUG nova.compute.manager [req-7ed94c68-7e10-48f6-80b3-f4a7115ede87 req-a720edf1-c217-4a52-b6c4-6098ef46a99f service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] No waiting events found dispatching network-vif-plugged-a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:31:18 user nova-compute[74247]: WARNING nova.compute.manager [req-7ed94c68-7e10-48f6-80b3-f4a7115ede87 req-a720edf1-c217-4a52-b6c4-6098ef46a99f service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received unexpected event network-vif-plugged-a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11 for instance with vm_state building and task_state spawning.
Oct 16 18:31:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:18 user nova-compute[74247]: DEBUG nova.compute.manager [req-66232380-1aa9-43be-833b-0c684afde836 req-82a69bdc-b27d-4ca4-b24f-e21144370480 service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-vif-plugged-40eb3a07-e825-44ad-9077-c1880b1e8768 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:31:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-66232380-1aa9-43be-833b-0c684afde836 req-82a69bdc-b27d-4ca4-b24f-e21144370480 service nova] Acquiring lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:31:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-66232380-1aa9-43be-833b-0c684afde836 req-82a69bdc-b27d-4ca4-b24f-e21144370480 service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:31:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-66232380-1aa9-43be-833b-0c684afde836 req-82a69bdc-b27d-4ca4-b24f-e21144370480 service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:31:18 user nova-compute[74247]: DEBUG nova.compute.manager [req-66232380-1aa9-43be-833b-0c684afde836 req-82a69bdc-b27d-4ca4-b24f-e21144370480 service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] No waiting events found dispatching network-vif-plugged-40eb3a07-e825-44ad-9077-c1880b1e8768 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:31:18 user nova-compute[74247]: WARNING nova.compute.manager [req-66232380-1aa9-43be-833b-0c684afde836 req-82a69bdc-b27d-4ca4-b24f-e21144370480 service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received unexpected event network-vif-plugged-40eb3a07-e825-44ad-9077-c1880b1e8768 for instance with vm_state building and task_state spawning.
Oct 16 18:31:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:20 user nova-compute[74247]: DEBUG nova.compute.manager [req-c1dd1955-77cd-4ce2-882b-6e8bd00ef721 req-4c35db72-f0f4-4941-9f6d-7ab11d7aae0a service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-vif-plugged-40eb3a07-e825-44ad-9077-c1880b1e8768 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:31:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c1dd1955-77cd-4ce2-882b-6e8bd00ef721 req-4c35db72-f0f4-4941-9f6d-7ab11d7aae0a service nova] Acquiring lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:31:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c1dd1955-77cd-4ce2-882b-6e8bd00ef721 req-4c35db72-f0f4-4941-9f6d-7ab11d7aae0a service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:31:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c1dd1955-77cd-4ce2-882b-6e8bd00ef721 req-4c35db72-f0f4-4941-9f6d-7ab11d7aae0a service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:31:20 user nova-compute[74247]: DEBUG nova.compute.manager [req-c1dd1955-77cd-4ce2-882b-6e8bd00ef721 req-4c35db72-f0f4-4941-9f6d-7ab11d7aae0a service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] No waiting events found dispatching network-vif-plugged-40eb3a07-e825-44ad-9077-c1880b1e8768 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:31:20 user nova-compute[74247]: WARNING nova.compute.manager [req-c1dd1955-77cd-4ce2-882b-6e8bd00ef721 req-4c35db72-f0f4-4941-9f6d-7ab11d7aae0a service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received unexpected event network-vif-plugged-40eb3a07-e825-44ad-9077-c1880b1e8768 for instance with vm_state building and task_state spawning.
Oct 16 18:31:20 user nova-compute[74247]: DEBUG nova.compute.manager [req-c1dd1955-77cd-4ce2-882b-6e8bd00ef721 req-4c35db72-f0f4-4941-9f6d-7ab11d7aae0a service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-vif-plugged-2813ff58-0b02-4da1-8774-ad7452da7d78 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:31:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c1dd1955-77cd-4ce2-882b-6e8bd00ef721 req-4c35db72-f0f4-4941-9f6d-7ab11d7aae0a service nova] Acquiring lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:31:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c1dd1955-77cd-4ce2-882b-6e8bd00ef721 req-4c35db72-f0f4-4941-9f6d-7ab11d7aae0a service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:31:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c1dd1955-77cd-4ce2-882b-6e8bd00ef721 req-4c35db72-f0f4-4941-9f6d-7ab11d7aae0a service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:31:20 user nova-compute[74247]: DEBUG nova.compute.manager [req-c1dd1955-77cd-4ce2-882b-6e8bd00ef721 req-4c35db72-f0f4-4941-9f6d-7ab11d7aae0a service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] No waiting events found dispatching network-vif-plugged-2813ff58-0b02-4da1-8774-ad7452da7d78 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:31:20 user nova-compute[74247]: WARNING nova.compute.manager [req-c1dd1955-77cd-4ce2-882b-6e8bd00ef721 req-4c35db72-f0f4-4941-9f6d-7ab11d7aae0a service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received unexpected event network-vif-plugged-2813ff58-0b02-4da1-8774-ad7452da7d78 for instance with vm_state building and task_state spawning.
Oct 16 18:31:20 user nova-compute[74247]: DEBUG nova.compute.manager [req-c1dd1955-77cd-4ce2-882b-6e8bd00ef721 req-4c35db72-f0f4-4941-9f6d-7ab11d7aae0a service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-vif-plugged-2813ff58-0b02-4da1-8774-ad7452da7d78 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:31:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c1dd1955-77cd-4ce2-882b-6e8bd00ef721 req-4c35db72-f0f4-4941-9f6d-7ab11d7aae0a service nova] Acquiring lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:31:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c1dd1955-77cd-4ce2-882b-6e8bd00ef721 req-4c35db72-f0f4-4941-9f6d-7ab11d7aae0a service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:31:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c1dd1955-77cd-4ce2-882b-6e8bd00ef721 req-4c35db72-f0f4-4941-9f6d-7ab11d7aae0a service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:31:20 user nova-compute[74247]: DEBUG nova.compute.manager [req-c1dd1955-77cd-4ce2-882b-6e8bd00ef721 req-4c35db72-f0f4-4941-9f6d-7ab11d7aae0a service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] No waiting events found dispatching network-vif-plugged-2813ff58-0b02-4da1-8774-ad7452da7d78 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:31:20 user nova-compute[74247]: WARNING nova.compute.manager [req-c1dd1955-77cd-4ce2-882b-6e8bd00ef721 req-4c35db72-f0f4-4941-9f6d-7ab11d7aae0a service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received unexpected event network-vif-plugged-2813ff58-0b02-4da1-8774-ad7452da7d78 for instance with vm_state building and task_state spawning.
Oct 16 18:31:20 user nova-compute[74247]: DEBUG nova.compute.manager [req-c1dd1955-77cd-4ce2-882b-6e8bd00ef721 req-4c35db72-f0f4-4941-9f6d-7ab11d7aae0a service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-vif-plugged-a815917f-f1ec-48f2-b272-97bf2ad1d6cd {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:31:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c1dd1955-77cd-4ce2-882b-6e8bd00ef721 req-4c35db72-f0f4-4941-9f6d-7ab11d7aae0a service nova] Acquiring lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:31:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c1dd1955-77cd-4ce2-882b-6e8bd00ef721 req-4c35db72-f0f4-4941-9f6d-7ab11d7aae0a service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:31:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c1dd1955-77cd-4ce2-882b-6e8bd00ef721 req-4c35db72-f0f4-4941-9f6d-7ab11d7aae0a service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:31:20 user nova-compute[74247]: DEBUG nova.compute.manager [req-c1dd1955-77cd-4ce2-882b-6e8bd00ef721 req-4c35db72-f0f4-4941-9f6d-7ab11d7aae0a service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] No waiting events found dispatching network-vif-plugged-a815917f-f1ec-48f2-b272-97bf2ad1d6cd {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:31:20 user nova-compute[74247]: WARNING nova.compute.manager [req-c1dd1955-77cd-4ce2-882b-6e8bd00ef721 req-4c35db72-f0f4-4941-9f6d-7ab11d7aae0a service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received unexpected event network-vif-plugged-a815917f-f1ec-48f2-b272-97bf2ad1d6cd for instance with vm_state building and task_state spawning.
Oct 16 18:31:20 user nova-compute[74247]: DEBUG nova.compute.manager [req-c1dd1955-77cd-4ce2-882b-6e8bd00ef721 req-4c35db72-f0f4-4941-9f6d-7ab11d7aae0a service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-vif-plugged-a815917f-f1ec-48f2-b272-97bf2ad1d6cd {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:31:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c1dd1955-77cd-4ce2-882b-6e8bd00ef721 req-4c35db72-f0f4-4941-9f6d-7ab11d7aae0a service nova] Acquiring lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:31:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c1dd1955-77cd-4ce2-882b-6e8bd00ef721 req-4c35db72-f0f4-4941-9f6d-7ab11d7aae0a service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:31:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c1dd1955-77cd-4ce2-882b-6e8bd00ef721 req-4c35db72-f0f4-4941-9f6d-7ab11d7aae0a service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:31:20 user nova-compute[74247]: DEBUG nova.compute.manager [req-c1dd1955-77cd-4ce2-882b-6e8bd00ef721 req-4c35db72-f0f4-4941-9f6d-7ab11d7aae0a service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] No waiting events found dispatching network-vif-plugged-a815917f-f1ec-48f2-b272-97bf2ad1d6cd {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:31:20 user nova-compute[74247]: WARNING nova.compute.manager [req-c1dd1955-77cd-4ce2-882b-6e8bd00ef721 req-4c35db72-f0f4-4941-9f6d-7ab11d7aae0a service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received unexpected event network-vif-plugged-a815917f-f1ec-48f2-b272-97bf2ad1d6cd for instance with vm_state building and task_state spawning.
Oct 16 18:31:20 user nova-compute[74247]: DEBUG nova.compute.manager [req-7f29ffb0-93f5-40c1-8140-17bd7178f7a2 req-d37695bf-506e-4aa9-adb6-5b24b8326f60 service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-vif-plugged-a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:31:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7f29ffb0-93f5-40c1-8140-17bd7178f7a2 req-d37695bf-506e-4aa9-adb6-5b24b8326f60 service nova] Acquiring lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:31:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7f29ffb0-93f5-40c1-8140-17bd7178f7a2 req-d37695bf-506e-4aa9-adb6-5b24b8326f60 service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:31:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7f29ffb0-93f5-40c1-8140-17bd7178f7a2 req-d37695bf-506e-4aa9-adb6-5b24b8326f60 service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:31:20 user nova-compute[74247]: DEBUG nova.compute.manager [req-7f29ffb0-93f5-40c1-8140-17bd7178f7a2 req-d37695bf-506e-4aa9-adb6-5b24b8326f60 service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] No waiting events found dispatching network-vif-plugged-a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:31:20 user nova-compute[74247]: WARNING nova.compute.manager [req-7f29ffb0-93f5-40c1-8140-17bd7178f7a2 req-d37695bf-506e-4aa9-adb6-5b24b8326f60 service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received unexpected event network-vif-plugged-a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11 for instance with vm_state building and task_state spawning.
Oct 16 18:31:20 user nova-compute[74247]: DEBUG nova.compute.manager [req-7f29ffb0-93f5-40c1-8140-17bd7178f7a2 req-d37695bf-506e-4aa9-adb6-5b24b8326f60 service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-vif-plugged-1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:31:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7f29ffb0-93f5-40c1-8140-17bd7178f7a2 req-d37695bf-506e-4aa9-adb6-5b24b8326f60 service nova] Acquiring lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:31:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7f29ffb0-93f5-40c1-8140-17bd7178f7a2 req-d37695bf-506e-4aa9-adb6-5b24b8326f60 service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:31:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7f29ffb0-93f5-40c1-8140-17bd7178f7a2 req-d37695bf-506e-4aa9-adb6-5b24b8326f60 service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:31:20 user nova-compute[74247]: DEBUG nova.compute.manager [req-7f29ffb0-93f5-40c1-8140-17bd7178f7a2 req-d37695bf-506e-4aa9-adb6-5b24b8326f60 service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] No waiting events found dispatching network-vif-plugged-1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:31:20 user nova-compute[74247]: WARNING nova.compute.manager [req-7f29ffb0-93f5-40c1-8140-17bd7178f7a2 req-d37695bf-506e-4aa9-adb6-5b24b8326f60 service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received unexpected event network-vif-plugged-1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec for instance with vm_state building and task_state spawning.
Oct 16 18:31:20 user nova-compute[74247]: DEBUG nova.compute.manager [req-7f29ffb0-93f5-40c1-8140-17bd7178f7a2 req-d37695bf-506e-4aa9-adb6-5b24b8326f60 service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-vif-plugged-1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:31:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7f29ffb0-93f5-40c1-8140-17bd7178f7a2 req-d37695bf-506e-4aa9-adb6-5b24b8326f60 service nova] Acquiring lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:31:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7f29ffb0-93f5-40c1-8140-17bd7178f7a2 req-d37695bf-506e-4aa9-adb6-5b24b8326f60 service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:31:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7f29ffb0-93f5-40c1-8140-17bd7178f7a2 req-d37695bf-506e-4aa9-adb6-5b24b8326f60 service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:31:20 user nova-compute[74247]: DEBUG nova.compute.manager [req-7f29ffb0-93f5-40c1-8140-17bd7178f7a2 req-d37695bf-506e-4aa9-adb6-5b24b8326f60 service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] No waiting events found dispatching network-vif-plugged-1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:31:20 user nova-compute[74247]: WARNING nova.compute.manager [req-7f29ffb0-93f5-40c1-8140-17bd7178f7a2 req-d37695bf-506e-4aa9-adb6-5b24b8326f60 service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received unexpected event network-vif-plugged-1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec for instance with vm_state building and task_state spawning.
Oct 16 18:31:20 user nova-compute[74247]: DEBUG nova.compute.manager [req-7f29ffb0-93f5-40c1-8140-17bd7178f7a2 req-d37695bf-506e-4aa9-adb6-5b24b8326f60 service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-vif-plugged-2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:31:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7f29ffb0-93f5-40c1-8140-17bd7178f7a2 req-d37695bf-506e-4aa9-adb6-5b24b8326f60 service nova] Acquiring lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:31:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7f29ffb0-93f5-40c1-8140-17bd7178f7a2 req-d37695bf-506e-4aa9-adb6-5b24b8326f60 service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:31:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7f29ffb0-93f5-40c1-8140-17bd7178f7a2 req-d37695bf-506e-4aa9-adb6-5b24b8326f60 service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:31:20 user nova-compute[74247]: DEBUG nova.compute.manager [req-7f29ffb0-93f5-40c1-8140-17bd7178f7a2 req-d37695bf-506e-4aa9-adb6-5b24b8326f60 service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] No waiting events found dispatching network-vif-plugged-2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:31:20 user nova-compute[74247]: WARNING nova.compute.manager [req-7f29ffb0-93f5-40c1-8140-17bd7178f7a2 req-d37695bf-506e-4aa9-adb6-5b24b8326f60 service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received unexpected event network-vif-plugged-2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5 for instance with vm_state building and task_state spawning.
Oct 16 18:31:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:22 user nova-compute[74247]: DEBUG nova.compute.manager [req-76c4991c-9659-4217-82dc-f6d4d2d8192a req-27650f40-0896-4971-a016-bfe81dc628cf service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-vif-plugged-23684bac-dba0-4fdd-80d3-750ed2a77731 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:31:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-76c4991c-9659-4217-82dc-f6d4d2d8192a req-27650f40-0896-4971-a016-bfe81dc628cf service nova] Acquiring lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:31:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-76c4991c-9659-4217-82dc-f6d4d2d8192a req-27650f40-0896-4971-a016-bfe81dc628cf service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:31:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-76c4991c-9659-4217-82dc-f6d4d2d8192a req-27650f40-0896-4971-a016-bfe81dc628cf service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:31:22 user nova-compute[74247]: DEBUG nova.compute.manager [req-76c4991c-9659-4217-82dc-f6d4d2d8192a req-27650f40-0896-4971-a016-bfe81dc628cf service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] No waiting events found dispatching network-vif-plugged-23684bac-dba0-4fdd-80d3-750ed2a77731 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:31:22 user nova-compute[74247]: WARNING nova.compute.manager [req-76c4991c-9659-4217-82dc-f6d4d2d8192a req-27650f40-0896-4971-a016-bfe81dc628cf service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received unexpected event network-vif-plugged-23684bac-dba0-4fdd-80d3-750ed2a77731 for instance with vm_state building and task_state spawning.
Oct 16 18:31:22 user nova-compute[74247]: DEBUG nova.compute.manager [req-76c4991c-9659-4217-82dc-f6d4d2d8192a req-27650f40-0896-4971-a016-bfe81dc628cf service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-vif-plugged-23684bac-dba0-4fdd-80d3-750ed2a77731 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:31:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-76c4991c-9659-4217-82dc-f6d4d2d8192a req-27650f40-0896-4971-a016-bfe81dc628cf service nova] Acquiring lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:31:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-76c4991c-9659-4217-82dc-f6d4d2d8192a req-27650f40-0896-4971-a016-bfe81dc628cf service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:31:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-76c4991c-9659-4217-82dc-f6d4d2d8192a req-27650f40-0896-4971-a016-bfe81dc628cf service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:31:22 user nova-compute[74247]: DEBUG nova.compute.manager [req-76c4991c-9659-4217-82dc-f6d4d2d8192a req-27650f40-0896-4971-a016-bfe81dc628cf service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] No waiting events found dispatching network-vif-plugged-23684bac-dba0-4fdd-80d3-750ed2a77731 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:31:22 user nova-compute[74247]: WARNING nova.compute.manager [req-76c4991c-9659-4217-82dc-f6d4d2d8192a req-27650f40-0896-4971-a016-bfe81dc628cf service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received unexpected event network-vif-plugged-23684bac-dba0-4fdd-80d3-750ed2a77731 for instance with vm_state building and task_state spawning.
Oct 16 18:31:22 user nova-compute[74247]: DEBUG nova.compute.manager [req-17904a53-82b6-43ec-a443-a68604f8e326 req-acd6e786-2437-4743-b98b-c3573420a00a service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-vif-plugged-2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:31:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-17904a53-82b6-43ec-a443-a68604f8e326 req-acd6e786-2437-4743-b98b-c3573420a00a service nova] Acquiring lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:31:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-17904a53-82b6-43ec-a443-a68604f8e326 req-acd6e786-2437-4743-b98b-c3573420a00a service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:31:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-17904a53-82b6-43ec-a443-a68604f8e326 req-acd6e786-2437-4743-b98b-c3573420a00a service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:31:22 user nova-compute[74247]: DEBUG nova.compute.manager [req-17904a53-82b6-43ec-a443-a68604f8e326 req-acd6e786-2437-4743-b98b-c3573420a00a service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] No waiting events found dispatching network-vif-plugged-2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:31:22 user nova-compute[74247]: WARNING nova.compute.manager [req-17904a53-82b6-43ec-a443-a68604f8e326 req-acd6e786-2437-4743-b98b-c3573420a00a service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received unexpected event network-vif-plugged-2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5 for instance with vm_state building and task_state spawning.
Oct 16 18:31:22 user nova-compute[74247]: DEBUG nova.compute.manager [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:31:22 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:31:22 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Instance spawned successfully.
Oct 16 18:31:22 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 18:31:23 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:31:23 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:31:23 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:31:23 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:31:23 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:31:23 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:31:23 user nova-compute[74247]: INFO nova.compute.manager [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Took 14.11 seconds to spawn the instance on the hypervisor.
Oct 16 18:31:23 user nova-compute[74247]: DEBUG nova.compute.manager [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:31:23 user nova-compute[74247]: INFO nova.compute.manager [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Took 101.62 seconds to build instance.
Oct 16 18:31:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8a69197c-8ce2-4ff2-83c3-835ecb01ad9b tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 101.736s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:31:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 63.022s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:31:23 user nova-compute[74247]: INFO nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Oct 16 18:31:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:31:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Acquiring lock "7c17a25b-6818-48fa-b406-638dbf1845d4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:31:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lock "7c17a25b-6818-48fa-b406-638dbf1845d4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:31:38 user nova-compute[74247]: DEBUG nova.objects.instance [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lazy-loading 'flavor' on Instance uuid 7c17a25b-6818-48fa-b406-638dbf1845d4 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:31:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lock "7c17a25b-6818-48fa-b406-638dbf1845d4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.382s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:31:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Acquiring lock "7c17a25b-6818-48fa-b406-638dbf1845d4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:31:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lock "7c17a25b-6818-48fa-b406-638dbf1845d4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:31:39 user nova-compute[74247]: INFO nova.compute.manager [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Attaching volume 434ea0ef-34e5-4e31-aef0-3886568d333a to /dev/vdb
Oct 16 18:31:39 user nova-compute[74247]: DEBUG os_brick.utils [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:31:39 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:39 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:39 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09aa9fc-15cb-473b-9147-539efdc2688c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:39 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:39 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:39 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c50405c-cee4-49c6-aa44-7f72ab438658]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:39 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:39 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:39 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd84cd3c-6d4e-4b7d-86a8-5b8efbafb8fc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:39 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c469af5-25c8-4243-a4df-85d0401a0aec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:39 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:39 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:31:39 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 18:31:39 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:39 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:31:39 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 18:31:39 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af23783-f3a6-436d-8277-b65af39a8a20]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:39 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 18:31:39 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 18:31:39 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 18:31:39 user nova-compute[74247]: DEBUG os_brick.utils [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:31:39 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Updating existing volume attachment record: a06939c7-729c-44d0-af6b-cd61f0224dfd {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 18:31:40 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:40 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:45 user nova-compute[74247]: DEBUG nova.compute.manager [req-bf1ce862-cf67-4906-a8bc-fcbe5943477c req-af2f531a-8102-4c26-8a83-e23c5046e997 service nova] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Received event network-changed-423dc8c8-ef91-4b4c-a3f1-29f8769ae668 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:31:45 user nova-compute[74247]: DEBUG nova.compute.manager [req-bf1ce862-cf67-4906-a8bc-fcbe5943477c req-af2f531a-8102-4c26-8a83-e23c5046e997 service nova] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Refreshing instance network info cache due to event network-changed-423dc8c8-ef91-4b4c-a3f1-29f8769ae668. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:31:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-bf1ce862-cf67-4906-a8bc-fcbe5943477c req-af2f531a-8102-4c26-8a83-e23c5046e997 service nova] Acquiring lock "refresh_cache-d4c23a0a-d5cb-4893-9a40-4586e98a2535" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:31:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-bf1ce862-cf67-4906-a8bc-fcbe5943477c req-af2f531a-8102-4c26-8a83-e23c5046e997 service nova] Acquired lock "refresh_cache-d4c23a0a-d5cb-4893-9a40-4586e98a2535" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:31:45 user nova-compute[74247]: DEBUG nova.network.neutron [req-bf1ce862-cf67-4906-a8bc-fcbe5943477c req-af2f531a-8102-4c26-8a83-e23c5046e997 service nova] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Refreshing network info cache for port 423dc8c8-ef91-4b4c-a3f1-29f8769ae668 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:31:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:46 user nova-compute[74247]: DEBUG nova.network.neutron [req-bf1ce862-cf67-4906-a8bc-fcbe5943477c req-af2f531a-8102-4c26-8a83-e23c5046e997 service nova] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Updated VIF entry in instance network info cache for port 423dc8c8-ef91-4b4c-a3f1-29f8769ae668. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:31:46 user nova-compute[74247]: DEBUG nova.network.neutron [req-bf1ce862-cf67-4906-a8bc-fcbe5943477c req-af2f531a-8102-4c26-8a83-e23c5046e997 service nova] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Updating instance_info_cache with network_info: [{"id": "423dc8c8-ef91-4b4c-a3f1-29f8769ae668", "address": "fa:16:3e:f9:1d:bf", "network": {"id": "46ba27ba-e8dd-4c09-8b0e-1418f651dc21", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1347745998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85a018057c194fc497ad8476dd290a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap423dc8c8-ef", "ovs_interfaceid": "423dc8c8-ef91-4b4c-a3f1-29f8769ae668", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:31:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-bf1ce862-cf67-4906-a8bc-fcbe5943477c req-af2f531a-8102-4c26-8a83-e23c5046e997 service nova] Releasing lock "refresh_cache-d4c23a0a-d5cb-4893-9a40-4586e98a2535" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:31:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Acquiring lock "d4c23a0a-d5cb-4893-9a40-4586e98a2535" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:31:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Lock "d4c23a0a-d5cb-4893-9a40-4586e98a2535" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:31:51 user nova-compute[74247]: DEBUG nova.objects.instance [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Lazy-loading 'flavor' on Instance uuid d4c23a0a-d5cb-4893-9a40-4586e98a2535 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:31:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Lock "d4c23a0a-d5cb-4893-9a40-4586e98a2535" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:31:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Acquiring lock "d4c23a0a-d5cb-4893-9a40-4586e98a2535" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:31:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Lock "d4c23a0a-d5cb-4893-9a40-4586e98a2535" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:31:51 user nova-compute[74247]: INFO nova.compute.manager [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Attaching volume b0215602-b35c-47d3-a601-694f0203a6c5 to /dev/sdc
Oct 16 18:31:51 user nova-compute[74247]: DEBUG os_brick.utils [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:31:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:52 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[516078b9-59f5-41d8-91d4-6c6b75fb5f42]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:52 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fed8d14-08ec-43e5-89af-eef7b4092ea0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:52 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33d3d04-e8c5-48bc-a2bc-90884d3f4660]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:52 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadb051e-4606-43a3-89e9-694f35a60b60]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:31:52 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 18:31:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:31:52 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 18:31:52 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4101d030-177f-444c-94af-e6845b232ea8]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:52 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 18:31:52 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 18:31:52 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 18:31:52 user nova-compute[74247]: DEBUG os_brick.utils [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:31:52 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Updating existing volume attachment record: 461efb65-f8fb-4b94-8893-989d55e7ecc3 {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 18:31:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tNSdcMQl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:31:58 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:31:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:31:58 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:31:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:31:58 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:31:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6cfc14-47de-4e8a-9151-2dad3c8a280b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 18:31:58 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d2e23f-b0c1-4579-a9f2-f642f142cf45]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a] added
Oct 16 18:31:58 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ade7278-86c9-4c31-bd86-358ac1db50bd]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[649c0d6a-65b3-4e4a-b2be-c6b85afa9731]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tNSdcMQl {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tNSdcMQl" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fd86b5-002c-4eb2-ac19-29c73da5de35]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tNSdcMQl'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c95c89e-7004-41a4-9e72-fe2f69666120]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ce0989-a65a-44aa-93fd-d77a0434d057]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:31:58 user nova-compute[74247]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)
Oct 16 18:31:58 user nova-compute[74247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:31:58 user nova-compute[74247]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a (non-flash)
Oct 16 18:31:58 user nova-compute[74247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 (non-flash)
Oct 16 18:31:58 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:31:58 user nova-compute[74247]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)
Oct 16 18:31:58 user nova-compute[74247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:31:58 user nova-compute[74247]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a (non-flash)
Oct 16 18:31:58 user nova-compute[74247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 (non-flash)
Oct 16 18:31:58 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[84233122-9351-4468-8e8d-1f300443de0b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a, portal: 172.16.0.220,3260]
Oct 16 18:31:58 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a, portal: 172.16.0.220,3260] successful.
Oct 16 18:31:58 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc6bc35-4110-48d1-abfe-479550a037e4]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd021365-14b2-4557-aa0f-f4f5828ac024]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:31:58 user nova-compute[74247]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)
Oct 16 18:31:58 user nova-compute[74247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:31:58 user nova-compute[74247]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a (non-flash)
Oct 16 18:31:58 user nova-compute[74247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 (non-flash)
Oct 16 18:31:58 user nova-compute[74247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a (non-flash)
Oct 16 18:31:58 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:31:58 user nova-compute[74247]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)
Oct 16 18:31:58 user nova-compute[74247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:31:58 user nova-compute[74247]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a (non-flash)
Oct 16 18:31:58 user nova-compute[74247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 (non-flash)
Oct 16 18:31:58 user nova-compute[74247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a (non-flash)
Oct 16 18:31:58 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] HCTL ('38', '-', '-', 0) found on session 20 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b815f0f-dc01-4cf0-ac6c-374ab9fe4424]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Searching for a device in session 20 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:31:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tNSdcMQl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:31:59 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:31:59 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:31:59 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 18:31:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "refresh_cache-a686ee86-272c-47be-8801-9c1500af272f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:31:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquired lock "refresh_cache-a686ee86-272c-47be-8801-9c1500af272f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:31:59 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: a686ee86-272c-47be-8801-9c1500af272f] Forcefully refreshing network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 18:31:59 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:31:59 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26135663462303461', 'path': '/dev/sdg'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:31:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135663462303461', 'path': '/dev/sdg'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:31:59 user nova-compute[74247]: DEBUG nova.objects.instance [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lazy-loading 'flavor' on Instance uuid 7c17a25b-6818-48fa-b406-638dbf1845d4 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:31:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 18:31:59 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:31:59 user nova-compute[74247]:   <source dev="/dev/sdg"/>
Oct 16 18:31:59 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:31:59 user nova-compute[74247]:   <serial>434ea0ef-34e5-4e31-aef0-3886568d333a</serial>
Oct 16 18:31:59 user nova-compute[74247]: </disk>
Oct 16 18:31:59 user nova-compute[74247]:  {{(pid=74247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 18:31:59 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: a686ee86-272c-47be-8801-9c1500af272f] Updating instance_info_cache with network_info: [{"id": "8cb168df-92d2-4ecc-946a-7d9075f75561", "address": "fa:16:3e:9d:bb:be", "network": {"id": "f12e9b98-2724-4b9c-a299-7286c163458c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1410604293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973c8310858e4e1dafbc2fa926995940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb168df-92", "ovs_interfaceid": "8cb168df-92d2-4ecc-946a-7d9075f75561", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:31:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Releasing lock "refresh_cache-a686ee86-272c-47be-8801-9c1500af272f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:31:59 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: a686ee86-272c-47be-8801-9c1500af272f] Updated the network info_cache for instance {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 18:31:59 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:31:59 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:31:59 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:31:59 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:31:59 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:32:00 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:32:00 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:32:00 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] No VIF found with MAC fa:16:3e:f9:f6:64, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:32:00 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:32:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-21ee7a4b-5209-4f69-aede-37b67c41e714 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lock "7c17a25b-6818-48fa-b406-638dbf1845d4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.778s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:32:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:01 user nova-compute[74247]: INFO nova.compute.manager [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Rescuing
Oct 16 18:32:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Acquiring lock "refresh_cache-7c17a25b-6818-48fa-b406-638dbf1845d4" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:32:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Acquired lock "refresh_cache-7c17a25b-6818-48fa-b406-638dbf1845d4" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:32:01 user nova-compute[74247]: DEBUG nova.network.neutron [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:32:01 user nova-compute[74247]: DEBUG nova.network.neutron [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Updating instance_info_cache with network_info: [{"id": "5f5253f2-6e79-44f0-a4aa-167f273e7c6a", "address": "fa:16:3e:f9:f6:64", "network": {"id": "b8a52a8d-7eca-40b7-b94b-820a4ab8687b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1308054402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "021c1d91069e4798af2caae2c29694ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5253f2-6e", "ovs_interfaceid": "5f5253f2-6e79-44f0-a4aa-167f273e7c6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:32:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Releasing lock "refresh_cache-7c17a25b-6818-48fa-b406-638dbf1845d4" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:32:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:02 user nova-compute[74247]: DEBUG nova.compute.manager [req-92fd3551-7b25-4423-b2ce-4d0dad299a03 req-4e783048-3980-4fa8-bdc7-5d9c31002984 service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Received event network-vif-unplugged-5f5253f2-6e79-44f0-a4aa-167f273e7c6a {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:32:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-92fd3551-7b25-4423-b2ce-4d0dad299a03 req-4e783048-3980-4fa8-bdc7-5d9c31002984 service nova] Acquiring lock "7c17a25b-6818-48fa-b406-638dbf1845d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:32:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-92fd3551-7b25-4423-b2ce-4d0dad299a03 req-4e783048-3980-4fa8-bdc7-5d9c31002984 service nova] Lock "7c17a25b-6818-48fa-b406-638dbf1845d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:32:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-92fd3551-7b25-4423-b2ce-4d0dad299a03 req-4e783048-3980-4fa8-bdc7-5d9c31002984 service nova] Lock "7c17a25b-6818-48fa-b406-638dbf1845d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:32:02 user nova-compute[74247]: DEBUG nova.compute.manager [req-92fd3551-7b25-4423-b2ce-4d0dad299a03 req-4e783048-3980-4fa8-bdc7-5d9c31002984 service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] No waiting events found dispatching network-vif-unplugged-5f5253f2-6e79-44f0-a4aa-167f273e7c6a {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:32:02 user nova-compute[74247]: WARNING nova.compute.manager [req-92fd3551-7b25-4423-b2ce-4d0dad299a03 req-4e783048-3980-4fa8-bdc7-5d9c31002984 service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Received unexpected event network-vif-unplugged-5f5253f2-6e79-44f0-a4aa-167f273e7c6a for instance with vm_state active and task_state rescuing.
Oct 16 18:32:02 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:02 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:32:02 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 18:32:02 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:32:02 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Instance destroyed successfully.
Oct 16 18:32:02 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Attempting a stable device rescue
Oct 16 18:32:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:32:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:32:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:32:02 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 18:32:02 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74247) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 16 18:32:02 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Instance directory exists: not creating {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 16 18:32:02 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Creating image(s)
Oct 16 18:32:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Acquiring lock "/opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:32:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lock "/opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:32:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lock "/opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:32:02 user nova-compute[74247]: DEBUG nova.objects.instance [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7c17a25b-6818-48fa-b406-638dbf1845d4 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:32:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Acquiring lock "3d545e1a8f373cd8cf1ca41ef642a6fe078779dd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:32:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lock "3d545e1a8f373cd8cf1ca41ef642a6fe078779dd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:32:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d545e1a8f373cd8cf1ca41ef642a6fe078779dd.part --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6367b6d-1bc2-4472-b0c4-07baec4a28b0/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d545e1a8f373cd8cf1ca41ef642a6fe078779dd.part --force-share --output=json" returned: 0 in 0.273s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:04 user nova-compute[74247]: DEBUG nova.virt.images [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] 91b8775b-67cb-4342-bafe-48bb32e54244 was qcow2, converting to raw {{(pid=74247) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 16 18:32:04 user nova-compute[74247]: DEBUG nova.privsep.utils [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74247) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 18:32:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3d545e1a8f373cd8cf1ca41ef642a6fe078779dd.part /opt/stack/data/nova/instances/_base/3d545e1a8f373cd8cf1ca41ef642a6fe078779dd.converted {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6367b6d-1bc2-4472-b0c4-07baec4a28b0/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6367b6d-1bc2-4472-b0c4-07baec4a28b0/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:04 user nova-compute[74247]: DEBUG nova.compute.manager [req-95b2cf75-e021-4fef-bd40-4a4234075c04 req-ab25a22e-5bb2-4f60-9188-ed5e9d66192e service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Received event network-vif-plugged-5f5253f2-6e79-44f0-a4aa-167f273e7c6a {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:32:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-95b2cf75-e021-4fef-bd40-4a4234075c04 req-ab25a22e-5bb2-4f60-9188-ed5e9d66192e service nova] Acquiring lock "7c17a25b-6818-48fa-b406-638dbf1845d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:32:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-95b2cf75-e021-4fef-bd40-4a4234075c04 req-ab25a22e-5bb2-4f60-9188-ed5e9d66192e service nova] Lock "7c17a25b-6818-48fa-b406-638dbf1845d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:32:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-95b2cf75-e021-4fef-bd40-4a4234075c04 req-ab25a22e-5bb2-4f60-9188-ed5e9d66192e service nova] Lock "7c17a25b-6818-48fa-b406-638dbf1845d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:32:04 user nova-compute[74247]: DEBUG nova.compute.manager [req-95b2cf75-e021-4fef-bd40-4a4234075c04 req-ab25a22e-5bb2-4f60-9188-ed5e9d66192e service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] No waiting events found dispatching network-vif-plugged-5f5253f2-6e79-44f0-a4aa-167f273e7c6a {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:32:04 user nova-compute[74247]: WARNING nova.compute.manager [req-95b2cf75-e021-4fef-bd40-4a4234075c04 req-ab25a22e-5bb2-4f60-9188-ed5e9d66192e service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Received unexpected event network-vif-plugged-5f5253f2-6e79-44f0-a4aa-167f273e7c6a for instance with vm_state active and task_state rescuing.
Oct 16 18:32:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6367b6d-1bc2-4472-b0c4-07baec4a28b0/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3d545e1a8f373cd8cf1ca41ef642a6fe078779dd.part /opt/stack/data/nova/instances/_base/3d545e1a8f373cd8cf1ca41ef642a6fe078779dd.converted" returned: 0 in 0.684s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d545e1a8f373cd8cf1ca41ef642a6fe078779dd.converted --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d545e1a8f373cd8cf1ca41ef642a6fe078779dd.converted --force-share --output=json" returned: 0 in 0.185s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lock "3d545e1a8f373cd8cf1ca41ef642a6fe078779dd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.349s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Acquiring lock "3d545e1a8f373cd8cf1ca41ef642a6fe078779dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lock "3d545e1a8f373cd8cf1ca41ef642a6fe078779dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d545e1a8f373cd8cf1ca41ef642a6fe078779dd --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d545e1a8f373cd8cf1ca41ef642a6fe078779dd --force-share --output=json" returned: 0 in 0.235s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3d545e1a8f373cd8cf1ca41ef642a6fe078779dd,backing_fmt=raw /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk.rescue {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3d545e1a8f373cd8cf1ca41ef642a6fe078779dd,backing_fmt=raw /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk.rescue" returned: 0 in 0.062s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lock "3d545e1a8f373cd8cf1ca41ef642a6fe078779dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.309s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG nova.objects.instance [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lazy-loading 'migration_context' on Instance uuid 7c17a25b-6818-48fa-b406-638dbf1845d4 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG nova.objects.base [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Object Instance<7c17a25b-6818-48fa-b406-638dbf1845d4> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Start _get_guest_xml network_info=[{"id": "5f5253f2-6e79-44f0-a4aa-167f273e7c6a", "address": "fa:16:3e:f9:f6:64", "network": {"id": "b8a52a8d-7eca-40b7-b94b-820a4ab8687b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1308054402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1308054402-network", "vif_mac": "fa:16:3e:f9:f6:64"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "021c1d91069e4798af2caae2c29694ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5253f2-6e", "ovs_interfaceid": "5f5253f2-6e79-44f0-a4aa-167f273e7c6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '91b8775b-67cb-4342-bafe-48bb32e54244', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': '83126bb1-29f5-42fe-8620-72ab0797f776'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tNSdcMQl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '7c17a25b-6818-48fa-b406-638dbf1845d4', 'attached_at': '', 'detached_at': '', 'volume_id': '434ea0ef-34e5-4e31-aef0-3886568d333a', 'serial': '434ea0ef-34e5-4e31-aef0-3886568d333a'}, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'a06939c7-729c-44d0-af6b-cd61f0224dfd', 'guest_format': None, 'volume_type': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG nova.objects.instance [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lazy-loading 'resources' on Instance uuid 7c17a25b-6818-48fa-b406-638dbf1845d4 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG nova.objects.base [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Object Instance<7c17a25b-6818-48fa-b406-638dbf1845d4> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG nova.objects.instance [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lazy-loading 'numa_topology' on Instance uuid 7c17a25b-6818-48fa-b406-638dbf1845d4 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG nova.objects.base [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Object Instance<7c17a25b-6818-48fa-b406-638dbf1845d4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:32:05 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:32:05 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:32:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG nova.objects.instance [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7c17a25b-6818-48fa-b406-638dbf1845d4 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG nova.objects.base [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Object Instance<7c17a25b-6818-48fa-b406-638dbf1845d4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tNSdcMQl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:32:05 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:32:05 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:32:05 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:32:05 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:32:05 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:32:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a -p 172.16.0.220:3260" returned: 0 in 0.026s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5fc033c-0afc-4984-9699-e10a9a255888]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = tNSdcMQl\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 16 18:32:05 user nova-compute[74247]: node.name = iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a
Oct 16 18:32:05 user nova-compute[74247]: node.tpgt = -1
Oct 16 18:32:05 user nova-compute[74247]: node.startup = automatic
Oct 16 18:32:05 user nova-compute[74247]: node.leading_login = No
Oct 16 18:32:05 user nova-compute[74247]: iface.iscsi_ifacename = default
Oct 16 18:32:05 user nova-compute[74247]: iface.net_ifacename = <empty>
Oct 16 18:32:05 user nova-compute[74247]: iface.ipaddress = <empty>
Oct 16 18:32:05 user nova-compute[74247]: iface.prefix_len = 0
Oct 16 18:32:05 user nova-compute[74247]: iface.hwaddress = <empty>
Oct 16 18:32:05 user nova-compute[74247]: iface.transport_name = tcp
Oct 16 18:32:05 user nova-compute[74247]: iface.initiatorname = <empty>
Oct 16 18:32:05 user nova-compute[74247]: iface.state = <empty>
Oct 16 18:32:05 user nova-compute[74247]: iface.vlan_id = 0
Oct 16 18:32:05 user nova-compute[74247]: iface.vlan_priority = 0
Oct 16 18:32:05 user nova-compute[74247]: iface.vlan_state = <empty>
Oct 16 18:32:05 user nova-compute[74247]: iface.iface_num = 0
Oct 16 18:32:05 user nova-compute[74247]: iface.mtu = 0
Oct 16 18:32:05 user nova-compute[74247]: iface.port = 0
Oct 16 18:32:05 user nova-compute[74247]: iface.bootproto = <empty>
Oct 16 18:32:05 user nova-compute[74247]: iface.subnet_mask = <empty>
Oct 16 18:32:05 user nova-compute[74247]: iface.gateway = <empty>
Oct 16 18:32:05 user nova-compute[74247]: iface.dhcp_alt_client_id_state = <empty>
Oct 16 18:32:05 user nova-compute[74247]: iface.dhcp_alt_client_id = <empty>
Oct 16 18:32:05 user nova-compute[74247]: iface.dhcp_dns = <empty>
Oct 16 18:32:05 user nova-compute[74247]: iface.dhcp_learn_iqn = <empty>
Oct 16 18:32:05 user nova-compute[74247]: iface.dhcp_req_vendor_id_state = <empty>
Oct 16 18:32:05 user nova-compute[74247]: iface.dhcp_vendor_id_state = <empty>
Oct 16 18:32:05 user nova-compute[74247]: iface.dhcp_vendor_id = <empty>
Oct 16 18:32:05 user nova-compute[74247]: iface.dhcp_slp_da = <empty>
Oct 16 18:32:05 user nova-compute[74247]: iface.fragmentation = <empty>
Oct 16 18:32:05 user nova-compute[74247]: iface.gratuitous_arp = <empty>
Oct 16 18:32:05 user nova-compute[74247]: iface.incoming_forwarding = <empty>
Oct 16 18:32:05 user nova-compute[74247]: iface.tos_state = <empty>
Oct 16 18:32:05 user nova-compute[74247]: iface.tos = 0
Oct 16 18:32:05 user nova-compute[74247]: iface.ttl = 0
Oct 16 18:32:05 user nova-compute[74247]: iface.delayed_ack = <empty>
Oct 16 18:32:05 user nova-compute[74247]: iface.tcp_nagle = <empty>
Oct 16 18:32:05 user nova-compute[74247]: iface.tcp_wsf_state = <empty>
Oct 16 18:32:05 user nova-compute[74247]: iface.tcp_wsf = 0
Oct 16 18:32:05 user nova-compute[74247]: iface.tcp_timer_scale = 0
Oct 16 18:32:05 user nova-compute[74247]: iface.tcp_timestamp = <empty>
Oct 16 18:32:05 user nova-compute[74247]: iface.redirect = <empty>
Oct 16 18:32:05 user nova-compute[74247]: iface.def_task_mgmt_timeout = 0
Oct 16 18:32:05 user nova-compute[74247]: iface.header_digest = <empty>
Oct 16 18:32:05 user nova-compute[74247]: iface.data_digest = <empty>
Oct 16 18:32:05 user nova-compute[74247]: iface.immediate_data = <empty>
Oct 16 18:32:05 user nova-compute[74247]: iface.initial_r2t = <empty>
Oct 16 18:32:05 user nova-compute[74247]: iface.data_seq_inorder = <empty>
Oct 16 18:32:05 user nova-compute[74247]: iface.data_pdu_inorder = <empty>
Oct 16 18:32:05 user nova-compute[74247]: iface.erl = 0
Oct 16 18:32:05 user nova-compute[74247]: iface.max_receive_data_len = 0
Oct 16 18:32:05 user nova-compute[74247]: iface.first_burst_len = 0
Oct 16 18:32:05 user nova-compute[74247]: iface.max_outstanding_r2t = 0
Oct 16 18:32:05 user nova-compute[74247]: iface.max_burst_len = 0
Oct 16 18:32:05 user nova-compute[74247]: iface.chap_auth = <empty>
Oct 16 18:32:05 user nova-compute[74247]: iface.bidi_chap = <empty>
Oct 16 18:32:05 user nova-compute[74247]: iface.strict_login_compliance = <empty>
Oct 16 18:32:05 user nova-compute[74247]: iface.discovery_auth = <empty>
Oct 16 18:32:05 user nova-compute[74247]: iface.discovery_logout = <empty>
Oct 16 18:32:05 user nova-compute[74247]: node.discovery_address = <empty>
Oct 16 18:32:05 user nova-compute[74247]: node.discovery_port = 0
Oct 16 18:32:05 user nova-compute[74247]: node.discovery_type = static
Oct 16 18:32:05 user nova-compute[74247]: node.session.initial_cmdsn = 0
Oct 16 18:32:05 user nova-compute[74247]: node.session.initial_login_retry_max = 8
Oct 16 18:32:05 user nova-compute[74247]: node.session.xmit_thread_priority = -20
Oct 16 18:32:05 user nova-compute[74247]: node.session.cmds_max = 128
Oct 16 18:32:05 user nova-compute[74247]: node.session.queue_depth = 32
Oct 16 18:32:05 user nova-compute[74247]: node.session.nr_sessions = 1
Oct 16 18:32:05 user nova-compute[74247]: node.session.auth.authmethod = CHAP
Oct 16 18:32:05 user nova-compute[74247]: node.session.auth.username = tNSdcMQl
Oct 16 18:32:05 user nova-compute[74247]: node.session.auth.password = ***
Oct 16 18:32:05 user nova-compute[74247]: node.session.auth.username_in = <empty>
Oct 16 18:32:05 user nova-compute[74247]: node.session.auth.password_in = <empty>
Oct 16 18:32:05 user nova-compute[74247]: node.session.auth.chap_algs = MD5
Oct 16 18:32:05 user nova-compute[74247]: node.session.timeo.replacement_timeout = 120
Oct 16 18:32:05 user nova-compute[74247]: node.session.err_timeo.abort_timeout = 15
Oct 16 18:32:05 user nova-compute[74247]: node.session.err_timeo.lu_reset_timeout = 30
Oct 16 18:32:05 user nova-compute[74247]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 16 18:32:05 user nova-compute[74247]: node.session.err_timeo.host_reset_timeout = 60
Oct 16 18:32:05 user nova-compute[74247]: node.session.iscsi.FastAbort = Yes
Oct 16 18:32:05 user nova-compute[74247]: node.session.iscsi.InitialR2T = No
Oct 16 18:32:05 user nova-compute[74247]: node.session.iscsi.ImmediateData = Yes
Oct 16 18:32:05 user nova-compute[74247]: node.session.iscsi.FirstBurstLength = 262144
Oct 16 18:32:05 user nova-compute[74247]: node.session.iscsi.MaxBurstLength = 16776192
Oct 16 18:32:05 user nova-compute[74247]: node.session.iscsi.DefaultTime2Retain = 0
Oct 16 18:32:05 user nova-compute[74247]: node.session.iscsi.DefaultTime2Wait = 2
Oct 16 18:32:05 user nova-compute[74247]: node.session.iscsi.MaxConnections = 1
Oct 16 18:32:05 user nova-compute[74247]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 16 18:32:05 user nova-compute[74247]: node.session.iscsi.ERL = 0
Oct 16 18:32:05 user nova-compute[74247]: node.session.scan = manual
Oct 16 18:32:05 user nova-compute[74247]: node.session.reopen_max = 0
Oct 16 18:32:05 user nova-compute[74247]: node.conn[0].address = 172.16.0.220
Oct 16 18:32:05 user nova-compute[74247]: node.conn[0].port = 3260
Oct 16 18:32:05 user nova-compute[74247]: node.conn[0].startup = manual
Oct 16 18:32:05 user nova-compute[74247]: node.conn[0].tcp.window_size = 524288
Oct 16 18:32:05 user nova-compute[74247]: node.conn[0].tcp.type_of_service = 0
Oct 16 18:32:05 user nova-compute[74247]: node.conn[0].timeo.logout_timeout = 15
Oct 16 18:32:05 user nova-compute[74247]: node.conn[0].timeo.login_timeout = 15
Oct 16 18:32:05 user nova-compute[74247]: node.conn[0].timeo.auth_timeout = 45
Oct 16 18:32:05 user nova-compute[74247]: node.conn[0].timeo.noop_out_interval = 5
Oct 16 18:32:05 user nova-compute[74247]: node.conn[0].timeo.noop_out_timeout = 5
Oct 16 18:32:05 user nova-compute[74247]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 16 18:32:05 user nova-compute[74247]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 16 18:32:05 user nova-compute[74247]: node.conn[0].iscsi.HeaderDigest = None
Oct 16 18:32:05 user nova-compute[74247]: node.conn[0].iscsi.DataDigest = None
Oct 16 18:32:05 user nova-compute[74247]: node.conn[0].iscsi.IFMarker = No
Oct 16 18:32:05 user nova-compute[74247]: node.conn[0].iscsi.OFMarker = No
Oct 16 18:32:05 user nova-compute[74247]: # END RECORD
Oct 16 18:32:05 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbba9c7-3df5-4b13-9537-2b50b9e40122]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7758885b-123f-45fe-956b-64199b6d5d9a]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tNSdcMQl {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tNSdcMQl" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d57ece3-5090-4461-848b-03ef60a66873]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tNSdcMQl'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6b290e-19e0-4496-aff5-50d02606f989]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb959e7-1273-4c48-a454-d0272c36846a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:32:05 user nova-compute[74247]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)
Oct 16 18:32:05 user nova-compute[74247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:32:05 user nova-compute[74247]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a (non-flash)
Oct 16 18:32:05 user nova-compute[74247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 (non-flash)
Oct 16 18:32:05 user nova-compute[74247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a (non-flash)
Oct 16 18:32:05 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:32:05 user nova-compute[74247]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)
Oct 16 18:32:05 user nova-compute[74247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:32:05 user nova-compute[74247]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a (non-flash)
Oct 16 18:32:05 user nova-compute[74247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 (non-flash)
Oct 16 18:32:05 user nova-compute[74247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a (non-flash)
Oct 16 18:32:05 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.206s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] HCTL ('38', '0', '0', 0) found on session 20 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Scanning host 38 c: 0, t: 0, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c9a7f1-b161-46e6-956e-87413dd43d4a]: (4, ('0 0 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Searching for a device in session 20 and hctl ('38', '0', '0', 0) yield: sdg {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tNSdcMQl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.234s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] <== connect_volume: return (236ms) {'type': 'block', 'scsi_wwn': '26135663462303461', 'path': '/dev/sdg'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135663462303461', 'path': '/dev/sdg'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:27:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2056095538',display_name='tempest-ServerStableDeviceRescueTest-server-2056095538',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2056095538',id=14,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNw4l9zlgXNO30XsKe4Vj/du/OZkqc9heI+vCPA/3reIdMuWdthuZZGAOiDNP07hjzSUKEhxbgz+Vel73d0eDePuZLQtInh8vruuIgwyafEohXs7W0XS/37cHW8FQVpNBg==',key_name='tempest-keypair-1094775864',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:28:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='021c1d91069e4798af2caae2c29694ba',ramdisk_id='',reservation_id='r-oa4qirax',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1208025923',owner_user_name='tempest-ServerStableDeviceRescueTest-1208025923-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:29:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7601cab932f74be396a6d8a59568dc9f',uuid=7c17a25b-6818-48fa-b406-638dbf1845d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f5253f2-6e79-44f0-a4aa-167f273e7c6a", "address": "fa:16:3e:f9:f6:64", "network": {"id": "b8a52a8d-7eca-40b7-b94b-820a4ab8687b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1308054402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1308054402-network", "vif_mac": "fa:16:3e:f9:f6:64"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "021c1d91069e4798af2caae2c29694ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5253f2-6e", "ovs_interfaceid": "5f5253f2-6e79-44f0-a4aa-167f273e7c6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Converting VIF {"id": "5f5253f2-6e79-44f0-a4aa-167f273e7c6a", "address": "fa:16:3e:f9:f6:64", "network": {"id": "b8a52a8d-7eca-40b7-b94b-820a4ab8687b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1308054402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1308054402-network", "vif_mac": "fa:16:3e:f9:f6:64"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "021c1d91069e4798af2caae2c29694ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5253f2-6e", "ovs_interfaceid": "5f5253f2-6e79-44f0-a4aa-167f273e7c6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:f6:64,bridge_name='br-int',has_traffic_filtering=True,id=5f5253f2-6e79-44f0-a4aa-167f273e7c6a,network=Network(b8a52a8d-7eca-40b7-b94b-820a4ab8687b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5253f2-6e') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG nova.objects.instance [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c17a25b-6818-48fa-b406-638dbf1845d4 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG nova.objects.base [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Object Instance<7c17a25b-6818-48fa-b406-638dbf1845d4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:32:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:32:05 user nova-compute[74247]:   <uuid>7c17a25b-6818-48fa-b406-638dbf1845d4</uuid>
Oct 16 18:32:05 user nova-compute[74247]:   <name>instance-0000000e</name>
Oct 16 18:32:05 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:32:05 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:32:05 user nova-compute[74247]:   <metadata>
Oct 16 18:32:05 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:32:05 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:32:05 user nova-compute[74247]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-2056095538</nova:name>
Oct 16 18:32:05 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:32:05</nova:creationTime>
Oct 16 18:32:05 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:32:05 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:32:05 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:32:05 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:32:05 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:32:05 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:32:05 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:32:05 user nova-compute[74247]:       <nova:owner>
Oct 16 18:32:05 user nova-compute[74247]:         <nova:user uuid="7601cab932f74be396a6d8a59568dc9f">tempest-ServerStableDeviceRescueTest-1208025923-project-member</nova:user>
Oct 16 18:32:05 user nova-compute[74247]:         <nova:project uuid="021c1d91069e4798af2caae2c29694ba">tempest-ServerStableDeviceRescueTest-1208025923</nova:project>
Oct 16 18:32:05 user nova-compute[74247]:       </nova:owner>
Oct 16 18:32:05 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:32:05 user nova-compute[74247]:       <nova:ports>
Oct 16 18:32:05 user nova-compute[74247]:         <nova:port uuid="5f5253f2-6e79-44f0-a4aa-167f273e7c6a">
Oct 16 18:32:05 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 16 18:32:05 user nova-compute[74247]:         </nova:port>
Oct 16 18:32:05 user nova-compute[74247]:       </nova:ports>
Oct 16 18:32:05 user nova-compute[74247]:     </nova:instance>
Oct 16 18:32:05 user nova-compute[74247]:   </metadata>
Oct 16 18:32:05 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:32:05 user nova-compute[74247]:     <system>
Oct 16 18:32:05 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:32:05 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:32:05 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:32:05 user nova-compute[74247]:       <entry name="serial">7c17a25b-6818-48fa-b406-638dbf1845d4</entry>
Oct 16 18:32:05 user nova-compute[74247]:       <entry name="uuid">7c17a25b-6818-48fa-b406-638dbf1845d4</entry>
Oct 16 18:32:05 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:32:05 user nova-compute[74247]:     </system>
Oct 16 18:32:05 user nova-compute[74247]:   </sysinfo>
Oct 16 18:32:05 user nova-compute[74247]:   <os>
Oct 16 18:32:05 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:32:05 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:32:05 user nova-compute[74247]:   </os>
Oct 16 18:32:05 user nova-compute[74247]:   <features>
Oct 16 18:32:05 user nova-compute[74247]:     <acpi/>
Oct 16 18:32:05 user nova-compute[74247]:     <apic/>
Oct 16 18:32:05 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:32:05 user nova-compute[74247]:   </features>
Oct 16 18:32:05 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:32:05 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:32:05 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:32:05 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:32:05 user nova-compute[74247]:   </clock>
Oct 16 18:32:05 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:32:05 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:32:05 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:32:05 user nova-compute[74247]:   </cpu>
Oct 16 18:32:05 user nova-compute[74247]:   <devices>
Oct 16 18:32:05 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:32:05 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:32:05 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk"/>
Oct 16 18:32:05 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:32:05 user nova-compute[74247]:     </disk>
Oct 16 18:32:05 user nova-compute[74247]:     <disk type="block" device="disk">
Oct 16 18:32:05 user nova-compute[74247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:32:05 user nova-compute[74247]:       <source dev="/dev/sdg"/>
Oct 16 18:32:05 user nova-compute[74247]:       <target dev="vdb" bus="virtio"/>
Oct 16 18:32:05 user nova-compute[74247]:       <serial>434ea0ef-34e5-4e31-aef0-3886568d333a</serial>
Oct 16 18:32:05 user nova-compute[74247]:     </disk>
Oct 16 18:32:05 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:32:05 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:32:05 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk.rescue"/>
Oct 16 18:32:05 user nova-compute[74247]:       <target dev="vdc" bus="virtio"/>
Oct 16 18:32:05 user nova-compute[74247]:       <boot order="1"/>
Oct 16 18:32:05 user nova-compute[74247]:     </disk>
Oct 16 18:32:05 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:32:05 user nova-compute[74247]:       <mac address="fa:16:3e:f9:f6:64"/>
Oct 16 18:32:05 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:32:05 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:32:05 user nova-compute[74247]:       <target dev="tap5f5253f2-6e"/>
Oct 16 18:32:05 user nova-compute[74247]:     </interface>
Oct 16 18:32:05 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:32:05 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/console.log" append="off"/>
Oct 16 18:32:05 user nova-compute[74247]:     </serial>
Oct 16 18:32:05 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:32:05 user nova-compute[74247]:     <video>
Oct 16 18:32:05 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:32:05 user nova-compute[74247]:     </video>
Oct 16 18:32:05 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:32:05 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:32:05 user nova-compute[74247]:     </rng>
Oct 16 18:32:05 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:32:05 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:32:05 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:32:05 user nova-compute[74247]:     </memballoon>
Oct 16 18:32:05 user nova-compute[74247]:   </devices>
Oct 16 18:32:05 user nova-compute[74247]: </domain>
Oct 16 18:32:05 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:32:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c23a0a-d5cb-4893-9a40-4586e98a2535/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:06 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Instance destroyed successfully.
Oct 16 18:32:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:32:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:32:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:32:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] No VIF found with MAC fa:16:3e:f9:f6:64, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:32:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c23a0a-d5cb-4893-9a40-4586e98a2535/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c23a0a-d5cb-4893-9a40-4586e98a2535/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c23a0a-d5cb-4893-9a40-4586e98a2535/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:32:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:07 user nova-compute[74247]: DEBUG nova.compute.manager [req-a0727e3d-756b-42b2-a6e9-a11a8cb1bb90 req-cec0a926-09f4-49af-a03b-7a4c8f2bab3b service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Received event network-vif-plugged-5f5253f2-6e79-44f0-a4aa-167f273e7c6a {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:32:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a0727e3d-756b-42b2-a6e9-a11a8cb1bb90 req-cec0a926-09f4-49af-a03b-7a4c8f2bab3b service nova] Acquiring lock "7c17a25b-6818-48fa-b406-638dbf1845d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:32:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a0727e3d-756b-42b2-a6e9-a11a8cb1bb90 req-cec0a926-09f4-49af-a03b-7a4c8f2bab3b service nova] Lock "7c17a25b-6818-48fa-b406-638dbf1845d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:32:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a0727e3d-756b-42b2-a6e9-a11a8cb1bb90 req-cec0a926-09f4-49af-a03b-7a4c8f2bab3b service nova] Lock "7c17a25b-6818-48fa-b406-638dbf1845d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:32:07 user nova-compute[74247]: DEBUG nova.compute.manager [req-a0727e3d-756b-42b2-a6e9-a11a8cb1bb90 req-cec0a926-09f4-49af-a03b-7a4c8f2bab3b service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] No waiting events found dispatching network-vif-plugged-5f5253f2-6e79-44f0-a4aa-167f273e7c6a {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:32:07 user nova-compute[74247]: WARNING nova.compute.manager [req-a0727e3d-756b-42b2-a6e9-a11a8cb1bb90 req-cec0a926-09f4-49af-a03b-7a4c8f2bab3b service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Received unexpected event network-vif-plugged-5f5253f2-6e79-44f0-a4aa-167f273e7c6a for instance with vm_state active and task_state rescuing.
Oct 16 18:32:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:08 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:32:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk.rescue --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk.rescue --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:09 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:32:09 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:32:09 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:32:10 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:10 user nova-compute[74247]: DEBUG nova.compute.manager [req-20139575-0278-4150-8f4b-132e901859e6 req-54ece8be-18c6-4bb2-a85d-bf6d24ecaaee service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Received event network-vif-plugged-5f5253f2-6e79-44f0-a4aa-167f273e7c6a {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:32:10 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-20139575-0278-4150-8f4b-132e901859e6 req-54ece8be-18c6-4bb2-a85d-bf6d24ecaaee service nova] Acquiring lock "7c17a25b-6818-48fa-b406-638dbf1845d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:32:10 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-20139575-0278-4150-8f4b-132e901859e6 req-54ece8be-18c6-4bb2-a85d-bf6d24ecaaee service nova] Lock "7c17a25b-6818-48fa-b406-638dbf1845d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:32:10 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-20139575-0278-4150-8f4b-132e901859e6 req-54ece8be-18c6-4bb2-a85d-bf6d24ecaaee service nova] Lock "7c17a25b-6818-48fa-b406-638dbf1845d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:32:10 user nova-compute[74247]: DEBUG nova.compute.manager [req-20139575-0278-4150-8f4b-132e901859e6 req-54ece8be-18c6-4bb2-a85d-bf6d24ecaaee service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] No waiting events found dispatching network-vif-plugged-5f5253f2-6e79-44f0-a4aa-167f273e7c6a {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:32:10 user nova-compute[74247]: WARNING nova.compute.manager [req-20139575-0278-4150-8f4b-132e901859e6 req-54ece8be-18c6-4bb2-a85d-bf6d24ecaaee service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Received unexpected event network-vif-plugged-5f5253f2-6e79-44f0-a4aa-167f273e7c6a for instance with vm_state active and task_state rescuing.
Oct 16 18:32:10 user nova-compute[74247]: DEBUG nova.compute.manager [None req-6c0d2ea6-4e33-46c5-a188-1ecc6897d45a tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:32:10 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:32:10 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:32:10 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=7453MB free_disk=25.22093963623047GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 18:32:10 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:32:10 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:32:10 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:10 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:32:10 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance e37fbc27-3404-479a-be08-4d590391cf30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:32:10 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance bbec99d1-82a3-4e4d-a3ae-17e00821bee1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:32:10 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 7c17a25b-6818-48fa-b406-638dbf1845d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:32:10 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance a686ee86-272c-47be-8801-9c1500af272f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:32:10 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 7fa3da6f-ba9f-4752-901a-933427fcbda8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:32:10 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance d4c23a0a-d5cb-4893-9a40-4586e98a2535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:32:10 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance cddf4842-1c25-4cc8-914e-af30849e4d6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:32:10 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance d6367b6d-1bc2-4472-b0c4-07baec4a28b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:32:10 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 18:32:10 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 18:32:11 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:32:11 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:32:11 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 18:32:11 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.615s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:32:11 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:32:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WPGgkqsK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:32:11 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:32:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:32:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:32:11 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:32:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:32:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:32:11 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:32:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5 -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a353a4d-1550-4e62-a2fc-5bbdd36b17f0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:32:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 18:32:11 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:32:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac930c0-9eb2-4369-82bd-06f1e80a1032]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:32:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5] added
Oct 16 18:32:11 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:32:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b1dbef-252a-413c-be08-9c95d69d4e89]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:32:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:32:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[65948850-f3f8-4a74-8801-9b3eeea252fb]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:32:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:32:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WPGgkqsK {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WPGgkqsK" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7dbb8d7-c375-4ff9-9fce-69d00ca865d4]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:32:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WPGgkqsK'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:32:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdc12a4-1d34-4285-9536-e90fb7d1f3e1]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:32:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:32:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e449456-ab5b-4e49-8f9e-97091de51992]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:32:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:32:11 user nova-compute[74247]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)
Oct 16 18:32:11 user nova-compute[74247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:32:11 user nova-compute[74247]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a (non-flash)
Oct 16 18:32:11 user nova-compute[74247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 (non-flash)
Oct 16 18:32:11 user nova-compute[74247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a (non-flash)
Oct 16 18:32:11 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:32:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:32:11 user nova-compute[74247]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)
Oct 16 18:32:11 user nova-compute[74247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:32:11 user nova-compute[74247]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a (non-flash)
Oct 16 18:32:11 user nova-compute[74247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 (non-flash)
Oct 16 18:32:11 user nova-compute[74247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a (non-flash)
Oct 16 18:32:11 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:32:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5 -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5 -p 172.16.0.220:3260 --login" returned: 0 in 0.106s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:12 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fe69b8-7ad4-46c3-94ab-572b50802ead]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:32:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5, portal: 172.16.0.220,3260]
Oct 16 18:32:12 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5, portal: 172.16.0.220,3260] successful.
Oct 16 18:32:12 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:32:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:12 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b776b97f-3ff1-44f4-a60b-3eeabe846c49]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:32:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:32:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:12 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f14bbec-7214-4c66-9ccf-2899374dfa9e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:32:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:32:12 user nova-compute[74247]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)
Oct 16 18:32:12 user nova-compute[74247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:32:12 user nova-compute[74247]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a (non-flash)
Oct 16 18:32:12 user nova-compute[74247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 (non-flash)
Oct 16 18:32:12 user nova-compute[74247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a (non-flash)
Oct 16 18:32:12 user nova-compute[74247]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5 (non-flash)
Oct 16 18:32:12 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:32:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:32:12 user nova-compute[74247]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)
Oct 16 18:32:12 user nova-compute[74247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:32:12 user nova-compute[74247]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a (non-flash)
Oct 16 18:32:12 user nova-compute[74247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 (non-flash)
Oct 16 18:32:12 user nova-compute[74247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a (non-flash)
Oct 16 18:32:12 user nova-compute[74247]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5 (non-flash)
Oct 16 18:32:12 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:32:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.401s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:32:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:32:12 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] HCTL ('39', '-', '-', 0) found on session 21 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:32:12 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:32:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.026s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:12 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e837b364-aa61-4f4e-8822-449782b2c252]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:32:12 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Searching for a device in session 21 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:32:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WPGgkqsK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:32:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.461s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:32:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] <== connect_volume: return (1463ms) {'type': 'block', 'scsi_wwn': '26531323834353130', 'path': '/dev/sdh'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:32:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531323834353130', 'path': '/dev/sdh'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:32:13 user nova-compute[74247]: DEBUG nova.objects.instance [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Lazy-loading 'flavor' on Instance uuid d4c23a0a-d5cb-4893-9a40-4586e98a2535 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:32:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 18:32:13 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:32:13 user nova-compute[74247]:   <source dev="/dev/sdh"/>
Oct 16 18:32:13 user nova-compute[74247]:   <target dev="sdc" bus="scsi"/>
Oct 16 18:32:13 user nova-compute[74247]:   <serial>b0215602-b35c-47d3-a601-694f0203a6c5</serial>
Oct 16 18:32:13 user nova-compute[74247]:   <address type="drive" controller="0" unit="2"/>
Oct 16 18:32:13 user nova-compute[74247]: </disk>
Oct 16 18:32:13 user nova-compute[74247]:  {{(pid=74247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 18:32:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] No BDM found with device name sda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:32:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:32:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:32:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] No VIF found with MAC fa:16:3e:f9:1d:bf, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:32:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0ebee367-823b-4bf7-921c-d7fc6771ba51 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Lock "d4c23a0a-d5cb-4893-9a40-4586e98a2535" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.062s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:32:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-25af5dd7-3582-4548-8aa0-2d45c7498d79 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Acquiring lock "d4c23a0a-d5cb-4893-9a40-4586e98a2535" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:32:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-25af5dd7-3582-4548-8aa0-2d45c7498d79 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Lock "d4c23a0a-d5cb-4893-9a40-4586e98a2535" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:32:15 user nova-compute[74247]: INFO nova.compute.manager [None req-25af5dd7-3582-4548-8aa0-2d45c7498d79 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Detaching volume b0215602-b35c-47d3-a601-694f0203a6c5
Oct 16 18:32:15 user nova-compute[74247]: INFO nova.virt.block_device [None req-25af5dd7-3582-4548-8aa0-2d45c7498d79 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Attempting to driver detach volume b0215602-b35c-47d3-a601-694f0203a6c5 from mountpoint /dev/sdc
Oct 16 18:32:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-25af5dd7-3582-4548-8aa0-2d45c7498d79 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Attempting to detach device sdc from instance d4c23a0a-d5cb-4893-9a40-4586e98a2535 from the persistent domain config. {{(pid=74247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 18:32:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-25af5dd7-3582-4548-8aa0-2d45c7498d79 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 18:32:15 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:32:15 user nova-compute[74247]:   <source dev="/dev/sdh"/>
Oct 16 18:32:15 user nova-compute[74247]:   <target dev="sdc" bus="scsi"/>
Oct 16 18:32:15 user nova-compute[74247]:   <serial>b0215602-b35c-47d3-a601-694f0203a6c5</serial>
Oct 16 18:32:15 user nova-compute[74247]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 16 18:32:15 user nova-compute[74247]: </disk>
Oct 16 18:32:15 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:32:15 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-25af5dd7-3582-4548-8aa0-2d45c7498d79 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Successfully detached device sdc from instance d4c23a0a-d5cb-4893-9a40-4586e98a2535 from the persistent domain config.
Oct 16 18:32:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-25af5dd7-3582-4548-8aa0-2d45c7498d79 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance d4c23a0a-d5cb-4893-9a40-4586e98a2535 from the live domain config. {{(pid=74247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 18:32:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-25af5dd7-3582-4548-8aa0-2d45c7498d79 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 18:32:15 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:32:15 user nova-compute[74247]:   <source dev="/dev/sdh"/>
Oct 16 18:32:15 user nova-compute[74247]:   <target dev="sdc" bus="scsi"/>
Oct 16 18:32:15 user nova-compute[74247]:   <serial>b0215602-b35c-47d3-a601-694f0203a6c5</serial>
Oct 16 18:32:15 user nova-compute[74247]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 16 18:32:15 user nova-compute[74247]: </disk>
Oct 16 18:32:15 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:32:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-25af5dd7-3582-4548-8aa0-2d45c7498d79 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance d4c23a0a-d5cb-4893-9a40-4586e98a2535 {{(pid=74247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 18:32:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquiring lock "958af87e-69d0-4da1-8fcf-90e0f275d62e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:32:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "958af87e-69d0-4da1-8fcf-90e0f275d62e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:32:24 user nova-compute[74247]: DEBUG nova.compute.manager [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 18:32:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:32:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:32:24 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:32:24 user nova-compute[74247]: INFO nova.compute.claims [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Claim successful on node user
Oct 16 18:32:24 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:32:24 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:32:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.503s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:32:24 user nova-compute[74247]: DEBUG nova.compute.manager [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 18:32:24 user nova-compute[74247]: DEBUG nova.compute.manager [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 18:32:24 user nova-compute[74247]: DEBUG nova.network.neutron [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 18:32:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquiring lock "d775101d-53a1-48c7-af24-91480be6af61" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:32:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "d775101d-53a1-48c7-af24-91480be6af61" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:32:25 user nova-compute[74247]: DEBUG nova.compute.manager [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 18:32:25 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 18:32:25 user nova-compute[74247]: DEBUG nova.compute.manager [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 18:32:25 user nova-compute[74247]: DEBUG nova.policy [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '51026968ba1f49eaa8e0cc27a81855db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16160dad45544c6e8d9758e883089822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 18:32:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:32:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:32:25 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:32:25 user nova-compute[74247]: INFO nova.compute.claims [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] Claim successful on node user
Oct 16 18:32:25 user nova-compute[74247]: DEBUG nova.compute.manager [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 18:32:25 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:32:25 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Creating image(s)
Oct 16 18:32:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquiring lock "/opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:32:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "/opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:32:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "/opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:32:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.190s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquiring lock "37399febbd18f60b85fd0f833558f6a3539ab231" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:32:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:32:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.194s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk 1073741824 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:25 user nova-compute[74247]: DEBUG nova.network.neutron [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Successfully created port: 4457ec1e-80ee-4038-9838-3af879097230 {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:32:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk 1073741824" returned: 0 in 0.051s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:32:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:25 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:32:25 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:32:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.646s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:32:25 user nova-compute[74247]: DEBUG nova.compute.manager [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 18:32:25 user nova-compute[74247]: DEBUG nova.compute.manager [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 18:32:25 user nova-compute[74247]: DEBUG nova.network.neutron [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 18:32:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.186s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:25 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Checking if we can resize image /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk. size=1073741824 {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 18:32:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:25 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 18:32:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:25 user nova-compute[74247]: DEBUG nova.compute.manager [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Cannot resize image /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk to a smaller size. {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Ensure instance console log exists: /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG nova.compute.manager [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:32:26 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] Creating image(s)
Oct 16 18:32:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquiring lock "/opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "/opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "/opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.018s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG nova.policy [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '51026968ba1f49eaa8e0cc27a81855db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16160dad45544c6e8d9758e883089822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG nova.network.neutron [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Successfully updated port: 4457ec1e-80ee-4038-9838-3af879097230 {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquiring lock "refresh_cache-958af87e-69d0-4da1-8fcf-90e0f275d62e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquired lock "refresh_cache-958af87e-69d0-4da1-8fcf-90e0f275d62e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG nova.network.neutron [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.228s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquiring lock "37399febbd18f60b85fd0f833558f6a3539ab231" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG nova.compute.manager [req-115e3113-e564-4bae-8b4c-1e6a4ac2caf0 req-c88d874e-251e-49b7-950a-fd4bb7e49a7d service nova] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Received event network-changed-4457ec1e-80ee-4038-9838-3af879097230 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG nova.compute.manager [req-115e3113-e564-4bae-8b4c-1e6a4ac2caf0 req-c88d874e-251e-49b7-950a-fd4bb7e49a7d service nova] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Refreshing instance network info cache due to event network-changed-4457ec1e-80ee-4038-9838-3af879097230. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-115e3113-e564-4bae-8b4c-1e6a4ac2caf0 req-c88d874e-251e-49b7-950a-fd4bb7e49a7d service nova] Acquiring lock "refresh_cache-958af87e-69d0-4da1-8fcf-90e0f275d62e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG nova.network.neutron [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.165s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk 1073741824 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk 1073741824" returned: 0 in 0.047s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG nova.network.neutron [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Updating instance_info_cache with network_info: [{"id": "4457ec1e-80ee-4038-9838-3af879097230", "address": "fa:16:3e:fb:7d:a8", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4457ec1e-80", "ovs_interfaceid": "4457ec1e-80ee-4038-9838-3af879097230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Releasing lock "refresh_cache-958af87e-69d0-4da1-8fcf-90e0f275d62e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG nova.compute.manager [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Instance network_info: |[{"id": "4457ec1e-80ee-4038-9838-3af879097230", "address": "fa:16:3e:fb:7d:a8", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4457ec1e-80", "ovs_interfaceid": "4457ec1e-80ee-4038-9838-3af879097230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-115e3113-e564-4bae-8b4c-1e6a4ac2caf0 req-c88d874e-251e-49b7-950a-fd4bb7e49a7d service nova] Acquired lock "refresh_cache-958af87e-69d0-4da1-8fcf-90e0f275d62e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG nova.network.neutron [req-115e3113-e564-4bae-8b4c-1e6a4ac2caf0 req-c88d874e-251e-49b7-950a-fd4bb7e49a7d service nova] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Refreshing network info cache for port 4457ec1e-80ee-4038-9838-3af879097230 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Start _get_guest_xml network_info=[{"id": "4457ec1e-80ee-4038-9838-3af879097230", "address": "fa:16:3e:fb:7d:a8", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4457ec1e-80", "ovs_interfaceid": "4457ec1e-80ee-4038-9838-3af879097230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': '83126bb1-29f5-42fe-8620-72ab0797f776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:32:26 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:32:26 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:32:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:32:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1308192945',display_name='tempest-ServerRescueNegativeTestJSON-server-1308192945',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1308192945',id=19,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16160dad45544c6e8d9758e883089822',ramdisk_id='',reservation_id='r-6ds0qsic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2007731322',owner_user_name='tempest-ServerRescueNegativeTestJSON-2007731322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:32:25Z,user_data=None,user_id='51026968ba1f49eaa8e0cc27a81855db',uuid=958af87e-69d0-4da1-8fcf-90e0f275d62e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4457ec1e-80ee-4038-9838-3af879097230", "address": "fa:16:3e:fb:7d:a8", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4457ec1e-80", "ovs_interfaceid": "4457ec1e-80ee-4038-9838-3af879097230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Converting VIF {"id": "4457ec1e-80ee-4038-9838-3af879097230", "address": "fa:16:3e:fb:7d:a8", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4457ec1e-80", "ovs_interfaceid": "4457ec1e-80ee-4038-9838-3af879097230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:7d:a8,bridge_name='br-int',has_traffic_filtering=True,id=4457ec1e-80ee-4038-9838-3af879097230,network=Network(57ee1ccc-d7df-4a86-9234-c3c5f447e051),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4457ec1e-80') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG nova.objects.instance [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lazy-loading 'pci_devices' on Instance uuid 958af87e-69d0-4da1-8fcf-90e0f275d62e {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.203s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk. size=1073741824 {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:32:26 user nova-compute[74247]:   <uuid>958af87e-69d0-4da1-8fcf-90e0f275d62e</uuid>
Oct 16 18:32:26 user nova-compute[74247]:   <name>instance-00000013</name>
Oct 16 18:32:26 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:32:26 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:32:26 user nova-compute[74247]:   <metadata>
Oct 16 18:32:26 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:32:26 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:32:26 user nova-compute[74247]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1308192945</nova:name>
Oct 16 18:32:26 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:32:26</nova:creationTime>
Oct 16 18:32:26 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:32:26 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:32:26 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:32:26 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:32:26 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:32:26 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:32:26 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:32:26 user nova-compute[74247]:       <nova:owner>
Oct 16 18:32:26 user nova-compute[74247]:         <nova:user uuid="51026968ba1f49eaa8e0cc27a81855db">tempest-ServerRescueNegativeTestJSON-2007731322-project-member</nova:user>
Oct 16 18:32:26 user nova-compute[74247]:         <nova:project uuid="16160dad45544c6e8d9758e883089822">tempest-ServerRescueNegativeTestJSON-2007731322</nova:project>
Oct 16 18:32:26 user nova-compute[74247]:       </nova:owner>
Oct 16 18:32:26 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:32:26 user nova-compute[74247]:       <nova:ports>
Oct 16 18:32:26 user nova-compute[74247]:         <nova:port uuid="4457ec1e-80ee-4038-9838-3af879097230">
Oct 16 18:32:26 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 16 18:32:26 user nova-compute[74247]:         </nova:port>
Oct 16 18:32:26 user nova-compute[74247]:       </nova:ports>
Oct 16 18:32:26 user nova-compute[74247]:     </nova:instance>
Oct 16 18:32:26 user nova-compute[74247]:   </metadata>
Oct 16 18:32:26 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:32:26 user nova-compute[74247]:     <system>
Oct 16 18:32:26 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:32:26 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:32:26 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:32:26 user nova-compute[74247]:       <entry name="serial">958af87e-69d0-4da1-8fcf-90e0f275d62e</entry>
Oct 16 18:32:26 user nova-compute[74247]:       <entry name="uuid">958af87e-69d0-4da1-8fcf-90e0f275d62e</entry>
Oct 16 18:32:26 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:32:26 user nova-compute[74247]:     </system>
Oct 16 18:32:26 user nova-compute[74247]:   </sysinfo>
Oct 16 18:32:26 user nova-compute[74247]:   <os>
Oct 16 18:32:26 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:32:26 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:32:26 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:32:26 user nova-compute[74247]:   </os>
Oct 16 18:32:26 user nova-compute[74247]:   <features>
Oct 16 18:32:26 user nova-compute[74247]:     <acpi/>
Oct 16 18:32:26 user nova-compute[74247]:     <apic/>
Oct 16 18:32:26 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:32:26 user nova-compute[74247]:   </features>
Oct 16 18:32:26 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:32:26 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:32:26 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:32:26 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:32:26 user nova-compute[74247]:   </clock>
Oct 16 18:32:26 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:32:26 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:32:26 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:32:26 user nova-compute[74247]:   </cpu>
Oct 16 18:32:26 user nova-compute[74247]:   <devices>
Oct 16 18:32:26 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:32:26 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:32:26 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk"/>
Oct 16 18:32:26 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:32:26 user nova-compute[74247]:     </disk>
Oct 16 18:32:26 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:32:26 user nova-compute[74247]:       <mac address="fa:16:3e:fb:7d:a8"/>
Oct 16 18:32:26 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:32:26 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:32:26 user nova-compute[74247]:       <target dev="tap4457ec1e-80"/>
Oct 16 18:32:26 user nova-compute[74247]:     </interface>
Oct 16 18:32:26 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:32:26 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/console.log" append="off"/>
Oct 16 18:32:26 user nova-compute[74247]:     </serial>
Oct 16 18:32:26 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:32:26 user nova-compute[74247]:     <video>
Oct 16 18:32:26 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:32:26 user nova-compute[74247]:     </video>
Oct 16 18:32:26 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:32:26 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:32:26 user nova-compute[74247]:     </rng>
Oct 16 18:32:26 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:32:26 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:32:26 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:32:26 user nova-compute[74247]:     </memballoon>
Oct 16 18:32:26 user nova-compute[74247]:   </devices>
Oct 16 18:32:26 user nova-compute[74247]: </domain>
Oct 16 18:32:26 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:32:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1308192945',display_name='tempest-ServerRescueNegativeTestJSON-server-1308192945',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1308192945',id=19,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16160dad45544c6e8d9758e883089822',ramdisk_id='',reservation_id='r-6ds0qsic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2007731322',owner_user_name='tempest-ServerRescueNegativeTestJSON-2007731322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:32:25Z,user_data=None,user_id='51026968ba1f49eaa8e0cc27a81855db',uuid=958af87e-69d0-4da1-8fcf-90e0f275d62e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4457ec1e-80ee-4038-9838-3af879097230", "address": "fa:16:3e:fb:7d:a8", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4457ec1e-80", "ovs_interfaceid": "4457ec1e-80ee-4038-9838-3af879097230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Converting VIF {"id": "4457ec1e-80ee-4038-9838-3af879097230", "address": "fa:16:3e:fb:7d:a8", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4457ec1e-80", "ovs_interfaceid": "4457ec1e-80ee-4038-9838-3af879097230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:7d:a8,bridge_name='br-int',has_traffic_filtering=True,id=4457ec1e-80ee-4038-9838-3af879097230,network=Network(57ee1ccc-d7df-4a86-9234-c3c5f447e051),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4457ec1e-80') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG os_vif [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:7d:a8,bridge_name='br-int',has_traffic_filtering=True,id=4457ec1e-80ee-4038-9838-3af879097230,network=Network(57ee1ccc-d7df-4a86-9234-c3c5f447e051),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4457ec1e-80') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG nova.network.neutron [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] Successfully created port: 646f5b58-acad-402e-bdf5-e5bd423c69e8 {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '339733e9-5cda-5031-96c6-8cd966f1a663', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4457ec1e-80, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4457ec1e-80, col_values=(('qos', UUID('44da4aed-4b87-4536-a8e0-d944974ab95e')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4457ec1e-80, col_values=(('external_ids', {'iface-id': '4457ec1e-80ee-4038-9838-3af879097230', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:7d:a8', 'vm-uuid': '958af87e-69d0-4da1-8fcf-90e0f275d62e'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:26 user nova-compute[74247]: INFO os_vif [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:7d:a8,bridge_name='br-int',has_traffic_filtering=True,id=4457ec1e-80ee-4038-9838-3af879097230,network=Network(57ee1ccc-d7df-4a86-9234-c3c5f447e051),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4457ec1e-80')
Oct 16 18:32:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] No VIF found with MAC fa:16:3e:fb:7d:a8, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Cannot resize image /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk to a smaller size. {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] Ensure instance console log exists: /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:32:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG nova.network.neutron [req-115e3113-e564-4bae-8b4c-1e6a4ac2caf0 req-c88d874e-251e-49b7-950a-fd4bb7e49a7d service nova] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Updated VIF entry in instance network info cache for port 4457ec1e-80ee-4038-9838-3af879097230. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG nova.network.neutron [req-115e3113-e564-4bae-8b4c-1e6a4ac2caf0 req-c88d874e-251e-49b7-950a-fd4bb7e49a7d service nova] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Updating instance_info_cache with network_info: [{"id": "4457ec1e-80ee-4038-9838-3af879097230", "address": "fa:16:3e:fb:7d:a8", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4457ec1e-80", "ovs_interfaceid": "4457ec1e-80ee-4038-9838-3af879097230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-115e3113-e564-4bae-8b4c-1e6a4ac2caf0 req-c88d874e-251e-49b7-950a-fd4bb7e49a7d service nova] Releasing lock "refresh_cache-958af87e-69d0-4da1-8fcf-90e0f275d62e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG nova.network.neutron [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] Successfully updated port: 646f5b58-acad-402e-bdf5-e5bd423c69e8 {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquiring lock "refresh_cache-d775101d-53a1-48c7-af24-91480be6af61" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquired lock "refresh_cache-d775101d-53a1-48c7-af24-91480be6af61" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG nova.network.neutron [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG nova.compute.manager [req-4e7f8658-f6ff-4500-90ab-8135c9fa0e67 req-8138414a-3c04-4ced-8a3e-ed2818b16730 service nova] [instance: d775101d-53a1-48c7-af24-91480be6af61] Received event network-changed-646f5b58-acad-402e-bdf5-e5bd423c69e8 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG nova.compute.manager [req-4e7f8658-f6ff-4500-90ab-8135c9fa0e67 req-8138414a-3c04-4ced-8a3e-ed2818b16730 service nova] [instance: d775101d-53a1-48c7-af24-91480be6af61] Refreshing instance network info cache due to event network-changed-646f5b58-acad-402e-bdf5-e5bd423c69e8. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4e7f8658-f6ff-4500-90ab-8135c9fa0e67 req-8138414a-3c04-4ced-8a3e-ed2818b16730 service nova] Acquiring lock "refresh_cache-d775101d-53a1-48c7-af24-91480be6af61" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG nova.network.neutron [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG nova.network.neutron [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] Updating instance_info_cache with network_info: [{"id": "646f5b58-acad-402e-bdf5-e5bd423c69e8", "address": "fa:16:3e:45:9e:7d", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap646f5b58-ac", "ovs_interfaceid": "646f5b58-acad-402e-bdf5-e5bd423c69e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Releasing lock "refresh_cache-d775101d-53a1-48c7-af24-91480be6af61" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG nova.compute.manager [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] Instance network_info: |[{"id": "646f5b58-acad-402e-bdf5-e5bd423c69e8", "address": "fa:16:3e:45:9e:7d", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap646f5b58-ac", "ovs_interfaceid": "646f5b58-acad-402e-bdf5-e5bd423c69e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4e7f8658-f6ff-4500-90ab-8135c9fa0e67 req-8138414a-3c04-4ced-8a3e-ed2818b16730 service nova] Acquired lock "refresh_cache-d775101d-53a1-48c7-af24-91480be6af61" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG nova.network.neutron [req-4e7f8658-f6ff-4500-90ab-8135c9fa0e67 req-8138414a-3c04-4ced-8a3e-ed2818b16730 service nova] [instance: d775101d-53a1-48c7-af24-91480be6af61] Refreshing network info cache for port 646f5b58-acad-402e-bdf5-e5bd423c69e8 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] Start _get_guest_xml network_info=[{"id": "646f5b58-acad-402e-bdf5-e5bd423c69e8", "address": "fa:16:3e:45:9e:7d", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap646f5b58-ac", "ovs_interfaceid": "646f5b58-acad-402e-bdf5-e5bd423c69e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': '83126bb1-29f5-42fe-8620-72ab0797f776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:32:27 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:32:27 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:32:27 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:32:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-456531951',display_name='tempest-ServerRescueNegativeTestJSON-server-456531951',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-456531951',id=20,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16160dad45544c6e8d9758e883089822',ramdisk_id='',reservation_id='r-p6ml07y9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2007731322',owner_user_name='tempest-ServerRescueNegativeTestJSON-2007731322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:32:26Z,user_data=None,user_id='51026968ba1f49eaa8e0cc27a81855db',uuid=d775101d-53a1-48c7-af24-91480be6af61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "646f5b58-acad-402e-bdf5-e5bd423c69e8", "address": "fa:16:3e:45:9e:7d", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap646f5b58-ac", "ovs_interfaceid": "646f5b58-acad-402e-bdf5-e5bd423c69e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Converting VIF {"id": "646f5b58-acad-402e-bdf5-e5bd423c69e8", "address": "fa:16:3e:45:9e:7d", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap646f5b58-ac", "ovs_interfaceid": "646f5b58-acad-402e-bdf5-e5bd423c69e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:9e:7d,bridge_name='br-int',has_traffic_filtering=True,id=646f5b58-acad-402e-bdf5-e5bd423c69e8,network=Network(57ee1ccc-d7df-4a86-9234-c3c5f447e051),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap646f5b58-ac') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG nova.objects.instance [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lazy-loading 'pci_devices' on Instance uuid d775101d-53a1-48c7-af24-91480be6af61 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:32:27 user nova-compute[74247]:   <uuid>d775101d-53a1-48c7-af24-91480be6af61</uuid>
Oct 16 18:32:27 user nova-compute[74247]:   <name>instance-00000014</name>
Oct 16 18:32:27 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:32:27 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:32:27 user nova-compute[74247]:   <metadata>
Oct 16 18:32:27 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:32:27 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:32:27 user nova-compute[74247]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-456531951</nova:name>
Oct 16 18:32:27 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:32:27</nova:creationTime>
Oct 16 18:32:27 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:32:27 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:32:27 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:32:27 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:32:27 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:32:27 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:32:27 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:32:27 user nova-compute[74247]:       <nova:owner>
Oct 16 18:32:27 user nova-compute[74247]:         <nova:user uuid="51026968ba1f49eaa8e0cc27a81855db">tempest-ServerRescueNegativeTestJSON-2007731322-project-member</nova:user>
Oct 16 18:32:27 user nova-compute[74247]:         <nova:project uuid="16160dad45544c6e8d9758e883089822">tempest-ServerRescueNegativeTestJSON-2007731322</nova:project>
Oct 16 18:32:27 user nova-compute[74247]:       </nova:owner>
Oct 16 18:32:27 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:32:27 user nova-compute[74247]:       <nova:ports>
Oct 16 18:32:27 user nova-compute[74247]:         <nova:port uuid="646f5b58-acad-402e-bdf5-e5bd423c69e8">
Oct 16 18:32:27 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 16 18:32:27 user nova-compute[74247]:         </nova:port>
Oct 16 18:32:27 user nova-compute[74247]:       </nova:ports>
Oct 16 18:32:27 user nova-compute[74247]:     </nova:instance>
Oct 16 18:32:27 user nova-compute[74247]:   </metadata>
Oct 16 18:32:27 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:32:27 user nova-compute[74247]:     <system>
Oct 16 18:32:27 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:32:27 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:32:27 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:32:27 user nova-compute[74247]:       <entry name="serial">d775101d-53a1-48c7-af24-91480be6af61</entry>
Oct 16 18:32:27 user nova-compute[74247]:       <entry name="uuid">d775101d-53a1-48c7-af24-91480be6af61</entry>
Oct 16 18:32:27 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:32:27 user nova-compute[74247]:     </system>
Oct 16 18:32:27 user nova-compute[74247]:   </sysinfo>
Oct 16 18:32:27 user nova-compute[74247]:   <os>
Oct 16 18:32:27 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:32:27 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:32:27 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:32:27 user nova-compute[74247]:   </os>
Oct 16 18:32:27 user nova-compute[74247]:   <features>
Oct 16 18:32:27 user nova-compute[74247]:     <acpi/>
Oct 16 18:32:27 user nova-compute[74247]:     <apic/>
Oct 16 18:32:27 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:32:27 user nova-compute[74247]:   </features>
Oct 16 18:32:27 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:32:27 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:32:27 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:32:27 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:32:27 user nova-compute[74247]:   </clock>
Oct 16 18:32:27 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:32:27 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:32:27 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:32:27 user nova-compute[74247]:   </cpu>
Oct 16 18:32:27 user nova-compute[74247]:   <devices>
Oct 16 18:32:27 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:32:27 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:32:27 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk"/>
Oct 16 18:32:27 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:32:27 user nova-compute[74247]:     </disk>
Oct 16 18:32:27 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:32:27 user nova-compute[74247]:       <mac address="fa:16:3e:45:9e:7d"/>
Oct 16 18:32:27 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:32:27 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:32:27 user nova-compute[74247]:       <target dev="tap646f5b58-ac"/>
Oct 16 18:32:27 user nova-compute[74247]:     </interface>
Oct 16 18:32:27 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:32:27 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/console.log" append="off"/>
Oct 16 18:32:27 user nova-compute[74247]:     </serial>
Oct 16 18:32:27 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:32:27 user nova-compute[74247]:     <video>
Oct 16 18:32:27 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:32:27 user nova-compute[74247]:     </video>
Oct 16 18:32:27 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:32:27 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:32:27 user nova-compute[74247]:     </rng>
Oct 16 18:32:27 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:32:27 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:32:27 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:32:27 user nova-compute[74247]:     </memballoon>
Oct 16 18:32:27 user nova-compute[74247]:   </devices>
Oct 16 18:32:27 user nova-compute[74247]: </domain>
Oct 16 18:32:27 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:32:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-456531951',display_name='tempest-ServerRescueNegativeTestJSON-server-456531951',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-456531951',id=20,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16160dad45544c6e8d9758e883089822',ramdisk_id='',reservation_id='r-p6ml07y9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2007731322',owner_user_name='tempest-ServerRescueNegativeTestJSON-2007731322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:32:26Z,user_data=None,user_id='51026968ba1f49eaa8e0cc27a81855db',uuid=d775101d-53a1-48c7-af24-91480be6af61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "646f5b58-acad-402e-bdf5-e5bd423c69e8", "address": "fa:16:3e:45:9e:7d", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap646f5b58-ac", "ovs_interfaceid": "646f5b58-acad-402e-bdf5-e5bd423c69e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Converting VIF {"id": "646f5b58-acad-402e-bdf5-e5bd423c69e8", "address": "fa:16:3e:45:9e:7d", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap646f5b58-ac", "ovs_interfaceid": "646f5b58-acad-402e-bdf5-e5bd423c69e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:9e:7d,bridge_name='br-int',has_traffic_filtering=True,id=646f5b58-acad-402e-bdf5-e5bd423c69e8,network=Network(57ee1ccc-d7df-4a86-9234-c3c5f447e051),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap646f5b58-ac') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG os_vif [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:9e:7d,bridge_name='br-int',has_traffic_filtering=True,id=646f5b58-acad-402e-bdf5-e5bd423c69e8,network=Network(57ee1ccc-d7df-4a86-9234-c3c5f447e051),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap646f5b58-ac') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2e3fb202-d38e-573d-b334-783d73f953e4', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap646f5b58-ac, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap646f5b58-ac, col_values=(('qos', UUID('f30f72a2-6c54-46fa-8eeb-c7b4cfedd5dc')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap646f5b58-ac, col_values=(('external_ids', {'iface-id': '646f5b58-acad-402e-bdf5-e5bd423c69e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:9e:7d', 'vm-uuid': 'd775101d-53a1-48c7-af24-91480be6af61'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:27 user nova-compute[74247]: INFO os_vif [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:9e:7d,bridge_name='br-int',has_traffic_filtering=True,id=646f5b58-acad-402e-bdf5-e5bd423c69e8,network=Network(57ee1ccc-d7df-4a86-9234-c3c5f447e051),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap646f5b58-ac')
Oct 16 18:32:27 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:32:27 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] No VIF found with MAC fa:16:3e:45:9e:7d, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:32:28 user nova-compute[74247]: DEBUG nova.network.neutron [req-4e7f8658-f6ff-4500-90ab-8135c9fa0e67 req-8138414a-3c04-4ced-8a3e-ed2818b16730 service nova] [instance: d775101d-53a1-48c7-af24-91480be6af61] Updated VIF entry in instance network info cache for port 646f5b58-acad-402e-bdf5-e5bd423c69e8. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:32:28 user nova-compute[74247]: DEBUG nova.network.neutron [req-4e7f8658-f6ff-4500-90ab-8135c9fa0e67 req-8138414a-3c04-4ced-8a3e-ed2818b16730 service nova] [instance: d775101d-53a1-48c7-af24-91480be6af61] Updating instance_info_cache with network_info: [{"id": "646f5b58-acad-402e-bdf5-e5bd423c69e8", "address": "fa:16:3e:45:9e:7d", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap646f5b58-ac", "ovs_interfaceid": "646f5b58-acad-402e-bdf5-e5bd423c69e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:32:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4e7f8658-f6ff-4500-90ab-8135c9fa0e67 req-8138414a-3c04-4ced-8a3e-ed2818b16730 service nova] Releasing lock "refresh_cache-d775101d-53a1-48c7-af24-91480be6af61" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:32:28 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:28 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:28 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:28 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:28 user nova-compute[74247]: DEBUG nova.compute.manager [req-9b7606d1-5880-41ca-8898-6d488b941912 req-05845348-026e-4d9d-99f3-4514c40d1423 service nova] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Received event network-vif-plugged-4457ec1e-80ee-4038-9838-3af879097230 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:32:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9b7606d1-5880-41ca-8898-6d488b941912 req-05845348-026e-4d9d-99f3-4514c40d1423 service nova] Acquiring lock "958af87e-69d0-4da1-8fcf-90e0f275d62e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:32:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9b7606d1-5880-41ca-8898-6d488b941912 req-05845348-026e-4d9d-99f3-4514c40d1423 service nova] Lock "958af87e-69d0-4da1-8fcf-90e0f275d62e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:32:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9b7606d1-5880-41ca-8898-6d488b941912 req-05845348-026e-4d9d-99f3-4514c40d1423 service nova] Lock "958af87e-69d0-4da1-8fcf-90e0f275d62e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:32:28 user nova-compute[74247]: DEBUG nova.compute.manager [req-9b7606d1-5880-41ca-8898-6d488b941912 req-05845348-026e-4d9d-99f3-4514c40d1423 service nova] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] No waiting events found dispatching network-vif-plugged-4457ec1e-80ee-4038-9838-3af879097230 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:32:28 user nova-compute[74247]: WARNING nova.compute.manager [req-9b7606d1-5880-41ca-8898-6d488b941912 req-05845348-026e-4d9d-99f3-4514c40d1423 service nova] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Received unexpected event network-vif-plugged-4457ec1e-80ee-4038-9838-3af879097230 for instance with vm_state building and task_state spawning.
Oct 16 18:32:28 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:28 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:28 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:28 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:28 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:29 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:29 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:29 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:29 user nova-compute[74247]: DEBUG nova.compute.manager [req-1868a51b-414e-45b9-94a1-ea7bd3b8c9a9 req-905f53ef-6359-419e-a83e-33f8ee839547 service nova] [instance: d775101d-53a1-48c7-af24-91480be6af61] Received event network-vif-plugged-646f5b58-acad-402e-bdf5-e5bd423c69e8 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:32:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1868a51b-414e-45b9-94a1-ea7bd3b8c9a9 req-905f53ef-6359-419e-a83e-33f8ee839547 service nova] Acquiring lock "d775101d-53a1-48c7-af24-91480be6af61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:32:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1868a51b-414e-45b9-94a1-ea7bd3b8c9a9 req-905f53ef-6359-419e-a83e-33f8ee839547 service nova] Lock "d775101d-53a1-48c7-af24-91480be6af61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:32:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1868a51b-414e-45b9-94a1-ea7bd3b8c9a9 req-905f53ef-6359-419e-a83e-33f8ee839547 service nova] Lock "d775101d-53a1-48c7-af24-91480be6af61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:32:29 user nova-compute[74247]: DEBUG nova.compute.manager [req-1868a51b-414e-45b9-94a1-ea7bd3b8c9a9 req-905f53ef-6359-419e-a83e-33f8ee839547 service nova] [instance: d775101d-53a1-48c7-af24-91480be6af61] No waiting events found dispatching network-vif-plugged-646f5b58-acad-402e-bdf5-e5bd423c69e8 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:32:29 user nova-compute[74247]: WARNING nova.compute.manager [req-1868a51b-414e-45b9-94a1-ea7bd3b8c9a9 req-905f53ef-6359-419e-a83e-33f8ee839547 service nova] [instance: d775101d-53a1-48c7-af24-91480be6af61] Received unexpected event network-vif-plugged-646f5b58-acad-402e-bdf5-e5bd423c69e8 for instance with vm_state building and task_state spawning.
Oct 16 18:32:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:30 user nova-compute[74247]: DEBUG nova.compute.manager [req-473fb82a-3fd4-4698-9b1b-000b5b8c5359 req-201af1b4-6bb3-45b9-96b9-11f723a6ab56 service nova] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Received event network-vif-plugged-4457ec1e-80ee-4038-9838-3af879097230 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:32:30 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-473fb82a-3fd4-4698-9b1b-000b5b8c5359 req-201af1b4-6bb3-45b9-96b9-11f723a6ab56 service nova] Acquiring lock "958af87e-69d0-4da1-8fcf-90e0f275d62e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:32:30 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-473fb82a-3fd4-4698-9b1b-000b5b8c5359 req-201af1b4-6bb3-45b9-96b9-11f723a6ab56 service nova] Lock "958af87e-69d0-4da1-8fcf-90e0f275d62e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:32:30 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-473fb82a-3fd4-4698-9b1b-000b5b8c5359 req-201af1b4-6bb3-45b9-96b9-11f723a6ab56 service nova] Lock "958af87e-69d0-4da1-8fcf-90e0f275d62e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:32:30 user nova-compute[74247]: DEBUG nova.compute.manager [req-473fb82a-3fd4-4698-9b1b-000b5b8c5359 req-201af1b4-6bb3-45b9-96b9-11f723a6ab56 service nova] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] No waiting events found dispatching network-vif-plugged-4457ec1e-80ee-4038-9838-3af879097230 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:32:30 user nova-compute[74247]: WARNING nova.compute.manager [req-473fb82a-3fd4-4698-9b1b-000b5b8c5359 req-201af1b4-6bb3-45b9-96b9-11f723a6ab56 service nova] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Received unexpected event network-vif-plugged-4457ec1e-80ee-4038-9838-3af879097230 for instance with vm_state building and task_state spawning.
Oct 16 18:32:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:31 user nova-compute[74247]: DEBUG nova.compute.manager [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:32:31 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:32:31 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Instance spawned successfully.
Oct 16 18:32:31 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 18:32:31 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:32:31 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:32:31 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:32:31 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:32:31 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:32:31 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:32:31 user nova-compute[74247]: INFO nova.compute.manager [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Took 6.33 seconds to spawn the instance on the hypervisor.
Oct 16 18:32:31 user nova-compute[74247]: DEBUG nova.compute.manager [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:32:31 user nova-compute[74247]: INFO nova.compute.manager [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Took 7.43 seconds to build instance.
Oct 16 18:32:31 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1ac420c6-f4e9-4e6c-b8a9-14a0d4fe86c0 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "958af87e-69d0-4da1-8fcf-90e0f275d62e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.531s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:32:32 user nova-compute[74247]: DEBUG nova.compute.manager [req-1a22ef74-de60-4328-8f90-375285047d62 req-97c5b650-14b9-4732-9b37-dd920f1d2da1 service nova] [instance: d775101d-53a1-48c7-af24-91480be6af61] Received event network-vif-plugged-646f5b58-acad-402e-bdf5-e5bd423c69e8 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:32:32 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1a22ef74-de60-4328-8f90-375285047d62 req-97c5b650-14b9-4732-9b37-dd920f1d2da1 service nova] Acquiring lock "d775101d-53a1-48c7-af24-91480be6af61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:32:32 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1a22ef74-de60-4328-8f90-375285047d62 req-97c5b650-14b9-4732-9b37-dd920f1d2da1 service nova] Lock "d775101d-53a1-48c7-af24-91480be6af61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:32:32 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1a22ef74-de60-4328-8f90-375285047d62 req-97c5b650-14b9-4732-9b37-dd920f1d2da1 service nova] Lock "d775101d-53a1-48c7-af24-91480be6af61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:32:32 user nova-compute[74247]: DEBUG nova.compute.manager [req-1a22ef74-de60-4328-8f90-375285047d62 req-97c5b650-14b9-4732-9b37-dd920f1d2da1 service nova] [instance: d775101d-53a1-48c7-af24-91480be6af61] No waiting events found dispatching network-vif-plugged-646f5b58-acad-402e-bdf5-e5bd423c69e8 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:32:32 user nova-compute[74247]: WARNING nova.compute.manager [req-1a22ef74-de60-4328-8f90-375285047d62 req-97c5b650-14b9-4732-9b37-dd920f1d2da1 service nova] [instance: d775101d-53a1-48c7-af24-91480be6af61] Received unexpected event network-vif-plugged-646f5b58-acad-402e-bdf5-e5bd423c69e8 for instance with vm_state building and task_state spawning.
Oct 16 18:32:32 user nova-compute[74247]: DEBUG nova.compute.manager [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:32:32 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:32:32 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: d775101d-53a1-48c7-af24-91480be6af61] Instance spawned successfully.
Oct 16 18:32:32 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 18:32:32 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:32:32 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:32:32 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:32:32 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:32:32 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:32:32 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:32:32 user nova-compute[74247]: INFO nova.compute.manager [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] Took 6.06 seconds to spawn the instance on the hypervisor.
Oct 16 18:32:32 user nova-compute[74247]: DEBUG nova.compute.manager [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:32:32 user nova-compute[74247]: INFO nova.compute.manager [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] Took 7.12 seconds to build instance.
Oct 16 18:32:32 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f6845b21-4ca9-44a7-b606-1fb1860fae37 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "d775101d-53a1-48c7-af24-91480be6af61" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.254s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:32:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:35 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-25af5dd7-3582-4548-8aa0-2d45c7498d79 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance d4c23a0a-d5cb-4893-9a40-4586e98a2535 is timed out.
Oct 16 18:32:35 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-25af5dd7-3582-4548-8aa0-2d45c7498d79 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Successfully detached device sdc from instance d4c23a0a-d5cb-4893-9a40-4586e98a2535 from the live domain config.
Oct 16 18:32:35 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25af5dd7-3582-4548-8aa0-2d45c7498d79 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 18:32:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-25af5dd7-3582-4548-8aa0-2d45c7498d79 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WPGgkqsK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:32:35 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-25af5dd7-3582-4548-8aa0-2d45c7498d79 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:32:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-25af5dd7-3582-4548-8aa0-2d45c7498d79 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:32:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-25af5dd7-3582-4548-8aa0-2d45c7498d79 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:32:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:35 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1af6f97-ba00-4424-ab24-4c9522775c07]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:32:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-25af5dd7-3582-4548-8aa0-2d45c7498d79 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 18:32:35 user nova-compute[74247]: No targets found.
Oct 16 18:32:35 user nova-compute[74247]: iSNS:
Oct 16 18:32:35 user nova-compute[74247]: No targets found.
Oct 16 18:32:35 user nova-compute[74247]: STATIC:
Oct 16 18:32:35 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5
Oct 16 18:32:35 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:32:35 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:32:35 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2
Oct 16 18:32:35 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:32:35 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:32:35 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6
Oct 16 18:32:35 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:32:35 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:32:35 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313
Oct 16 18:32:35 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:32:35 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:32:35 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a
Oct 16 18:32:35 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:32:35 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:32:35 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93
Oct 16 18:32:35 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:32:35 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:32:35 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a
Oct 16 18:32:35 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:32:35 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:32:35 user nova-compute[74247]: FIRMWARE:
Oct 16 18:32:35 user nova-compute[74247]: No targets found.
Oct 16 18:32:35 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:32:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-25af5dd7-3582-4548-8aa0-2d45c7498d79 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 18:32:35 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 18:32:35 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 18:32:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-25af5dd7-3582-4548-8aa0-2d45c7498d79 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 18:32:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:35 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[627712e1-f6d8-4315-a075-40e47192336a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:32:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:35 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb34813b-4148-463c-be13-68e2d0befc94]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:32:36 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-25af5dd7-3582-4548-8aa0-2d45c7498d79 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:32:36 user nova-compute[74247]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)
Oct 16 18:32:36 user nova-compute[74247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:32:36 user nova-compute[74247]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a (non-flash)
Oct 16 18:32:36 user nova-compute[74247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 (non-flash)
Oct 16 18:32:36 user nova-compute[74247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a (non-flash)
Oct 16 18:32:36 user nova-compute[74247]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5 (non-flash)
Oct 16 18:32:36 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:32:36 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-25af5dd7-3582-4548-8aa0-2d45c7498d79 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:32:36 user nova-compute[74247]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)
Oct 16 18:32:36 user nova-compute[74247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:32:36 user nova-compute[74247]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a (non-flash)
Oct 16 18:32:36 user nova-compute[74247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 (non-flash)
Oct 16 18:32:36 user nova-compute[74247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a (non-flash)
Oct 16 18:32:36 user nova-compute[74247]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5 (non-flash)
Oct 16 18:32:36 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:32:36 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-25af5dd7-3582-4548-8aa0-2d45c7498d79 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe048442290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5'): ({'sdh'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 18:32:36 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-25af5dd7-3582-4548-8aa0-2d45c7498d79 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Removing single pathed devices sdh {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 18:32:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:36 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[364364ef-e669-4163-be4b-bf5b6abbbf3c]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:32:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:36 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[51991e5b-a150-45a4-b157-d95f968a2cab]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:32:36 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-25af5dd7-3582-4548-8aa0-2d45c7498d79 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Flushing IO for device /dev/sdh {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 18:32:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:36 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8cb467e-bd78-4460-a53c-7e98c2a03d69]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:32:36 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-25af5dd7-3582-4548-8aa0-2d45c7498d79 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 18:32:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.045s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:36 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[816c9fd4-0058-4c32-a022-3a4aa28daf6c]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:32:36 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-25af5dd7-3582-4548-8aa0-2d45c7498d79 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 18:32:36 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-25af5dd7-3582-4548-8aa0-2d45c7498d79 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] SCSI volumes sdh have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 18:32:36 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-25af5dd7-3582-4548-8aa0-2d45c7498d79 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 18:32:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:36 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[21bd2909-f06e-4602-891c-eb9348fe39d2]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:32:36 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-25af5dd7-3582-4548-8aa0-2d45c7498d79 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:32:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5 -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:36 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e22a40-f67d-4ce3-ad81-82269febb6fd]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:32:36 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-25af5dd7-3582-4548-8aa0-2d45c7498d79 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5, portal: 172.16.0.220,3260]
Oct 16 18:32:36 user nova-compute[74247]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5, portal: 172.16.0.220,3260] successful.
Oct 16 18:32:36 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:32:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5 -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0215602-b35c-47d3-a601-694f0203a6c5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:36 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c994fd3-2364-4e46-840e-2a26cfcd3b02]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:32:36 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-25af5dd7-3582-4548-8aa0-2d45c7498d79 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:32:36 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-25af5dd7-3582-4548-8aa0-2d45c7498d79 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:32:36 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-25af5dd7-3582-4548-8aa0-2d45c7498d79 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] <== disconnect_volume: return (358ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:32:36 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25af5dd7-3582-4548-8aa0-2d45c7498d79 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 18:32:37 user nova-compute[74247]: DEBUG nova.objects.instance [None req-25af5dd7-3582-4548-8aa0-2d45c7498d79 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Lazy-loading 'flavor' on Instance uuid d4c23a0a-d5cb-4893-9a40-4586e98a2535 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:32:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-25af5dd7-3582-4548-8aa0-2d45c7498d79 tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Lock "d4c23a0a-d5cb-4893-9a40-4586e98a2535" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.910s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:32:37 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-034543d9-6c77-4286-8cfc-6d6634e311fa tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Acquiring lock "d4c23a0a-d5cb-4893-9a40-4586e98a2535" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:32:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-034543d9-6c77-4286-8cfc-6d6634e311fa tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Lock "d4c23a0a-d5cb-4893-9a40-4586e98a2535" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:32:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-034543d9-6c77-4286-8cfc-6d6634e311fa tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Acquiring lock "d4c23a0a-d5cb-4893-9a40-4586e98a2535-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:32:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-034543d9-6c77-4286-8cfc-6d6634e311fa tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Lock "d4c23a0a-d5cb-4893-9a40-4586e98a2535-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:32:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-034543d9-6c77-4286-8cfc-6d6634e311fa tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Lock "d4c23a0a-d5cb-4893-9a40-4586e98a2535-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:32:38 user nova-compute[74247]: INFO nova.compute.manager [None req-034543d9-6c77-4286-8cfc-6d6634e311fa tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Terminating instance
Oct 16 18:32:38 user nova-compute[74247]: DEBUG nova.compute.manager [None req-034543d9-6c77-4286-8cfc-6d6634e311fa tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 18:32:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:38 user nova-compute[74247]: DEBUG nova.compute.manager [req-6c46a8ba-a483-4e03-8c57-d96a8a717899 req-d751bf7f-d6d6-49df-9874-4fdaf99fcd4d service nova] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Received event network-vif-unplugged-423dc8c8-ef91-4b4c-a3f1-29f8769ae668 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:32:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-6c46a8ba-a483-4e03-8c57-d96a8a717899 req-d751bf7f-d6d6-49df-9874-4fdaf99fcd4d service nova] Acquiring lock "d4c23a0a-d5cb-4893-9a40-4586e98a2535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:32:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-6c46a8ba-a483-4e03-8c57-d96a8a717899 req-d751bf7f-d6d6-49df-9874-4fdaf99fcd4d service nova] Lock "d4c23a0a-d5cb-4893-9a40-4586e98a2535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:32:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-6c46a8ba-a483-4e03-8c57-d96a8a717899 req-d751bf7f-d6d6-49df-9874-4fdaf99fcd4d service nova] Lock "d4c23a0a-d5cb-4893-9a40-4586e98a2535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:32:38 user nova-compute[74247]: DEBUG nova.compute.manager [req-6c46a8ba-a483-4e03-8c57-d96a8a717899 req-d751bf7f-d6d6-49df-9874-4fdaf99fcd4d service nova] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] No waiting events found dispatching network-vif-unplugged-423dc8c8-ef91-4b4c-a3f1-29f8769ae668 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:32:38 user nova-compute[74247]: DEBUG nova.compute.manager [req-6c46a8ba-a483-4e03-8c57-d96a8a717899 req-d751bf7f-d6d6-49df-9874-4fdaf99fcd4d service nova] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Received event network-vif-unplugged-423dc8c8-ef91-4b4c-a3f1-29f8769ae668 for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:32:39 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Instance destroyed successfully.
Oct 16 18:32:39 user nova-compute[74247]: DEBUG nova.objects.instance [None req-034543d9-6c77-4286-8cfc-6d6634e311fa tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Lazy-loading 'resources' on Instance uuid d4c23a0a-d5cb-4893-9a40-4586e98a2535 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:32:39 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-034543d9-6c77-4286-8cfc-6d6634e311fa tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T18:29:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-791406764',display_name='tempest-AttachSCSIVolumeTestJSON-server-791406764',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-791406764',id=16,image_ref='b90a1621-833a-4187-80e0-12981d48dfb7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBML2fAT3Ax5OrVksD34Dd5wMBbq+p6bA6TKmMnvwD9mGuDgOSjZ+agz+odm9/f5LM68jvYD/4JlIAj2Htp5yGVqquQn5kuPGEPJ3yx4lq0I/iaXmRQDXynEXTGOxPZf00g==',key_name='tempest-keypair-1855339094',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:30:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85a018057c194fc497ad8476dd290a69',ramdisk_id='',reservation_id='r-n59d770m',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b90a1621-833a-4187-80e0-12981d48dfb7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1602494163',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1602494163-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:30:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cebea5593d0403389777c0c9b0d0372',uuid=d4c23a0a-d5cb-4893-9a40-4586e98a2535,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "423dc8c8-ef91-4b4c-a3f1-29f8769ae668", "address": "fa:16:3e:f9:1d:bf", "network": {"id": "46ba27ba-e8dd-4c09-8b0e-1418f651dc21", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1347745998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85a018057c194fc497ad8476dd290a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap423dc8c8-ef", "ovs_interfaceid": "423dc8c8-ef91-4b4c-a3f1-29f8769ae668", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:32:39 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-034543d9-6c77-4286-8cfc-6d6634e311fa tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Converting VIF {"id": "423dc8c8-ef91-4b4c-a3f1-29f8769ae668", "address": "fa:16:3e:f9:1d:bf", "network": {"id": "46ba27ba-e8dd-4c09-8b0e-1418f651dc21", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1347745998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85a018057c194fc497ad8476dd290a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap423dc8c8-ef", "ovs_interfaceid": "423dc8c8-ef91-4b4c-a3f1-29f8769ae668", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:32:39 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-034543d9-6c77-4286-8cfc-6d6634e311fa tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:1d:bf,bridge_name='br-int',has_traffic_filtering=True,id=423dc8c8-ef91-4b4c-a3f1-29f8769ae668,network=Network(46ba27ba-e8dd-4c09-8b0e-1418f651dc21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap423dc8c8-ef') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:32:39 user nova-compute[74247]: DEBUG os_vif [None req-034543d9-6c77-4286-8cfc-6d6634e311fa tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:1d:bf,bridge_name='br-int',has_traffic_filtering=True,id=423dc8c8-ef91-4b4c-a3f1-29f8769ae668,network=Network(46ba27ba-e8dd-4c09-8b0e-1418f651dc21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap423dc8c8-ef') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:32:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap423dc8c8-ef, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:32:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:32:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=18626ac9-d328-4db9-a36e-28e16c8fd655) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:32:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:39 user nova-compute[74247]: INFO os_vif [None req-034543d9-6c77-4286-8cfc-6d6634e311fa tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:1d:bf,bridge_name='br-int',has_traffic_filtering=True,id=423dc8c8-ef91-4b4c-a3f1-29f8769ae668,network=Network(46ba27ba-e8dd-4c09-8b0e-1418f651dc21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap423dc8c8-ef')
Oct 16 18:32:39 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-034543d9-6c77-4286-8cfc-6d6634e311fa tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Deleting instance files /opt/stack/data/nova/instances/d4c23a0a-d5cb-4893-9a40-4586e98a2535_del
Oct 16 18:32:39 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-034543d9-6c77-4286-8cfc-6d6634e311fa tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Deletion of /opt/stack/data/nova/instances/d4c23a0a-d5cb-4893-9a40-4586e98a2535_del complete
Oct 16 18:32:39 user nova-compute[74247]: INFO nova.compute.manager [None req-034543d9-6c77-4286-8cfc-6d6634e311fa tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 16 18:32:39 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-034543d9-6c77-4286-8cfc-6d6634e311fa tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 18:32:39 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 18:32:39 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 18:32:39 user nova-compute[74247]: DEBUG nova.compute.manager [None req-e66b4cc7-6252-49b7-9f79-c987a68b134b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:32:39 user nova-compute[74247]: INFO nova.compute.manager [None req-e66b4cc7-6252-49b7-9f79-c987a68b134b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] instance snapshotting
Oct 16 18:32:39 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-e66b4cc7-6252-49b7-9f79-c987a68b134b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Beginning live snapshot process
Oct 16 18:32:39 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-e66b4cc7-6252-49b7-9f79-c987a68b134b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json -f qcow2 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:39 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-e66b4cc7-6252-49b7-9f79-c987a68b134b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:39 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-e66b4cc7-6252-49b7-9f79-c987a68b134b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json -f qcow2 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:40 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-e66b4cc7-6252-49b7-9f79-c987a68b134b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json -f qcow2" returned: 0 in 0.209s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:40 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-e66b4cc7-6252-49b7-9f79-c987a68b134b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:40 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:32:40 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Took 0.99 seconds to deallocate network for instance.
Oct 16 18:32:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-034543d9-6c77-4286-8cfc-6d6634e311fa tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:32:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-034543d9-6c77-4286-8cfc-6d6634e311fa tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:32:40 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-e66b4cc7-6252-49b7-9f79-c987a68b134b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.184s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:40 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-e66b4cc7-6252-49b7-9f79-c987a68b134b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpub2orcsu/eb3c9e84335743b28bfc4787c0b0dcac.delta 1073741824 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:40 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-e66b4cc7-6252-49b7-9f79-c987a68b134b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpub2orcsu/eb3c9e84335743b28bfc4787c0b0dcac.delta 1073741824" returned: 0 in 0.055s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:40 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-e66b4cc7-6252-49b7-9f79-c987a68b134b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 16 18:32:40 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-034543d9-6c77-4286-8cfc-6d6634e311fa tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:32:40 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-034543d9-6c77-4286-8cfc-6d6634e311fa tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:32:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-034543d9-6c77-4286-8cfc-6d6634e311fa tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.425s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:32:40 user nova-compute[74247]: DEBUG nova.compute.manager [req-3f68c0f7-6d20-4f24-84b2-ca8a488ea141 req-64fa2be7-278e-4524-8fe7-d4c04c523e21 service nova] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Received event network-vif-plugged-423dc8c8-ef91-4b4c-a3f1-29f8769ae668 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:32:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3f68c0f7-6d20-4f24-84b2-ca8a488ea141 req-64fa2be7-278e-4524-8fe7-d4c04c523e21 service nova] Acquiring lock "d4c23a0a-d5cb-4893-9a40-4586e98a2535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:32:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3f68c0f7-6d20-4f24-84b2-ca8a488ea141 req-64fa2be7-278e-4524-8fe7-d4c04c523e21 service nova] Lock "d4c23a0a-d5cb-4893-9a40-4586e98a2535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:32:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3f68c0f7-6d20-4f24-84b2-ca8a488ea141 req-64fa2be7-278e-4524-8fe7-d4c04c523e21 service nova] Lock "d4c23a0a-d5cb-4893-9a40-4586e98a2535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:32:40 user nova-compute[74247]: DEBUG nova.compute.manager [req-3f68c0f7-6d20-4f24-84b2-ca8a488ea141 req-64fa2be7-278e-4524-8fe7-d4c04c523e21 service nova] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] No waiting events found dispatching network-vif-plugged-423dc8c8-ef91-4b4c-a3f1-29f8769ae668 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:32:40 user nova-compute[74247]: WARNING nova.compute.manager [req-3f68c0f7-6d20-4f24-84b2-ca8a488ea141 req-64fa2be7-278e-4524-8fe7-d4c04c523e21 service nova] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Received unexpected event network-vif-plugged-423dc8c8-ef91-4b4c-a3f1-29f8769ae668 for instance with vm_state deleted and task_state None.
Oct 16 18:32:40 user nova-compute[74247]: DEBUG nova.compute.manager [req-3f68c0f7-6d20-4f24-84b2-ca8a488ea141 req-64fa2be7-278e-4524-8fe7-d4c04c523e21 service nova] [instance: d4c23a0a-d5cb-4893-9a40-4586e98a2535] Received event network-vif-deleted-423dc8c8-ef91-4b4c-a3f1-29f8769ae668 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:32:40 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-034543d9-6c77-4286-8cfc-6d6634e311fa tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Deleted allocations for instance d4c23a0a-d5cb-4893-9a40-4586e98a2535
Oct 16 18:32:40 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-034543d9-6c77-4286-8cfc-6d6634e311fa tempest-AttachSCSIVolumeTestJSON-1602494163 tempest-AttachSCSIVolumeTestJSON-1602494163-project-member] Lock "d4c23a0a-d5cb-4893-9a40-4586e98a2535" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.640s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:32:41 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-e66b4cc7-6252-49b7-9f79-c987a68b134b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 18:32:41 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-e66b4cc7-6252-49b7-9f79-c987a68b134b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] COPY block job progress, current cursor: 47644672 final cursor: 75497472 {{(pid=74247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 18:32:42 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-e66b4cc7-6252-49b7-9f79-c987a68b134b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 18:32:42 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-e66b4cc7-6252-49b7-9f79-c987a68b134b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 16 18:32:42 user nova-compute[74247]: DEBUG nova.privsep.utils [None req-e66b4cc7-6252-49b7-9f79-c987a68b134b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74247) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 18:32:42 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-e66b4cc7-6252-49b7-9f79-c987a68b134b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpub2orcsu/eb3c9e84335743b28bfc4787c0b0dcac.delta /opt/stack/data/nova/instances/snapshots/tmpub2orcsu/eb3c9e84335743b28bfc4787c0b0dcac {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:42 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-e66b4cc7-6252-49b7-9f79-c987a68b134b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpub2orcsu/eb3c9e84335743b28bfc4787c0b0dcac.delta /opt/stack/data/nova/instances/snapshots/tmpub2orcsu/eb3c9e84335743b28bfc4787c0b0dcac" returned: 0 in 0.560s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:42 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-e66b4cc7-6252-49b7-9f79-c987a68b134b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Snapshot extracted, beginning image upload
Oct 16 18:32:44 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:45 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-e66b4cc7-6252-49b7-9f79-c987a68b134b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Snapshot image upload complete
Oct 16 18:32:45 user nova-compute[74247]: INFO nova.compute.manager [None req-e66b4cc7-6252-49b7-9f79-c987a68b134b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Took 6.18 seconds to snapshot the instance on the hypervisor.
Oct 16 18:32:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:53 user nova-compute[74247]: DEBUG nova.compute.manager [req-2f30491a-577e-4048-aa8f-d33db4951c98 req-470bf7ef-b4bd-4845-8cdc-6275f2cab656 service nova] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Received event network-changed-c53d6d53-a35d-4efe-bdf2-021991dd4187 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:32:53 user nova-compute[74247]: DEBUG nova.compute.manager [req-2f30491a-577e-4048-aa8f-d33db4951c98 req-470bf7ef-b4bd-4845-8cdc-6275f2cab656 service nova] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Refreshing instance network info cache due to event network-changed-c53d6d53-a35d-4efe-bdf2-021991dd4187. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:32:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-2f30491a-577e-4048-aa8f-d33db4951c98 req-470bf7ef-b4bd-4845-8cdc-6275f2cab656 service nova] Acquiring lock "refresh_cache-d6367b6d-1bc2-4472-b0c4-07baec4a28b0" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:32:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-2f30491a-577e-4048-aa8f-d33db4951c98 req-470bf7ef-b4bd-4845-8cdc-6275f2cab656 service nova] Acquired lock "refresh_cache-d6367b6d-1bc2-4472-b0c4-07baec4a28b0" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:32:53 user nova-compute[74247]: DEBUG nova.network.neutron [req-2f30491a-577e-4048-aa8f-d33db4951c98 req-470bf7ef-b4bd-4845-8cdc-6275f2cab656 service nova] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Refreshing network info cache for port c53d6d53-a35d-4efe-bdf2-021991dd4187 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:32:54 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:54 user nova-compute[74247]: DEBUG nova.network.neutron [req-2f30491a-577e-4048-aa8f-d33db4951c98 req-470bf7ef-b4bd-4845-8cdc-6275f2cab656 service nova] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Updated VIF entry in instance network info cache for port c53d6d53-a35d-4efe-bdf2-021991dd4187. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:32:54 user nova-compute[74247]: DEBUG nova.network.neutron [req-2f30491a-577e-4048-aa8f-d33db4951c98 req-470bf7ef-b4bd-4845-8cdc-6275f2cab656 service nova] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Updating instance_info_cache with network_info: [{"id": "c53d6d53-a35d-4efe-bdf2-021991dd4187", "address": "fa:16:3e:8d:4e:52", "network": {"id": "fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1988491128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96ced9d4c0c474fbc7edeed6f73324a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53d6d53-a3", "ovs_interfaceid": "c53d6d53-a35d-4efe-bdf2-021991dd4187", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:32:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-2f30491a-577e-4048-aa8f-d33db4951c98 req-470bf7ef-b4bd-4845-8cdc-6275f2cab656 service nova] Releasing lock "refresh_cache-d6367b6d-1bc2-4472-b0c4-07baec4a28b0" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:32:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:32:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "d6367b6d-1bc2-4472-b0c4-07baec4a28b0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:32:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "d6367b6d-1bc2-4472-b0c4-07baec4a28b0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:32:58 user nova-compute[74247]: DEBUG nova.objects.instance [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lazy-loading 'flavor' on Instance uuid d6367b6d-1bc2-4472-b0c4-07baec4a28b0 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:32:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "d6367b6d-1bc2-4472-b0c4-07baec4a28b0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:32:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "d6367b6d-1bc2-4472-b0c4-07baec4a28b0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:32:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "d6367b6d-1bc2-4472-b0c4-07baec4a28b0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:32:58 user nova-compute[74247]: INFO nova.compute.manager [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Attaching volume e52798fc-3122-48c4-9ba4-d50e4932208e to /dev/vdb
Oct 16 18:32:58 user nova-compute[74247]: DEBUG os_brick.utils [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:32:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:58 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[622167d7-40d6-4b8c-a99c-ce0132f9e67b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:32:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:58 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[298c94f4-aab0-4928-8e5e-46f00c464261]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:32:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:32:58 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc1b61e-b723-4ffc-8daa-9f12e920e05e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:32:58 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea55f518-1be4-4eaf-a0bd-b8ed6dd3d6f4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:32:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:32:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 18:32:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:32:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:32:58 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 18:32:58 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca5080e-3373-4e6f-9f70-bd491aede4f0]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:32:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 18:32:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 18:32:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 18:32:58 user nova-compute[74247]: DEBUG os_brick.utils [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:32:58 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Updating existing volume attachment record: 3da98100-09f1-45eb-b74f-492d352273db {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 18:32:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0080cc2e-e542-4cd6-9423-74c4ab146515 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Acquiring lock "b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:33:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0080cc2e-e542-4cd6-9423-74c4ab146515 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Lock "b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:33:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0080cc2e-e542-4cd6-9423-74c4ab146515 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Acquiring lock "b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:33:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0080cc2e-e542-4cd6-9423-74c4ab146515 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Lock "b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:33:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0080cc2e-e542-4cd6-9423-74c4ab146515 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Lock "b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:33:00 user nova-compute[74247]: INFO nova.compute.manager [None req-0080cc2e-e542-4cd6-9423-74c4ab146515 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Terminating instance
Oct 16 18:33:00 user nova-compute[74247]: DEBUG nova.compute.manager [None req-0080cc2e-e542-4cd6-9423-74c4ab146515 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 18:33:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:00 user nova-compute[74247]: DEBUG nova.compute.manager [req-0f640e4f-af82-4711-9889-84df177b1cbc req-3efd21d5-efe4-43a0-95c0-adbc78bd3f17 service nova] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Received event network-vif-unplugged-f4db2672-7205-43d7-ac3b-3f6ea5c336c6 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:33:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0f640e4f-af82-4711-9889-84df177b1cbc req-3efd21d5-efe4-43a0-95c0-adbc78bd3f17 service nova] Acquiring lock "b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:33:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0f640e4f-af82-4711-9889-84df177b1cbc req-3efd21d5-efe4-43a0-95c0-adbc78bd3f17 service nova] Lock "b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:33:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0f640e4f-af82-4711-9889-84df177b1cbc req-3efd21d5-efe4-43a0-95c0-adbc78bd3f17 service nova] Lock "b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:33:00 user nova-compute[74247]: DEBUG nova.compute.manager [req-0f640e4f-af82-4711-9889-84df177b1cbc req-3efd21d5-efe4-43a0-95c0-adbc78bd3f17 service nova] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] No waiting events found dispatching network-vif-unplugged-f4db2672-7205-43d7-ac3b-3f6ea5c336c6 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:33:00 user nova-compute[74247]: DEBUG nova.compute.manager [req-0f640e4f-af82-4711-9889-84df177b1cbc req-3efd21d5-efe4-43a0-95c0-adbc78bd3f17 service nova] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Received event network-vif-unplugged-f4db2672-7205-43d7-ac3b-3f6ea5c336c6 for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:33:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:01 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Instance destroyed successfully.
Oct 16 18:33:01 user nova-compute[74247]: DEBUG nova.objects.instance [None req-0080cc2e-e542-4cd6-9423-74c4ab146515 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Lazy-loading 'resources' on Instance uuid b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:33:01 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-0080cc2e-e542-4cd6-9423-74c4ab146515 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:23:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-716225271',display_name='tempest-ServersNegativeTestJSON-server-716225271',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-716225271',id=1,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:24:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94e9d0485eec462990dd029379397962',ramdisk_id='',reservation_id='r-k2w0anvk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1696683961',owner_user_name='tempest-ServersNegativeTestJSON-1696683961-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:24:14Z,user_data=None,user_id='8c82a90fcbed4a38b4f69a18de607f1f',uuid=b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4db2672-7205-43d7-ac3b-3f6ea5c336c6", "address": "fa:16:3e:5f:52:2e", "network": {"id": "f99cbf0c-7d0c-4ef8-934a-aaac218e9381", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2096188408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94e9d0485eec462990dd029379397962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4db2672-72", "ovs_interfaceid": "f4db2672-7205-43d7-ac3b-3f6ea5c336c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:33:01 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-0080cc2e-e542-4cd6-9423-74c4ab146515 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Converting VIF {"id": "f4db2672-7205-43d7-ac3b-3f6ea5c336c6", "address": "fa:16:3e:5f:52:2e", "network": {"id": "f99cbf0c-7d0c-4ef8-934a-aaac218e9381", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2096188408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94e9d0485eec462990dd029379397962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4db2672-72", "ovs_interfaceid": "f4db2672-7205-43d7-ac3b-3f6ea5c336c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:33:01 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-0080cc2e-e542-4cd6-9423-74c4ab146515 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:52:2e,bridge_name='br-int',has_traffic_filtering=True,id=f4db2672-7205-43d7-ac3b-3f6ea5c336c6,network=Network(f99cbf0c-7d0c-4ef8-934a-aaac218e9381),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4db2672-72') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:33:01 user nova-compute[74247]: DEBUG os_vif [None req-0080cc2e-e542-4cd6-9423-74c4ab146515 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:52:2e,bridge_name='br-int',has_traffic_filtering=True,id=f4db2672-7205-43d7-ac3b-3f6ea5c336c6,network=Network(f99cbf0c-7d0c-4ef8-934a-aaac218e9381),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4db2672-72') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:33:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4db2672-72, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:33:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:33:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d61c5e63-ab79-4d57-83ee-47ed3065b8e7) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:33:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:01 user nova-compute[74247]: INFO os_vif [None req-0080cc2e-e542-4cd6-9423-74c4ab146515 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:52:2e,bridge_name='br-int',has_traffic_filtering=True,id=f4db2672-7205-43d7-ac3b-3f6ea5c336c6,network=Network(f99cbf0c-7d0c-4ef8-934a-aaac218e9381),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4db2672-72')
Oct 16 18:33:01 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-0080cc2e-e542-4cd6-9423-74c4ab146515 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Deleting instance files /opt/stack/data/nova/instances/b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d_del
Oct 16 18:33:01 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-0080cc2e-e542-4cd6-9423-74c4ab146515 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Deletion of /opt/stack/data/nova/instances/b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d_del complete
Oct 16 18:33:01 user nova-compute[74247]: INFO nova.compute.manager [None req-0080cc2e-e542-4cd6-9423-74c4ab146515 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Took 0.96 seconds to destroy the instance on the hypervisor.
Oct 16 18:33:01 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-0080cc2e-e542-4cd6-9423-74c4ab146515 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 18:33:01 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 18:33:01 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 18:33:01 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:33:01 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Took 0.49 seconds to deallocate network for instance.
Oct 16 18:33:01 user nova-compute[74247]: DEBUG nova.compute.manager [req-ff7b2cc8-0bc4-43eb-8ee9-419ba5661b19 req-ee858d57-9d44-4f4f-83f5-57e79c0badce service nova] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Received event network-vif-deleted-f4db2672-7205-43d7-ac3b-3f6ea5c336c6 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:33:01 user nova-compute[74247]: INFO nova.compute.manager [req-ff7b2cc8-0bc4-43eb-8ee9-419ba5661b19 req-ee858d57-9d44-4f4f-83f5-57e79c0badce service nova] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Neutron deleted interface f4db2672-7205-43d7-ac3b-3f6ea5c336c6; detaching it from the instance and deleting it from the info cache
Oct 16 18:33:01 user nova-compute[74247]: DEBUG nova.network.neutron [req-ff7b2cc8-0bc4-43eb-8ee9-419ba5661b19 req-ee858d57-9d44-4f4f-83f5-57e79c0badce service nova] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:33:01 user nova-compute[74247]: DEBUG nova.compute.manager [req-ff7b2cc8-0bc4-43eb-8ee9-419ba5661b19 req-ee858d57-9d44-4f4f-83f5-57e79c0badce service nova] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Detach interface failed, port_id=f4db2672-7205-43d7-ac3b-3f6ea5c336c6, reason: Instance b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d could not be found. {{(pid=74247) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 18:33:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0080cc2e-e542-4cd6-9423-74c4ab146515 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:33:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0080cc2e-e542-4cd6-9423-74c4ab146515 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:33:02 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-0080cc2e-e542-4cd6-9423-74c4ab146515 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:33:02 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-0080cc2e-e542-4cd6-9423-74c4ab146515 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:33:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0080cc2e-e542-4cd6-9423-74c4ab146515 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.287s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:33:02 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-0080cc2e-e542-4cd6-9423-74c4ab146515 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Deleted allocations for instance b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d
Oct 16 18:33:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0080cc2e-e542-4cd6-9423-74c4ab146515 tempest-ServersNegativeTestJSON-1696683961 tempest-ServersNegativeTestJSON-1696683961-project-member] Lock "b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.924s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:33:02 user nova-compute[74247]: DEBUG nova.compute.manager [req-eef49099-ffd6-41af-ab59-32da8948fd06 req-8d17e2ad-ff9b-4bdb-9eeb-642e5cb0c18f service nova] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Received event network-vif-plugged-f4db2672-7205-43d7-ac3b-3f6ea5c336c6 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:33:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-eef49099-ffd6-41af-ab59-32da8948fd06 req-8d17e2ad-ff9b-4bdb-9eeb-642e5cb0c18f service nova] Acquiring lock "b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:33:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-eef49099-ffd6-41af-ab59-32da8948fd06 req-8d17e2ad-ff9b-4bdb-9eeb-642e5cb0c18f service nova] Lock "b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:33:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-eef49099-ffd6-41af-ab59-32da8948fd06 req-8d17e2ad-ff9b-4bdb-9eeb-642e5cb0c18f service nova] Lock "b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:33:02 user nova-compute[74247]: DEBUG nova.compute.manager [req-eef49099-ffd6-41af-ab59-32da8948fd06 req-8d17e2ad-ff9b-4bdb-9eeb-642e5cb0c18f service nova] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] No waiting events found dispatching network-vif-plugged-f4db2672-7205-43d7-ac3b-3f6ea5c336c6 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:33:02 user nova-compute[74247]: WARNING nova.compute.manager [req-eef49099-ffd6-41af-ab59-32da8948fd06 req-8d17e2ad-ff9b-4bdb-9eeb-642e5cb0c18f service nova] [instance: b0fc3852-ea0d-4f5c-905f-86a26e2b3b1d] Received unexpected event network-vif-plugged-f4db2672-7205-43d7-ac3b-3f6ea5c336c6 for instance with vm_state deleted and task_state None.
Oct 16 18:33:04 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:33:04 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:33:04 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 18:33:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "refresh_cache-bbec99d1-82a3-4e4d-a3ae-17e00821bee1" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:33:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquired lock "refresh_cache-bbec99d1-82a3-4e4d-a3ae-17e00821bee1" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:33:04 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Forcefully refreshing network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 18:33:04 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Updating instance_info_cache with network_info: [{"id": "db973a04-4ef6-40c2-a694-c7a12631bc59", "address": "fa:16:3e:d4:26:c0", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb973a04-4e", "ovs_interfaceid": "db973a04-4ef6-40c2-a694-c7a12631bc59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:33:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Releasing lock "refresh_cache-bbec99d1-82a3-4e4d-a3ae-17e00821bee1" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:33:04 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Updated the network info_cache for instance {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 18:33:04 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:33:04 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:33:04 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:33:04 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:33:04 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:33:04 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:33:04 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 18:33:04 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:33:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:33:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:33:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:33:04 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 18:33:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6367b6d-1bc2-4472-b0c4-07baec4a28b0/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6367b6d-1bc2-4472-b0c4-07baec4a28b0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6367b6d-1bc2-4472-b0c4-07baec4a28b0/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6367b6d-1bc2-4472-b0c4-07baec4a28b0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:33:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:07 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:33:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:08 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:33:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk.rescue --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk.rescue --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:08 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:33:08 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:33:08 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:33:08 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:33:08 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:33:08 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=7377MB free_disk=25.062965393066406GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 18:33:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:33:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:33:09 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance e37fbc27-3404-479a-be08-4d590391cf30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:33:09 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance bbec99d1-82a3-4e4d-a3ae-17e00821bee1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:33:09 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 7c17a25b-6818-48fa-b406-638dbf1845d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:33:09 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance a686ee86-272c-47be-8801-9c1500af272f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:33:09 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 7fa3da6f-ba9f-4752-901a-933427fcbda8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:33:09 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance cddf4842-1c25-4cc8-914e-af30849e4d6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:33:09 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance d6367b6d-1bc2-4472-b0c4-07baec4a28b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:33:09 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 958af87e-69d0-4da1-8fcf-90e0f275d62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:33:09 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance d775101d-53a1-48c7-af24-91480be6af61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:33:09 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 18:33:09 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 18:33:09 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:33:09 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:33:09 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 18:33:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.412s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:33:10 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:13 user nova-compute[74247]: DEBUG nova.compute.manager [req-964567db-37d3-4e22-96a9-75e498bf41cc req-d2c0921f-3c9e-4001-a611-17ba85050f0b service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-changed-a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:33:13 user nova-compute[74247]: DEBUG nova.compute.manager [req-964567db-37d3-4e22-96a9-75e498bf41cc req-d2c0921f-3c9e-4001-a611-17ba85050f0b service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Refreshing instance network info cache due to event network-changed-a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:33:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-964567db-37d3-4e22-96a9-75e498bf41cc req-d2c0921f-3c9e-4001-a611-17ba85050f0b service nova] Acquiring lock "refresh_cache-7fa3da6f-ba9f-4752-901a-933427fcbda8" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:33:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-964567db-37d3-4e22-96a9-75e498bf41cc req-d2c0921f-3c9e-4001-a611-17ba85050f0b service nova] Acquired lock "refresh_cache-7fa3da6f-ba9f-4752-901a-933427fcbda8" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:33:13 user nova-compute[74247]: DEBUG nova.network.neutron [req-964567db-37d3-4e22-96a9-75e498bf41cc req-d2c0921f-3c9e-4001-a611-17ba85050f0b service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Refreshing network info cache for port a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:33:14 user nova-compute[74247]: DEBUG nova.network.neutron [req-964567db-37d3-4e22-96a9-75e498bf41cc req-d2c0921f-3c9e-4001-a611-17ba85050f0b service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Updated VIF entry in instance network info cache for port a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:33:14 user nova-compute[74247]: DEBUG nova.network.neutron [req-964567db-37d3-4e22-96a9-75e498bf41cc req-d2c0921f-3c9e-4001-a611-17ba85050f0b service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Updating instance_info_cache with network_info: [{"id": "a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11", "address": "fa:16:3e:7e:13:34", "network": {"id": "43dd1e8a-1185-462c-9421-d0d7b2d90334", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1360889325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ea7e01-7e", "ovs_interfaceid": "a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40eb3a07-e825-44ad-9077-c1880b1e8768", "address": "fa:16:3e:ef:f1:d7", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40eb3a07-e8", "ovs_interfaceid": "40eb3a07-e825-44ad-9077-c1880b1e8768", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2813ff58-0b02-4da1-8774-ad7452da7d78", "address": "fa:16:3e:56:f0:e9", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2813ff58-0b", "ovs_interfaceid": "2813ff58-0b02-4da1-8774-ad7452da7d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec", "address": "fa:16:3e:32:8d:af", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dbd4bf3-bf", "ovs_interfaceid": "1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5", "address": "fa:16:3e:73:c9:16", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9f5274-68", "ovs_interfaceid": "2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a815917f-f1ec-48f2-b272-97bf2ad1d6cd", "address": "fa:16:3e:22:3b:ee", "network": {"id": "20ec901d-4e30-4c4a-ab56-7d57878cfdcc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1805797092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa815917f-f1", "ovs_interfaceid": "a815917f-f1ec-48f2-b272-97bf2ad1d6cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23684bac-dba0-4fdd-80d3-750ed2a77731", "address": "fa:16:3e:46:79:42", "network": {"id": "20ec901d-4e30-4c4a-ab56-7d57878cfdcc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1805797092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23684bac-db", "ovs_interfaceid": "23684bac-dba0-4fdd-80d3-750ed2a77731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:33:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-964567db-37d3-4e22-96a9-75e498bf41cc req-d2c0921f-3c9e-4001-a611-17ba85050f0b service nova] Releasing lock "refresh_cache-7fa3da6f-ba9f-4752-901a-933427fcbda8" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:33:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Acquiring lock "7fa3da6f-ba9f-4752-901a-933427fcbda8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Acquiring lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:33:16 user nova-compute[74247]: INFO nova.compute.manager [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Terminating instance
Oct 16 18:33:16 user nova-compute[74247]: DEBUG nova.compute.manager [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DorZEPQU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:33:16 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:33:16 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:33:16 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:33:16 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:33:16 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:33:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d70eca1-134f-46cc-b7b6-0a57ebc38ba0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 18:33:16 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7c3c9f-2d60-4fe6-9aa6-ab2170ee49dc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e] added
Oct 16 18:33:16 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a996a4-db5b-4764-88d7-0ae00db558b3]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[455844d4-2edb-439e-a912-3d6f13084652]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG nova.compute.manager [req-0bf56f02-c242-4b0c-89c5-c3c20f63c72b req-e8ed0661-07c3-41c5-b18a-4c96d5f30b86 service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-vif-unplugged-a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0bf56f02-c242-4b0c-89c5-c3c20f63c72b req-e8ed0661-07c3-41c5-b18a-4c96d5f30b86 service nova] Acquiring lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0bf56f02-c242-4b0c-89c5-c3c20f63c72b req-e8ed0661-07c3-41c5-b18a-4c96d5f30b86 service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0bf56f02-c242-4b0c-89c5-c3c20f63c72b req-e8ed0661-07c3-41c5-b18a-4c96d5f30b86 service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG nova.compute.manager [req-0bf56f02-c242-4b0c-89c5-c3c20f63c72b req-e8ed0661-07c3-41c5-b18a-4c96d5f30b86 service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] No waiting events found dispatching network-vif-unplugged-a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG nova.compute.manager [req-0bf56f02-c242-4b0c-89c5-c3c20f63c72b req-e8ed0661-07c3-41c5-b18a-4c96d5f30b86 service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-vif-unplugged-a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11 for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DorZEPQU {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DorZEPQU" returned: 0 in 0.026s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e00249b-27e9-4268-b414-4aeab66d6760]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DorZEPQU'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0ccb79-69cf-4916-81ea-0a9fb3cb6f21]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG nova.compute.manager [req-9b73d148-bc23-4da6-b9b9-eabf1e5d390a req-d9456cba-5223-4ce3-8236-33f418d6897e service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-vif-unplugged-40eb3a07-e825-44ad-9077-c1880b1e8768 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9b73d148-bc23-4da6-b9b9-eabf1e5d390a req-d9456cba-5223-4ce3-8236-33f418d6897e service nova] Acquiring lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9b73d148-bc23-4da6-b9b9-eabf1e5d390a req-d9456cba-5223-4ce3-8236-33f418d6897e service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9b73d148-bc23-4da6-b9b9-eabf1e5d390a req-d9456cba-5223-4ce3-8236-33f418d6897e service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG nova.compute.manager [req-9b73d148-bc23-4da6-b9b9-eabf1e5d390a req-d9456cba-5223-4ce3-8236-33f418d6897e service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] No waiting events found dispatching network-vif-unplugged-40eb3a07-e825-44ad-9077-c1880b1e8768 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG nova.compute.manager [req-9b73d148-bc23-4da6-b9b9-eabf1e5d390a req-d9456cba-5223-4ce3-8236-33f418d6897e service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-vif-unplugged-40eb3a07-e825-44ad-9077-c1880b1e8768 for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[adef213f-bbac-4e96-bb39-1c7bb796d3d3]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:33:16 user nova-compute[74247]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)
Oct 16 18:33:16 user nova-compute[74247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:33:16 user nova-compute[74247]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a (non-flash)
Oct 16 18:33:16 user nova-compute[74247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 (non-flash)
Oct 16 18:33:16 user nova-compute[74247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a (non-flash)
Oct 16 18:33:16 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:33:16 user nova-compute[74247]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)
Oct 16 18:33:16 user nova-compute[74247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:33:16 user nova-compute[74247]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a (non-flash)
Oct 16 18:33:16 user nova-compute[74247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 (non-flash)
Oct 16 18:33:16 user nova-compute[74247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a (non-flash)
Oct 16 18:33:16 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[803f8c59-a484-4ed9-80de-e087471c7c7b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e, portal: 172.16.0.220,3260]
Oct 16 18:33:16 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e, portal: 172.16.0.220,3260] successful.
Oct 16 18:33:16 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4b4634-e696-434d-9774-b01e88fc7d31]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a093225-fb8f-4636-b2d9-eaa97bdd82f7]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:33:16 user nova-compute[74247]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)
Oct 16 18:33:16 user nova-compute[74247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:33:16 user nova-compute[74247]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a (non-flash)
Oct 16 18:33:16 user nova-compute[74247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 (non-flash)
Oct 16 18:33:16 user nova-compute[74247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a (non-flash)
Oct 16 18:33:16 user nova-compute[74247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e (non-flash)
Oct 16 18:33:16 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:33:16 user nova-compute[74247]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)
Oct 16 18:33:16 user nova-compute[74247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:33:16 user nova-compute[74247]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a (non-flash)
Oct 16 18:33:16 user nova-compute[74247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 (non-flash)
Oct 16 18:33:16 user nova-compute[74247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a (non-flash)
Oct 16 18:33:16 user nova-compute[74247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e (non-flash)
Oct 16 18:33:16 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.378s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] HCTL ('39', '-', '-', 0) found on session 22 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.027s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b67d9e-f25b-4bde-8d55-9cef5113dcf9]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Searching for a device in session 22 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DorZEPQU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:17 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.440s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:33:17 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] <== connect_volume: return (1443ms) {'type': 'block', 'scsi_wwn': '23734386561336538', 'path': '/dev/sdh'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:33:17 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734386561336538', 'path': '/dev/sdh'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:33:17 user nova-compute[74247]: DEBUG nova.objects.instance [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lazy-loading 'flavor' on Instance uuid d6367b6d-1bc2-4472-b0c4-07baec4a28b0 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:33:17 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 18:33:17 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:33:17 user nova-compute[74247]:   <source dev="/dev/sdh"/>
Oct 16 18:33:17 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:33:17 user nova-compute[74247]:   <serial>e52798fc-3122-48c4-9ba4-d50e4932208e</serial>
Oct 16 18:33:17 user nova-compute[74247]: </disk>
Oct 16 18:33:17 user nova-compute[74247]:  {{(pid=74247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 18:33:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:18 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Instance destroyed successfully.
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.objects.instance [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Lazy-loading 'resources' on Instance uuid 7fa3da6f-ba9f-4752-901a-933427fcbda8 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T18:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1643831507',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1643831507',id=15,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBhF0sANZ/03xGnSsBlEhP5xqrLOn5YswxiMH0tVkN+k8phJyrEolhCxz6XLBZpBa0d6HcDDQLwP5W1UWE8yHjqqf3zr4EZl5QHQHaRViQLiasvsmm1YXaTvkU2/aD2JQ==',key_name='tempest-keypair-1285773862',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:31:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b90038686fba435a8e52f00df40b3ebb',ramdisk_id='',reservation_id='r-61ak5fxw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-758290026',owner_user_name='tempest-TaggedBootDevicesTest_v242-758290026-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:31:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7ccba53dfe84ade9e0ce346b9eb3420',uuid=7fa3da6f-ba9f-4752-901a-933427fcbda8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11", "address": "fa:16:3e:7e:13:34", "network": {"id": "43dd1e8a-1185-462c-9421-d0d7b2d90334", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1360889325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ea7e01-7e", "ovs_interfaceid": "a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Converting VIF {"id": "a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11", "address": "fa:16:3e:7e:13:34", "network": {"id": "43dd1e8a-1185-462c-9421-d0d7b2d90334", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1360889325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ea7e01-7e", "ovs_interfaceid": "a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:13:34,bridge_name='br-int',has_traffic_filtering=True,id=a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11,network=Network(43dd1e8a-1185-462c-9421-d0d7b2d90334),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4ea7e01-7e') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG os_vif [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:13:34,bridge_name='br-int',has_traffic_filtering=True,id=a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11,network=Network(43dd1e8a-1185-462c-9421-d0d7b2d90334),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4ea7e01-7e') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4ea7e01-7e, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] No VIF found with MAC fa:16:3e:8d:4e:52, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=12941255-b2f1-4cbb-8ec2-16c62bc54c32) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:18 user nova-compute[74247]: INFO os_vif [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:13:34,bridge_name='br-int',has_traffic_filtering=True,id=a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11,network=Network(43dd1e8a-1185-462c-9421-d0d7b2d90334),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4ea7e01-7e')
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T18:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1643831507',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1643831507',id=15,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBhF0sANZ/03xGnSsBlEhP5xqrLOn5YswxiMH0tVkN+k8phJyrEolhCxz6XLBZpBa0d6HcDDQLwP5W1UWE8yHjqqf3zr4EZl5QHQHaRViQLiasvsmm1YXaTvkU2/aD2JQ==',key_name='tempest-keypair-1285773862',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:31:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b90038686fba435a8e52f00df40b3ebb',ramdisk_id='',reservation_id='r-61ak5fxw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-758290026',owner_user_name='tempest-TaggedBootDevicesTest_v242-758290026-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:31:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7ccba53dfe84ade9e0ce346b9eb3420',uuid=7fa3da6f-ba9f-4752-901a-933427fcbda8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "40eb3a07-e825-44ad-9077-c1880b1e8768", "address": "fa:16:3e:ef:f1:d7", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40eb3a07-e8", "ovs_interfaceid": "40eb3a07-e825-44ad-9077-c1880b1e8768", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Converting VIF {"id": "40eb3a07-e825-44ad-9077-c1880b1e8768", "address": "fa:16:3e:ef:f1:d7", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40eb3a07-e8", "ovs_interfaceid": "40eb3a07-e825-44ad-9077-c1880b1e8768", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:f1:d7,bridge_name='br-int',has_traffic_filtering=True,id=40eb3a07-e825-44ad-9077-c1880b1e8768,network=Network(ac267af4-73e2-437a-b1a6-e0ae2497cad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap40eb3a07-e8') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG os_vif [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:f1:d7,bridge_name='br-int',has_traffic_filtering=True,id=40eb3a07-e825-44ad-9077-c1880b1e8768,network=Network(ac267af4-73e2-437a-b1a6-e0ae2497cad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap40eb3a07-e8') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap40eb3a07-e8, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-7fe0809c-35e3-4c5b-ae88-b2be784d6cae tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "d6367b6d-1bc2-4472-b0c4-07baec4a28b0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.251s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d7cda069-3118-4b9e-b0e8-163260849804) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:18 user nova-compute[74247]: INFO os_vif [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:f1:d7,bridge_name='br-int',has_traffic_filtering=True,id=40eb3a07-e825-44ad-9077-c1880b1e8768,network=Network(ac267af4-73e2-437a-b1a6-e0ae2497cad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap40eb3a07-e8')
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T18:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1643831507',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1643831507',id=15,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBhF0sANZ/03xGnSsBlEhP5xqrLOn5YswxiMH0tVkN+k8phJyrEolhCxz6XLBZpBa0d6HcDDQLwP5W1UWE8yHjqqf3zr4EZl5QHQHaRViQLiasvsmm1YXaTvkU2/aD2JQ==',key_name='tempest-keypair-1285773862',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:31:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b90038686fba435a8e52f00df40b3ebb',ramdisk_id='',reservation_id='r-61ak5fxw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-758290026',owner_user_name='tempest-TaggedBootDevicesTest_v242-758290026-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:31:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7ccba53dfe84ade9e0ce346b9eb3420',uuid=7fa3da6f-ba9f-4752-901a-933427fcbda8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2813ff58-0b02-4da1-8774-ad7452da7d78", "address": "fa:16:3e:56:f0:e9", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2813ff58-0b", "ovs_interfaceid": "2813ff58-0b02-4da1-8774-ad7452da7d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Converting VIF {"id": "2813ff58-0b02-4da1-8774-ad7452da7d78", "address": "fa:16:3e:56:f0:e9", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2813ff58-0b", "ovs_interfaceid": "2813ff58-0b02-4da1-8774-ad7452da7d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:f0:e9,bridge_name='br-int',has_traffic_filtering=True,id=2813ff58-0b02-4da1-8774-ad7452da7d78,network=Network(ac267af4-73e2-437a-b1a6-e0ae2497cad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2813ff58-0b') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG os_vif [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:f0:e9,bridge_name='br-int',has_traffic_filtering=True,id=2813ff58-0b02-4da1-8774-ad7452da7d78,network=Network(ac267af4-73e2-437a-b1a6-e0ae2497cad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2813ff58-0b') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2813ff58-0b, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e58d90f0-f491-4950-9029-c63bd9f63a05) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.compute.manager [req-e3109c76-c5fd-4755-a103-e8ea7e4eb157 req-baefe3da-568e-472e-a639-a1233d43cab8 service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-vif-plugged-a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e3109c76-c5fd-4755-a103-e8ea7e4eb157 req-baefe3da-568e-472e-a639-a1233d43cab8 service nova] Acquiring lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e3109c76-c5fd-4755-a103-e8ea7e4eb157 req-baefe3da-568e-472e-a639-a1233d43cab8 service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e3109c76-c5fd-4755-a103-e8ea7e4eb157 req-baefe3da-568e-472e-a639-a1233d43cab8 service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.compute.manager [req-e3109c76-c5fd-4755-a103-e8ea7e4eb157 req-baefe3da-568e-472e-a639-a1233d43cab8 service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] No waiting events found dispatching network-vif-plugged-a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:33:18 user nova-compute[74247]: WARNING nova.compute.manager [req-e3109c76-c5fd-4755-a103-e8ea7e4eb157 req-baefe3da-568e-472e-a639-a1233d43cab8 service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received unexpected event network-vif-plugged-a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11 for instance with vm_state active and task_state deleting.
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.compute.manager [req-e3109c76-c5fd-4755-a103-e8ea7e4eb157 req-baefe3da-568e-472e-a639-a1233d43cab8 service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-vif-unplugged-1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e3109c76-c5fd-4755-a103-e8ea7e4eb157 req-baefe3da-568e-472e-a639-a1233d43cab8 service nova] Acquiring lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e3109c76-c5fd-4755-a103-e8ea7e4eb157 req-baefe3da-568e-472e-a639-a1233d43cab8 service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e3109c76-c5fd-4755-a103-e8ea7e4eb157 req-baefe3da-568e-472e-a639-a1233d43cab8 service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.compute.manager [req-e3109c76-c5fd-4755-a103-e8ea7e4eb157 req-baefe3da-568e-472e-a639-a1233d43cab8 service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] No waiting events found dispatching network-vif-unplugged-1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.compute.manager [req-e3109c76-c5fd-4755-a103-e8ea7e4eb157 req-baefe3da-568e-472e-a639-a1233d43cab8 service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-vif-unplugged-1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.compute.manager [req-e3109c76-c5fd-4755-a103-e8ea7e4eb157 req-baefe3da-568e-472e-a639-a1233d43cab8 service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-vif-plugged-1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e3109c76-c5fd-4755-a103-e8ea7e4eb157 req-baefe3da-568e-472e-a639-a1233d43cab8 service nova] Acquiring lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e3109c76-c5fd-4755-a103-e8ea7e4eb157 req-baefe3da-568e-472e-a639-a1233d43cab8 service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e3109c76-c5fd-4755-a103-e8ea7e4eb157 req-baefe3da-568e-472e-a639-a1233d43cab8 service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.compute.manager [req-e3109c76-c5fd-4755-a103-e8ea7e4eb157 req-baefe3da-568e-472e-a639-a1233d43cab8 service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] No waiting events found dispatching network-vif-plugged-1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:33:18 user nova-compute[74247]: WARNING nova.compute.manager [req-e3109c76-c5fd-4755-a103-e8ea7e4eb157 req-baefe3da-568e-472e-a639-a1233d43cab8 service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received unexpected event network-vif-plugged-1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec for instance with vm_state active and task_state deleting.
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.compute.manager [req-e3109c76-c5fd-4755-a103-e8ea7e4eb157 req-baefe3da-568e-472e-a639-a1233d43cab8 service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-vif-unplugged-2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e3109c76-c5fd-4755-a103-e8ea7e4eb157 req-baefe3da-568e-472e-a639-a1233d43cab8 service nova] Acquiring lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e3109c76-c5fd-4755-a103-e8ea7e4eb157 req-baefe3da-568e-472e-a639-a1233d43cab8 service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e3109c76-c5fd-4755-a103-e8ea7e4eb157 req-baefe3da-568e-472e-a639-a1233d43cab8 service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.compute.manager [req-e3109c76-c5fd-4755-a103-e8ea7e4eb157 req-baefe3da-568e-472e-a639-a1233d43cab8 service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] No waiting events found dispatching network-vif-unplugged-2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.compute.manager [req-e3109c76-c5fd-4755-a103-e8ea7e4eb157 req-baefe3da-568e-472e-a639-a1233d43cab8 service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-vif-unplugged-2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5 for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.compute.manager [req-e3109c76-c5fd-4755-a103-e8ea7e4eb157 req-baefe3da-568e-472e-a639-a1233d43cab8 service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-vif-plugged-2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e3109c76-c5fd-4755-a103-e8ea7e4eb157 req-baefe3da-568e-472e-a639-a1233d43cab8 service nova] Acquiring lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e3109c76-c5fd-4755-a103-e8ea7e4eb157 req-baefe3da-568e-472e-a639-a1233d43cab8 service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e3109c76-c5fd-4755-a103-e8ea7e4eb157 req-baefe3da-568e-472e-a639-a1233d43cab8 service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.compute.manager [req-e3109c76-c5fd-4755-a103-e8ea7e4eb157 req-baefe3da-568e-472e-a639-a1233d43cab8 service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] No waiting events found dispatching network-vif-plugged-2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:33:18 user nova-compute[74247]: WARNING nova.compute.manager [req-e3109c76-c5fd-4755-a103-e8ea7e4eb157 req-baefe3da-568e-472e-a639-a1233d43cab8 service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received unexpected event network-vif-plugged-2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5 for instance with vm_state active and task_state deleting.
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:18 user nova-compute[74247]: INFO os_vif [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:f0:e9,bridge_name='br-int',has_traffic_filtering=True,id=2813ff58-0b02-4da1-8774-ad7452da7d78,network=Network(ac267af4-73e2-437a-b1a6-e0ae2497cad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2813ff58-0b')
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T18:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1643831507',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1643831507',id=15,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBhF0sANZ/03xGnSsBlEhP5xqrLOn5YswxiMH0tVkN+k8phJyrEolhCxz6XLBZpBa0d6HcDDQLwP5W1UWE8yHjqqf3zr4EZl5QHQHaRViQLiasvsmm1YXaTvkU2/aD2JQ==',key_name='tempest-keypair-1285773862',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:31:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b90038686fba435a8e52f00df40b3ebb',ramdisk_id='',reservation_id='r-61ak5fxw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-758290026',owner_user_name='tempest-TaggedBootDevicesTest_v242-758290026-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:31:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7ccba53dfe84ade9e0ce346b9eb3420',uuid=7fa3da6f-ba9f-4752-901a-933427fcbda8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec", "address": "fa:16:3e:32:8d:af", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dbd4bf3-bf", "ovs_interfaceid": "1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Converting VIF {"id": "1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec", "address": "fa:16:3e:32:8d:af", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dbd4bf3-bf", "ovs_interfaceid": "1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:8d:af,bridge_name='br-int',has_traffic_filtering=True,id=1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec,network=Network(ac267af4-73e2-437a-b1a6-e0ae2497cad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dbd4bf3-bf') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG os_vif [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:8d:af,bridge_name='br-int',has_traffic_filtering=True,id=1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec,network=Network(ac267af4-73e2-437a-b1a6-e0ae2497cad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dbd4bf3-bf') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1dbd4bf3-bf, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.compute.manager [req-c3249743-6e90-40f3-8b55-a784e9ddf798 req-18f4f22f-b193-4bc1-85e3-ee36c53aaf4c service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-vif-plugged-40eb3a07-e825-44ad-9077-c1880b1e8768 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c3249743-6e90-40f3-8b55-a784e9ddf798 req-18f4f22f-b193-4bc1-85e3-ee36c53aaf4c service nova] Acquiring lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c3249743-6e90-40f3-8b55-a784e9ddf798 req-18f4f22f-b193-4bc1-85e3-ee36c53aaf4c service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c3249743-6e90-40f3-8b55-a784e9ddf798 req-18f4f22f-b193-4bc1-85e3-ee36c53aaf4c service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.compute.manager [req-c3249743-6e90-40f3-8b55-a784e9ddf798 req-18f4f22f-b193-4bc1-85e3-ee36c53aaf4c service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] No waiting events found dispatching network-vif-plugged-40eb3a07-e825-44ad-9077-c1880b1e8768 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:33:18 user nova-compute[74247]: WARNING nova.compute.manager [req-c3249743-6e90-40f3-8b55-a784e9ddf798 req-18f4f22f-b193-4bc1-85e3-ee36c53aaf4c service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received unexpected event network-vif-plugged-40eb3a07-e825-44ad-9077-c1880b1e8768 for instance with vm_state active and task_state deleting.
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.compute.manager [req-c3249743-6e90-40f3-8b55-a784e9ddf798 req-18f4f22f-b193-4bc1-85e3-ee36c53aaf4c service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-vif-unplugged-2813ff58-0b02-4da1-8774-ad7452da7d78 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c3249743-6e90-40f3-8b55-a784e9ddf798 req-18f4f22f-b193-4bc1-85e3-ee36c53aaf4c service nova] Acquiring lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c3249743-6e90-40f3-8b55-a784e9ddf798 req-18f4f22f-b193-4bc1-85e3-ee36c53aaf4c service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c3249743-6e90-40f3-8b55-a784e9ddf798 req-18f4f22f-b193-4bc1-85e3-ee36c53aaf4c service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.compute.manager [req-c3249743-6e90-40f3-8b55-a784e9ddf798 req-18f4f22f-b193-4bc1-85e3-ee36c53aaf4c service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] No waiting events found dispatching network-vif-unplugged-2813ff58-0b02-4da1-8774-ad7452da7d78 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.compute.manager [req-c3249743-6e90-40f3-8b55-a784e9ddf798 req-18f4f22f-b193-4bc1-85e3-ee36c53aaf4c service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-vif-unplugged-2813ff58-0b02-4da1-8774-ad7452da7d78 for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.compute.manager [req-c3249743-6e90-40f3-8b55-a784e9ddf798 req-18f4f22f-b193-4bc1-85e3-ee36c53aaf4c service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-vif-plugged-2813ff58-0b02-4da1-8774-ad7452da7d78 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c3249743-6e90-40f3-8b55-a784e9ddf798 req-18f4f22f-b193-4bc1-85e3-ee36c53aaf4c service nova] Acquiring lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c3249743-6e90-40f3-8b55-a784e9ddf798 req-18f4f22f-b193-4bc1-85e3-ee36c53aaf4c service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c3249743-6e90-40f3-8b55-a784e9ddf798 req-18f4f22f-b193-4bc1-85e3-ee36c53aaf4c service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.compute.manager [req-c3249743-6e90-40f3-8b55-a784e9ddf798 req-18f4f22f-b193-4bc1-85e3-ee36c53aaf4c service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] No waiting events found dispatching network-vif-plugged-2813ff58-0b02-4da1-8774-ad7452da7d78 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:33:18 user nova-compute[74247]: WARNING nova.compute.manager [req-c3249743-6e90-40f3-8b55-a784e9ddf798 req-18f4f22f-b193-4bc1-85e3-ee36c53aaf4c service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received unexpected event network-vif-plugged-2813ff58-0b02-4da1-8774-ad7452da7d78 for instance with vm_state active and task_state deleting.
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.compute.manager [req-c3249743-6e90-40f3-8b55-a784e9ddf798 req-18f4f22f-b193-4bc1-85e3-ee36c53aaf4c service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-vif-unplugged-a815917f-f1ec-48f2-b272-97bf2ad1d6cd {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c3249743-6e90-40f3-8b55-a784e9ddf798 req-18f4f22f-b193-4bc1-85e3-ee36c53aaf4c service nova] Acquiring lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c3249743-6e90-40f3-8b55-a784e9ddf798 req-18f4f22f-b193-4bc1-85e3-ee36c53aaf4c service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c3249743-6e90-40f3-8b55-a784e9ddf798 req-18f4f22f-b193-4bc1-85e3-ee36c53aaf4c service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.compute.manager [req-c3249743-6e90-40f3-8b55-a784e9ddf798 req-18f4f22f-b193-4bc1-85e3-ee36c53aaf4c service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] No waiting events found dispatching network-vif-unplugged-a815917f-f1ec-48f2-b272-97bf2ad1d6cd {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.compute.manager [req-c3249743-6e90-40f3-8b55-a784e9ddf798 req-18f4f22f-b193-4bc1-85e3-ee36c53aaf4c service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-vif-unplugged-a815917f-f1ec-48f2-b272-97bf2ad1d6cd for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.compute.manager [req-c3249743-6e90-40f3-8b55-a784e9ddf798 req-18f4f22f-b193-4bc1-85e3-ee36c53aaf4c service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-vif-plugged-a815917f-f1ec-48f2-b272-97bf2ad1d6cd {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c3249743-6e90-40f3-8b55-a784e9ddf798 req-18f4f22f-b193-4bc1-85e3-ee36c53aaf4c service nova] Acquiring lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c3249743-6e90-40f3-8b55-a784e9ddf798 req-18f4f22f-b193-4bc1-85e3-ee36c53aaf4c service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c3249743-6e90-40f3-8b55-a784e9ddf798 req-18f4f22f-b193-4bc1-85e3-ee36c53aaf4c service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.compute.manager [req-c3249743-6e90-40f3-8b55-a784e9ddf798 req-18f4f22f-b193-4bc1-85e3-ee36c53aaf4c service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] No waiting events found dispatching network-vif-plugged-a815917f-f1ec-48f2-b272-97bf2ad1d6cd {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:33:18 user nova-compute[74247]: WARNING nova.compute.manager [req-c3249743-6e90-40f3-8b55-a784e9ddf798 req-18f4f22f-b193-4bc1-85e3-ee36c53aaf4c service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received unexpected event network-vif-plugged-a815917f-f1ec-48f2-b272-97bf2ad1d6cd for instance with vm_state active and task_state deleting.
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.compute.manager [req-c3249743-6e90-40f3-8b55-a784e9ddf798 req-18f4f22f-b193-4bc1-85e3-ee36c53aaf4c service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-vif-unplugged-23684bac-dba0-4fdd-80d3-750ed2a77731 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c3249743-6e90-40f3-8b55-a784e9ddf798 req-18f4f22f-b193-4bc1-85e3-ee36c53aaf4c service nova] Acquiring lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c3249743-6e90-40f3-8b55-a784e9ddf798 req-18f4f22f-b193-4bc1-85e3-ee36c53aaf4c service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c3249743-6e90-40f3-8b55-a784e9ddf798 req-18f4f22f-b193-4bc1-85e3-ee36c53aaf4c service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.compute.manager [req-c3249743-6e90-40f3-8b55-a784e9ddf798 req-18f4f22f-b193-4bc1-85e3-ee36c53aaf4c service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] No waiting events found dispatching network-vif-unplugged-23684bac-dba0-4fdd-80d3-750ed2a77731 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.compute.manager [req-c3249743-6e90-40f3-8b55-a784e9ddf798 req-18f4f22f-b193-4bc1-85e3-ee36c53aaf4c service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-vif-unplugged-23684bac-dba0-4fdd-80d3-750ed2a77731 for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.compute.manager [req-c3249743-6e90-40f3-8b55-a784e9ddf798 req-18f4f22f-b193-4bc1-85e3-ee36c53aaf4c service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-vif-plugged-23684bac-dba0-4fdd-80d3-750ed2a77731 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c3249743-6e90-40f3-8b55-a784e9ddf798 req-18f4f22f-b193-4bc1-85e3-ee36c53aaf4c service nova] Acquiring lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c3249743-6e90-40f3-8b55-a784e9ddf798 req-18f4f22f-b193-4bc1-85e3-ee36c53aaf4c service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c3249743-6e90-40f3-8b55-a784e9ddf798 req-18f4f22f-b193-4bc1-85e3-ee36c53aaf4c service nova] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.compute.manager [req-c3249743-6e90-40f3-8b55-a784e9ddf798 req-18f4f22f-b193-4bc1-85e3-ee36c53aaf4c service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] No waiting events found dispatching network-vif-plugged-23684bac-dba0-4fdd-80d3-750ed2a77731 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:33:18 user nova-compute[74247]: WARNING nova.compute.manager [req-c3249743-6e90-40f3-8b55-a784e9ddf798 req-18f4f22f-b193-4bc1-85e3-ee36c53aaf4c service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received unexpected event network-vif-plugged-23684bac-dba0-4fdd-80d3-750ed2a77731 for instance with vm_state active and task_state deleting.
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=be468974-d9be-43f9-8ddb-11e972368d36) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:18 user nova-compute[74247]: INFO os_vif [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:8d:af,bridge_name='br-int',has_traffic_filtering=True,id=1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec,network=Network(ac267af4-73e2-437a-b1a6-e0ae2497cad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dbd4bf3-bf')
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T18:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1643831507',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1643831507',id=15,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBhF0sANZ/03xGnSsBlEhP5xqrLOn5YswxiMH0tVkN+k8phJyrEolhCxz6XLBZpBa0d6HcDDQLwP5W1UWE8yHjqqf3zr4EZl5QHQHaRViQLiasvsmm1YXaTvkU2/aD2JQ==',key_name='tempest-keypair-1285773862',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:31:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b90038686fba435a8e52f00df40b3ebb',ramdisk_id='',reservation_id='r-61ak5fxw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-758290026',owner_user_name='tempest-TaggedBootDevicesTest_v242-758290026-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:31:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7ccba53dfe84ade9e0ce346b9eb3420',uuid=7fa3da6f-ba9f-4752-901a-933427fcbda8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5", "address": "fa:16:3e:73:c9:16", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9f5274-68", "ovs_interfaceid": "2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Converting VIF {"id": "2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5", "address": "fa:16:3e:73:c9:16", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9f5274-68", "ovs_interfaceid": "2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:c9:16,bridge_name='br-int',has_traffic_filtering=True,id=2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5,network=Network(ac267af4-73e2-437a-b1a6-e0ae2497cad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f9f5274-68') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG os_vif [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:c9:16,bridge_name='br-int',has_traffic_filtering=True,id=2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5,network=Network(ac267af4-73e2-437a-b1a6-e0ae2497cad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f9f5274-68') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f9f5274-68, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=16ff2474-4d18-480d-af52-33cda6e779a5) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:18 user nova-compute[74247]: INFO os_vif [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:c9:16,bridge_name='br-int',has_traffic_filtering=True,id=2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5,network=Network(ac267af4-73e2-437a-b1a6-e0ae2497cad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f9f5274-68')
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T18:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1643831507',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1643831507',id=15,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBhF0sANZ/03xGnSsBlEhP5xqrLOn5YswxiMH0tVkN+k8phJyrEolhCxz6XLBZpBa0d6HcDDQLwP5W1UWE8yHjqqf3zr4EZl5QHQHaRViQLiasvsmm1YXaTvkU2/aD2JQ==',key_name='tempest-keypair-1285773862',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:31:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b90038686fba435a8e52f00df40b3ebb',ramdisk_id='',reservation_id='r-61ak5fxw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-758290026',owner_user_name='tempest-TaggedBootDevicesTest_v242-758290026-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:31:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7ccba53dfe84ade9e0ce346b9eb3420',uuid=7fa3da6f-ba9f-4752-901a-933427fcbda8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a815917f-f1ec-48f2-b272-97bf2ad1d6cd", "address": "fa:16:3e:22:3b:ee", "network": {"id": "20ec901d-4e30-4c4a-ab56-7d57878cfdcc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1805797092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa815917f-f1", "ovs_interfaceid": "a815917f-f1ec-48f2-b272-97bf2ad1d6cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Converting VIF {"id": "a815917f-f1ec-48f2-b272-97bf2ad1d6cd", "address": "fa:16:3e:22:3b:ee", "network": {"id": "20ec901d-4e30-4c4a-ab56-7d57878cfdcc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1805797092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa815917f-f1", "ovs_interfaceid": "a815917f-f1ec-48f2-b272-97bf2ad1d6cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:3b:ee,bridge_name='br-int',has_traffic_filtering=True,id=a815917f-f1ec-48f2-b272-97bf2ad1d6cd,network=Network(20ec901d-4e30-4c4a-ab56-7d57878cfdcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa815917f-f1') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG os_vif [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:3b:ee,bridge_name='br-int',has_traffic_filtering=True,id=a815917f-f1ec-48f2-b272-97bf2ad1d6cd,network=Network(20ec901d-4e30-4c4a-ab56-7d57878cfdcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa815917f-f1') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa815917f-f1, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f0bcead6-3f24-4517-a3c6-61b9a8c0d083) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:18 user nova-compute[74247]: INFO os_vif [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:3b:ee,bridge_name='br-int',has_traffic_filtering=True,id=a815917f-f1ec-48f2-b272-97bf2ad1d6cd,network=Network(20ec901d-4e30-4c4a-ab56-7d57878cfdcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa815917f-f1')
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T18:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1643831507',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1643831507',id=15,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBhF0sANZ/03xGnSsBlEhP5xqrLOn5YswxiMH0tVkN+k8phJyrEolhCxz6XLBZpBa0d6HcDDQLwP5W1UWE8yHjqqf3zr4EZl5QHQHaRViQLiasvsmm1YXaTvkU2/aD2JQ==',key_name='tempest-keypair-1285773862',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:31:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b90038686fba435a8e52f00df40b3ebb',ramdisk_id='',reservation_id='r-61ak5fxw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-758290026',owner_user_name='tempest-TaggedBootDevicesTest_v242-758290026-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:31:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7ccba53dfe84ade9e0ce346b9eb3420',uuid=7fa3da6f-ba9f-4752-901a-933427fcbda8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23684bac-dba0-4fdd-80d3-750ed2a77731", "address": "fa:16:3e:46:79:42", "network": {"id": "20ec901d-4e30-4c4a-ab56-7d57878cfdcc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1805797092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23684bac-db", "ovs_interfaceid": "23684bac-dba0-4fdd-80d3-750ed2a77731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Converting VIF {"id": "23684bac-dba0-4fdd-80d3-750ed2a77731", "address": "fa:16:3e:46:79:42", "network": {"id": "20ec901d-4e30-4c4a-ab56-7d57878cfdcc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1805797092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23684bac-db", "ovs_interfaceid": "23684bac-dba0-4fdd-80d3-750ed2a77731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:79:42,bridge_name='br-int',has_traffic_filtering=True,id=23684bac-dba0-4fdd-80d3-750ed2a77731,network=Network(20ec901d-4e30-4c4a-ab56-7d57878cfdcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23684bac-db') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG os_vif [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:79:42,bridge_name='br-int',has_traffic_filtering=True,id=23684bac-dba0-4fdd-80d3-750ed2a77731,network=Network(20ec901d-4e30-4c4a-ab56-7d57878cfdcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23684bac-db') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23684bac-db, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aaedf15e-a3f9-47f4-81d9-7e088dd0933e) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:33:18 user nova-compute[74247]: INFO os_vif [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:79:42,bridge_name='br-int',has_traffic_filtering=True,id=23684bac-dba0-4fdd-80d3-750ed2a77731,network=Network(20ec901d-4e30-4c4a-ab56-7d57878cfdcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23684bac-db')
Oct 16 18:33:18 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BykpOTxh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:33:18 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:33:18 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e262975b-d96c-4e26-b520-1287624562f7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 18:33:18 user nova-compute[74247]: No targets found.
Oct 16 18:33:18 user nova-compute[74247]: iSNS:
Oct 16 18:33:18 user nova-compute[74247]: No targets found.
Oct 16 18:33:18 user nova-compute[74247]: STATIC:
Oct 16 18:33:18 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2
Oct 16 18:33:18 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:33:18 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:33:18 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6
Oct 16 18:33:18 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:33:18 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:33:18 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313
Oct 16 18:33:18 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:33:18 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:33:18 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a
Oct 16 18:33:18 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:33:18 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:33:18 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e
Oct 16 18:33:18 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:33:18 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:33:18 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93
Oct 16 18:33:18 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:33:18 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:33:18 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a
Oct 16 18:33:18 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:33:18 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:33:18 user nova-compute[74247]: FIRMWARE:
Oct 16 18:33:18 user nova-compute[74247]: No targets found.
Oct 16 18:33:18 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 18:33:18 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 18:33:18 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a80ccc-af04-4e3a-b381-887513347dbe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a5b98e-d3e4-4515-90aa-17b307171180]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:33:19 user nova-compute[74247]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)
Oct 16 18:33:19 user nova-compute[74247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:33:19 user nova-compute[74247]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a (non-flash)
Oct 16 18:33:19 user nova-compute[74247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 (non-flash)
Oct 16 18:33:19 user nova-compute[74247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a (non-flash)
Oct 16 18:33:19 user nova-compute[74247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e (non-flash)
Oct 16 18:33:19 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:33:19 user nova-compute[74247]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)
Oct 16 18:33:19 user nova-compute[74247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:33:19 user nova-compute[74247]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a (non-flash)
Oct 16 18:33:19 user nova-compute[74247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 (non-flash)
Oct 16 18:33:19 user nova-compute[74247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a (non-flash)
Oct 16 18:33:19 user nova-compute[74247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e (non-flash)
Oct 16 18:33:19 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe048798ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2'): ({'sdf'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Removing single pathed devices sdf {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[857e53e0-480a-47c9-aec4-6c9f4c04735b]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[625cd9ef-e307-4ec1-b672-0ed04ae58692]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Flushing IO for device /dev/sdf {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[41451734-7e3b-4129-baa9-3ea2aef03c19]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f3c08f-cafd-4e57-97fa-97d08d750162]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] SCSI volumes sdf have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9716037-e995-4d99-a76e-22095ecc69f9]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4a93b7-42b6-4ebf-a9ab-a10f597f1e7b]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2, portal: 172.16.0.220,3260]
Oct 16 18:33:19 user nova-compute[74247]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2, portal: 172.16.0.220,3260] successful.
Oct 16 18:33:19 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:012ad1ce-7193-4cf7-918c-d9cf4b9beba2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea983b5-1216-43d5-9392-ea31ac5349c8]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] <== disconnect_volume: return (359ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GwyhIJsQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:33:19 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2122152b-bb1a-45ae-961c-c4ee7b784ceb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 18:33:19 user nova-compute[74247]: No targets found.
Oct 16 18:33:19 user nova-compute[74247]: iSNS:
Oct 16 18:33:19 user nova-compute[74247]: No targets found.
Oct 16 18:33:19 user nova-compute[74247]: STATIC:
Oct 16 18:33:19 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6
Oct 16 18:33:19 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:33:19 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:33:19 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313
Oct 16 18:33:19 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:33:19 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:33:19 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a
Oct 16 18:33:19 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:33:19 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:33:19 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e
Oct 16 18:33:19 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:33:19 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:33:19 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93
Oct 16 18:33:19 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:33:19 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:33:19 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a
Oct 16 18:33:19 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:33:19 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:33:19 user nova-compute[74247]: FIRMWARE:
Oct 16 18:33:19 user nova-compute[74247]: No targets found.
Oct 16 18:33:19 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 18:33:19 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 18:33:19 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf5ed55-d44d-452a-a522-c67bee5d741a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd09b6b2-5198-43ee-a5f9-168772673014]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:33:19 user nova-compute[74247]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)
Oct 16 18:33:19 user nova-compute[74247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:33:19 user nova-compute[74247]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a (non-flash)
Oct 16 18:33:19 user nova-compute[74247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a (non-flash)
Oct 16 18:33:19 user nova-compute[74247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e (non-flash)
Oct 16 18:33:19 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:33:19 user nova-compute[74247]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 (non-flash)
Oct 16 18:33:19 user nova-compute[74247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:33:19 user nova-compute[74247]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a (non-flash)
Oct 16 18:33:19 user nova-compute[74247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a (non-flash)
Oct 16 18:33:19 user nova-compute[74247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e (non-flash)
Oct 16 18:33:19 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe048798ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93'): ({'sdc'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Removing single pathed devices sdc {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[892d830d-1543-4b34-be0f-0ebe0c52ca60]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[01005953-1347-4445-aa02-d62b872f8f3d]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Flushing IO for device /dev/sdc {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0483537d-198a-4db2-9f76-9f50c1871122]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.031s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65cad29-a56b-45ed-bb4f-9fb255ab0270]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] SCSI volumes sdc have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb79604-6f82-4535-9b9d-11847f0bfa14]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fffacc4-d62b-4208-a1f5-ee787e05702f]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93, portal: 172.16.0.220,3260]
Oct 16 18:33:19 user nova-compute[74247]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93, portal: 172.16.0.220,3260] successful.
Oct 16 18:33:19 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e2502cf-023d-406e-8618-c7c75907ae93 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f8807c-861b-4259-a7ae-52fca2527b84]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] <== disconnect_volume: return (320ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LwIOgWPD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:33:19 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ad7562-eb29-4b09-bf70-14cee942ce14]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 18:33:19 user nova-compute[74247]: No targets found.
Oct 16 18:33:19 user nova-compute[74247]: iSNS:
Oct 16 18:33:19 user nova-compute[74247]: No targets found.
Oct 16 18:33:19 user nova-compute[74247]: STATIC:
Oct 16 18:33:19 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6
Oct 16 18:33:19 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:33:19 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:33:19 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313
Oct 16 18:33:19 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:33:19 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:33:19 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a
Oct 16 18:33:19 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:33:19 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:33:19 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e
Oct 16 18:33:19 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:33:19 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:33:19 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a
Oct 16 18:33:19 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:33:19 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:33:19 user nova-compute[74247]: FIRMWARE:
Oct 16 18:33:19 user nova-compute[74247]: No targets found.
Oct 16 18:33:19 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 18:33:19 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 18:33:19 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc51a94e-41a3-4391-b561-6c1f618fc369]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[afee6681-4534-48f9-a0f8-52daf417f154]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:33:19 user nova-compute[74247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:33:19 user nova-compute[74247]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a (non-flash)
Oct 16 18:33:19 user nova-compute[74247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a (non-flash)
Oct 16 18:33:19 user nova-compute[74247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e (non-flash)
Oct 16 18:33:19 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:33:19 user nova-compute[74247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:33:19 user nova-compute[74247]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a (non-flash)
Oct 16 18:33:19 user nova-compute[74247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a (non-flash)
Oct 16 18:33:19 user nova-compute[74247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e (non-flash)
Oct 16 18:33:19 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe048443250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a'): ({'sde'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Removing single pathed devices sde {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c29f4c-e9e1-426c-81e7-30ab970c7a87]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7547f32-c84c-47c1-a3aa-bba770cc44cb]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Flushing IO for device /dev/sde {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d976d4b-e23c-4de1-93ae-4627276bff96]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07d6486-bdd7-4a91-9832-824a3b947da6]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] SCSI volumes sde have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f61c196-81eb-47d7-b6e0-76d2ae1c42e6]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16f4448-4162-4f06-bff8-5799099b9a2d]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a, portal: 172.16.0.220,3260]
Oct 16 18:33:19 user nova-compute[74247]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a, portal: 172.16.0.220,3260] successful.
Oct 16 18:33:19 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8274378-306d-460c-82c3-abda468dd73a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bfd9fb-7e39-4e81-a48d-d1a913891880]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] <== disconnect_volume: return (329ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 18:33:19 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Deleting instance files /opt/stack/data/nova/instances/7fa3da6f-ba9f-4752-901a-933427fcbda8_del
Oct 16 18:33:19 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Deletion of /opt/stack/data/nova/instances/7fa3da6f-ba9f-4752-901a-933427fcbda8_del complete
Oct 16 18:33:19 user nova-compute[74247]: INFO nova.compute.manager [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Took 3.68 seconds to destroy the instance on the hypervisor.
Oct 16 18:33:19 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 18:33:19 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 18:33:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "ed343632-72bc-40f0-9698-fe4bd67c56d7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:33:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "ed343632-72bc-40f0-9698-fe4bd67c56d7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:33:21 user nova-compute[74247]: DEBUG nova.compute.manager [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 18:33:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:33:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:33:21 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:33:21 user nova-compute[74247]: INFO nova.compute.claims [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Claim successful on node user
Oct 16 18:33:21 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:33:21 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:33:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.399s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:33:21 user nova-compute[74247]: DEBUG nova.compute.manager [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 18:33:21 user nova-compute[74247]: DEBUG nova.compute.manager [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 18:33:21 user nova-compute[74247]: DEBUG nova.network.neutron [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 18:33:21 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 18:33:21 user nova-compute[74247]: DEBUG nova.compute.manager [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 18:33:22 user nova-compute[74247]: DEBUG nova.policy [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5bd70613da1f489f86227655ff364795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96ced9d4c0c474fbc7edeed6f73324a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 18:33:22 user nova-compute[74247]: DEBUG nova.compute.manager [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 18:33:22 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:33:22 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Creating image(s)
Oct 16 18:33:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed343632-72bc-40f0-9698-fe4bd67c56d7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:33:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "/opt/stack/data/nova/instances/ed343632-72bc-40f0-9698-fe4bd67c56d7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:33:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "/opt/stack/data/nova/instances/ed343632-72bc-40f0-9698-fe4bd67c56d7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:33:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:22 user nova-compute[74247]: DEBUG nova.compute.manager [req-aa4242cc-b8a1-4142-9e8b-200e6d1822f8 req-62fde511-1579-4fd2-b5bd-1d758c3612cd service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-vif-deleted-a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:33:22 user nova-compute[74247]: INFO nova.compute.manager [req-aa4242cc-b8a1-4142-9e8b-200e6d1822f8 req-62fde511-1579-4fd2-b5bd-1d758c3612cd service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Neutron deleted interface a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11; detaching it from the instance and deleting it from the info cache
Oct 16 18:33:22 user nova-compute[74247]: DEBUG nova.network.neutron [req-aa4242cc-b8a1-4142-9e8b-200e6d1822f8 req-62fde511-1579-4fd2-b5bd-1d758c3612cd service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Updating instance_info_cache with network_info: [{"id": "40eb3a07-e825-44ad-9077-c1880b1e8768", "address": "fa:16:3e:ef:f1:d7", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40eb3a07-e8", "ovs_interfaceid": "40eb3a07-e825-44ad-9077-c1880b1e8768", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2813ff58-0b02-4da1-8774-ad7452da7d78", "address": "fa:16:3e:56:f0:e9", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2813ff58-0b", "ovs_interfaceid": "2813ff58-0b02-4da1-8774-ad7452da7d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec", "address": "fa:16:3e:32:8d:af", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dbd4bf3-bf", "ovs_interfaceid": "1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5", "address": "fa:16:3e:73:c9:16", "network": {"id": "ac267af4-73e2-437a-b1a6-e0ae2497cad9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1597212891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9f5274-68", "ovs_interfaceid": "2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a815917f-f1ec-48f2-b272-97bf2ad1d6cd", "address": "fa:16:3e:22:3b:ee", "network": {"id": "20ec901d-4e30-4c4a-ab56-7d57878cfdcc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1805797092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa815917f-f1", "ovs_interfaceid": "a815917f-f1ec-48f2-b272-97bf2ad1d6cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23684bac-dba0-4fdd-80d3-750ed2a77731", "address": "fa:16:3e:46:79:42", "network": {"id": "20ec901d-4e30-4c4a-ab56-7d57878cfdcc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1805797092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b90038686fba435a8e52f00df40b3ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23684bac-db", "ovs_interfaceid": "23684bac-dba0-4fdd-80d3-750ed2a77731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:33:22 user nova-compute[74247]: DEBUG nova.compute.manager [req-aa4242cc-b8a1-4142-9e8b-200e6d1822f8 req-62fde511-1579-4fd2-b5bd-1d758c3612cd service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Detach interface failed, port_id=a4ea7e01-7ec8-4ad3-ab1b-3b4a7a4ecb11, reason: Instance 7fa3da6f-ba9f-4752-901a-933427fcbda8 could not be found. {{(pid=74247) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 18:33:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.175s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "37399febbd18f60b85fd0f833558f6a3539ab231" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:33:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:33:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.183s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/ed343632-72bc-40f0-9698-fe4bd67c56d7/disk 1073741824 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/ed343632-72bc-40f0-9698-fe4bd67c56d7/disk 1073741824" returned: 0 in 0.054s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:33:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.187s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:22 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ed343632-72bc-40f0-9698-fe4bd67c56d7/disk. size=1073741824 {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 18:33:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed343632-72bc-40f0-9698-fe4bd67c56d7/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed343632-72bc-40f0-9698-fe4bd67c56d7/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:22 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Cannot resize image /opt/stack/data/nova/instances/ed343632-72bc-40f0-9698-fe4bd67c56d7/disk to a smaller size. {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 18:33:22 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 18:33:22 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Ensure instance console log exists: /opt/stack/data/nova/instances/ed343632-72bc-40f0-9698-fe4bd67c56d7/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:33:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:33:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:33:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:33:23 user nova-compute[74247]: DEBUG nova.network.neutron [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Successfully created port: 819231ee-2f65-441d-b02b-57ef317f0e1e {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:33:23 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:33:23 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Took 3.65 seconds to deallocate network for instance.
Oct 16 18:33:23 user nova-compute[74247]: DEBUG nova.network.neutron [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Successfully updated port: 819231ee-2f65-441d-b02b-57ef317f0e1e {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:33:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "refresh_cache-ed343632-72bc-40f0-9698-fe4bd67c56d7" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:33:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquired lock "refresh_cache-ed343632-72bc-40f0-9698-fe4bd67c56d7" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:33:23 user nova-compute[74247]: DEBUG nova.network.neutron [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:33:23 user nova-compute[74247]: DEBUG nova.compute.manager [req-0bbe651f-6cec-4b82-aa23-531803a69b9d req-f2fedbab-353c-4fe1-97ae-292abc951d69 service nova] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Received event network-changed-819231ee-2f65-441d-b02b-57ef317f0e1e {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:33:23 user nova-compute[74247]: DEBUG nova.compute.manager [req-0bbe651f-6cec-4b82-aa23-531803a69b9d req-f2fedbab-353c-4fe1-97ae-292abc951d69 service nova] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Refreshing instance network info cache due to event network-changed-819231ee-2f65-441d-b02b-57ef317f0e1e. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:33:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0bbe651f-6cec-4b82-aa23-531803a69b9d req-f2fedbab-353c-4fe1-97ae-292abc951d69 service nova] Acquiring lock "refresh_cache-ed343632-72bc-40f0-9698-fe4bd67c56d7" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:33:23 user nova-compute[74247]: DEBUG nova.network.neutron [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:33:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG nova.network.neutron [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Updating instance_info_cache with network_info: [{"id": "819231ee-2f65-441d-b02b-57ef317f0e1e", "address": "fa:16:3e:69:eb:2e", "network": {"id": "fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1988491128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96ced9d4c0c474fbc7edeed6f73324a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap819231ee-2f", "ovs_interfaceid": "819231ee-2f65-441d-b02b-57ef317f0e1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Releasing lock "refresh_cache-ed343632-72bc-40f0-9698-fe4bd67c56d7" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG nova.compute.manager [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Instance network_info: |[{"id": "819231ee-2f65-441d-b02b-57ef317f0e1e", "address": "fa:16:3e:69:eb:2e", "network": {"id": "fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1988491128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96ced9d4c0c474fbc7edeed6f73324a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap819231ee-2f", "ovs_interfaceid": "819231ee-2f65-441d-b02b-57ef317f0e1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0bbe651f-6cec-4b82-aa23-531803a69b9d req-f2fedbab-353c-4fe1-97ae-292abc951d69 service nova] Acquired lock "refresh_cache-ed343632-72bc-40f0-9698-fe4bd67c56d7" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG nova.network.neutron [req-0bbe651f-6cec-4b82-aa23-531803a69b9d req-f2fedbab-353c-4fe1-97ae-292abc951d69 service nova] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Refreshing network info cache for port 819231ee-2f65-441d-b02b-57ef317f0e1e {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Start _get_guest_xml network_info=[{"id": "819231ee-2f65-441d-b02b-57ef317f0e1e", "address": "fa:16:3e:69:eb:2e", "network": {"id": "fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1988491128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96ced9d4c0c474fbc7edeed6f73324a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap819231ee-2f", "ovs_interfaceid": "819231ee-2f65-441d-b02b-57ef317f0e1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': '83126bb1-29f5-42fe-8620-72ab0797f776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:33:24 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:33:24 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:33:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:33:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-66152859',display_name='tempest-AttachVolumeNegativeTest-server-66152859',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-66152859',id=21,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+BQnWXCr6juEzLQ9elUzo2VhDYD9XdUJOq42txq/yR3B32aUKTk8SDwxKLzugG5SBLiaM3QGcRGxzEfVJ+hRLbj2uYOfVA2F26nK6uVHGBoOWFBwJZNowi1hAOBVb9+A==',key_name='tempest-keypair-638332018',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c96ced9d4c0c474fbc7edeed6f73324a',ramdisk_id='',reservation_id='r-cktorekz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1731725928',owner_user_name='tempest-AttachVolumeNegativeTest-1731725928-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:33:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bd70613da1f489f86227655ff364795',uuid=ed343632-72bc-40f0-9698-fe4bd67c56d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "819231ee-2f65-441d-b02b-57ef317f0e1e", "address": "fa:16:3e:69:eb:2e", "network": {"id": "fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1988491128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96ced9d4c0c474fbc7edeed6f73324a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap819231ee-2f", "ovs_interfaceid": "819231ee-2f65-441d-b02b-57ef317f0e1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Converting VIF {"id": "819231ee-2f65-441d-b02b-57ef317f0e1e", "address": "fa:16:3e:69:eb:2e", "network": {"id": "fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1988491128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96ced9d4c0c474fbc7edeed6f73324a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap819231ee-2f", "ovs_interfaceid": "819231ee-2f65-441d-b02b-57ef317f0e1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:eb:2e,bridge_name='br-int',has_traffic_filtering=True,id=819231ee-2f65-441d-b02b-57ef317f0e1e,network=Network(fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap819231ee-2f') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG nova.objects.instance [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lazy-loading 'pci_devices' on Instance uuid ed343632-72bc-40f0-9698-fe4bd67c56d7 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG nova.compute.manager [req-b38475ce-5b95-455d-900e-a1ed40a6a527 req-8e435716-0ad2-46ee-bda0-c5129be5973c service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-vif-deleted-1dbd4bf3-bf9b-4e53-8b0c-1af92debf0ec {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG nova.compute.manager [req-b38475ce-5b95-455d-900e-a1ed40a6a527 req-8e435716-0ad2-46ee-bda0-c5129be5973c service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-vif-deleted-2f9f5274-68ee-4fad-9486-6e2e9d3d4ec5 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG nova.compute.manager [req-b38475ce-5b95-455d-900e-a1ed40a6a527 req-8e435716-0ad2-46ee-bda0-c5129be5973c service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-vif-deleted-23684bac-dba0-4fdd-80d3-750ed2a77731 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG nova.compute.manager [req-b38475ce-5b95-455d-900e-a1ed40a6a527 req-8e435716-0ad2-46ee-bda0-c5129be5973c service nova] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Received event network-vif-deleted-a815917f-f1ec-48f2-b272-97bf2ad1d6cd {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:33:24 user nova-compute[74247]:   <uuid>ed343632-72bc-40f0-9698-fe4bd67c56d7</uuid>
Oct 16 18:33:24 user nova-compute[74247]:   <name>instance-00000015</name>
Oct 16 18:33:24 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:33:24 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:33:24 user nova-compute[74247]:   <metadata>
Oct 16 18:33:24 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:33:24 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:33:24 user nova-compute[74247]:       <nova:name>tempest-AttachVolumeNegativeTest-server-66152859</nova:name>
Oct 16 18:33:24 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:33:24</nova:creationTime>
Oct 16 18:33:24 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:33:24 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:33:24 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:33:24 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:33:24 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:33:24 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:33:24 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:33:24 user nova-compute[74247]:       <nova:owner>
Oct 16 18:33:24 user nova-compute[74247]:         <nova:user uuid="5bd70613da1f489f86227655ff364795">tempest-AttachVolumeNegativeTest-1731725928-project-member</nova:user>
Oct 16 18:33:24 user nova-compute[74247]:         <nova:project uuid="c96ced9d4c0c474fbc7edeed6f73324a">tempest-AttachVolumeNegativeTest-1731725928</nova:project>
Oct 16 18:33:24 user nova-compute[74247]:       </nova:owner>
Oct 16 18:33:24 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:33:24 user nova-compute[74247]:       <nova:ports>
Oct 16 18:33:24 user nova-compute[74247]:         <nova:port uuid="819231ee-2f65-441d-b02b-57ef317f0e1e">
Oct 16 18:33:24 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 16 18:33:24 user nova-compute[74247]:         </nova:port>
Oct 16 18:33:24 user nova-compute[74247]:       </nova:ports>
Oct 16 18:33:24 user nova-compute[74247]:     </nova:instance>
Oct 16 18:33:24 user nova-compute[74247]:   </metadata>
Oct 16 18:33:24 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:33:24 user nova-compute[74247]:     <system>
Oct 16 18:33:24 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:33:24 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:33:24 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:33:24 user nova-compute[74247]:       <entry name="serial">ed343632-72bc-40f0-9698-fe4bd67c56d7</entry>
Oct 16 18:33:24 user nova-compute[74247]:       <entry name="uuid">ed343632-72bc-40f0-9698-fe4bd67c56d7</entry>
Oct 16 18:33:24 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:33:24 user nova-compute[74247]:     </system>
Oct 16 18:33:24 user nova-compute[74247]:   </sysinfo>
Oct 16 18:33:24 user nova-compute[74247]:   <os>
Oct 16 18:33:24 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:33:24 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:33:24 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:33:24 user nova-compute[74247]:   </os>
Oct 16 18:33:24 user nova-compute[74247]:   <features>
Oct 16 18:33:24 user nova-compute[74247]:     <acpi/>
Oct 16 18:33:24 user nova-compute[74247]:     <apic/>
Oct 16 18:33:24 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:33:24 user nova-compute[74247]:   </features>
Oct 16 18:33:24 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:33:24 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:33:24 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:33:24 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:33:24 user nova-compute[74247]:   </clock>
Oct 16 18:33:24 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:33:24 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:33:24 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:33:24 user nova-compute[74247]:   </cpu>
Oct 16 18:33:24 user nova-compute[74247]:   <devices>
Oct 16 18:33:24 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:33:24 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:33:24 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/ed343632-72bc-40f0-9698-fe4bd67c56d7/disk"/>
Oct 16 18:33:24 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:33:24 user nova-compute[74247]:     </disk>
Oct 16 18:33:24 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:33:24 user nova-compute[74247]:       <mac address="fa:16:3e:69:eb:2e"/>
Oct 16 18:33:24 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:33:24 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:33:24 user nova-compute[74247]:       <target dev="tap819231ee-2f"/>
Oct 16 18:33:24 user nova-compute[74247]:     </interface>
Oct 16 18:33:24 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:33:24 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/ed343632-72bc-40f0-9698-fe4bd67c56d7/console.log" append="off"/>
Oct 16 18:33:24 user nova-compute[74247]:     </serial>
Oct 16 18:33:24 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:33:24 user nova-compute[74247]:     <video>
Oct 16 18:33:24 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:33:24 user nova-compute[74247]:     </video>
Oct 16 18:33:24 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:33:24 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:33:24 user nova-compute[74247]:     </rng>
Oct 16 18:33:24 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:33:24 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:33:24 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:33:24 user nova-compute[74247]:     </memballoon>
Oct 16 18:33:24 user nova-compute[74247]:   </devices>
Oct 16 18:33:24 user nova-compute[74247]: </domain>
Oct 16 18:33:24 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:33:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-66152859',display_name='tempest-AttachVolumeNegativeTest-server-66152859',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-66152859',id=21,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+BQnWXCr6juEzLQ9elUzo2VhDYD9XdUJOq42txq/yR3B32aUKTk8SDwxKLzugG5SBLiaM3QGcRGxzEfVJ+hRLbj2uYOfVA2F26nK6uVHGBoOWFBwJZNowi1hAOBVb9+A==',key_name='tempest-keypair-638332018',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c96ced9d4c0c474fbc7edeed6f73324a',ramdisk_id='',reservation_id='r-cktorekz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1731725928',owner_user_name='tempest-AttachVolumeNegativeTest-1731725928-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:33:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bd70613da1f489f86227655ff364795',uuid=ed343632-72bc-40f0-9698-fe4bd67c56d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "819231ee-2f65-441d-b02b-57ef317f0e1e", "address": "fa:16:3e:69:eb:2e", "network": {"id": "fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1988491128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96ced9d4c0c474fbc7edeed6f73324a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap819231ee-2f", "ovs_interfaceid": "819231ee-2f65-441d-b02b-57ef317f0e1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Converting VIF {"id": "819231ee-2f65-441d-b02b-57ef317f0e1e", "address": "fa:16:3e:69:eb:2e", "network": {"id": "fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1988491128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96ced9d4c0c474fbc7edeed6f73324a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap819231ee-2f", "ovs_interfaceid": "819231ee-2f65-441d-b02b-57ef317f0e1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:eb:2e,bridge_name='br-int',has_traffic_filtering=True,id=819231ee-2f65-441d-b02b-57ef317f0e1e,network=Network(fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap819231ee-2f') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG os_vif [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:eb:2e,bridge_name='br-int',has_traffic_filtering=True,id=819231ee-2f65-441d-b02b-57ef317f0e1e,network=Network(fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap819231ee-2f') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb0ee105-44e9-531d-b630-91d51e3489e6', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap819231ee-2f, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap819231ee-2f, col_values=(('qos', UUID('eef056ba-7f14-4e2a-b33d-10c400014f5d')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap819231ee-2f, col_values=(('external_ids', {'iface-id': '819231ee-2f65-441d-b02b-57ef317f0e1e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:eb:2e', 'vm-uuid': 'ed343632-72bc-40f0-9698-fe4bd67c56d7'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:24 user nova-compute[74247]: INFO os_vif [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:eb:2e,bridge_name='br-int',has_traffic_filtering=True,id=819231ee-2f65-441d-b02b-57ef317f0e1e,network=Network(fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap819231ee-2f')
Oct 16 18:33:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] No VIF found with MAC fa:16:3e:69:eb:2e, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG nova.network.neutron [req-0bbe651f-6cec-4b82-aa23-531803a69b9d req-f2fedbab-353c-4fe1-97ae-292abc951d69 service nova] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Updated VIF entry in instance network info cache for port 819231ee-2f65-441d-b02b-57ef317f0e1e. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG nova.network.neutron [req-0bbe651f-6cec-4b82-aa23-531803a69b9d req-f2fedbab-353c-4fe1-97ae-292abc951d69 service nova] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Updating instance_info_cache with network_info: [{"id": "819231ee-2f65-441d-b02b-57ef317f0e1e", "address": "fa:16:3e:69:eb:2e", "network": {"id": "fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1988491128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96ced9d4c0c474fbc7edeed6f73324a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap819231ee-2f", "ovs_interfaceid": "819231ee-2f65-441d-b02b-57ef317f0e1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:33:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0bbe651f-6cec-4b82-aa23-531803a69b9d req-f2fedbab-353c-4fe1-97ae-292abc951d69 service nova] Releasing lock "refresh_cache-ed343632-72bc-40f0-9698-fe4bd67c56d7" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:33:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:25 user nova-compute[74247]: DEBUG nova.compute.manager [req-9b5bcb72-4161-4076-be6f-17382b6d6d24 req-b50449c3-5b9f-4fe7-856a-cfa14144d45d service nova] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Received event network-vif-plugged-819231ee-2f65-441d-b02b-57ef317f0e1e {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:33:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9b5bcb72-4161-4076-be6f-17382b6d6d24 req-b50449c3-5b9f-4fe7-856a-cfa14144d45d service nova] Acquiring lock "ed343632-72bc-40f0-9698-fe4bd67c56d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:33:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9b5bcb72-4161-4076-be6f-17382b6d6d24 req-b50449c3-5b9f-4fe7-856a-cfa14144d45d service nova] Lock "ed343632-72bc-40f0-9698-fe4bd67c56d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:33:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9b5bcb72-4161-4076-be6f-17382b6d6d24 req-b50449c3-5b9f-4fe7-856a-cfa14144d45d service nova] Lock "ed343632-72bc-40f0-9698-fe4bd67c56d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:33:25 user nova-compute[74247]: DEBUG nova.compute.manager [req-9b5bcb72-4161-4076-be6f-17382b6d6d24 req-b50449c3-5b9f-4fe7-856a-cfa14144d45d service nova] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] No waiting events found dispatching network-vif-plugged-819231ee-2f65-441d-b02b-57ef317f0e1e {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:33:25 user nova-compute[74247]: WARNING nova.compute.manager [req-9b5bcb72-4161-4076-be6f-17382b6d6d24 req-b50449c3-5b9f-4fe7-856a-cfa14144d45d service nova] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Received unexpected event network-vif-plugged-819231ee-2f65-441d-b02b-57ef317f0e1e for instance with vm_state building and task_state spawning.
Oct 16 18:33:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:26 user nova-compute[74247]: INFO nova.compute.manager [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] [instance: 7fa3da6f-ba9f-4752-901a-933427fcbda8] Took 2.63 seconds to detach 3 volumes for instance.
Oct 16 18:33:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:33:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:33:26 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:33:26 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:33:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.386s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:33:26 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Deleted allocations for instance 7fa3da6f-ba9f-4752-901a-933427fcbda8
Oct 16 18:33:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-07510daf-6c61-4076-8214-25879022804c tempest-TaggedBootDevicesTest_v242-758290026 tempest-TaggedBootDevicesTest_v242-758290026-project-member] Lock "7fa3da6f-ba9f-4752-901a-933427fcbda8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.567s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:33:27 user nova-compute[74247]: DEBUG nova.compute.manager [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:33:27 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:33:27 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Instance spawned successfully.
Oct 16 18:33:27 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 18:33:27 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:33:27 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:33:27 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:33:27 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:33:27 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:33:27 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:33:27 user nova-compute[74247]: INFO nova.compute.manager [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Took 5.71 seconds to spawn the instance on the hypervisor.
Oct 16 18:33:27 user nova-compute[74247]: DEBUG nova.compute.manager [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:33:27 user nova-compute[74247]: DEBUG nova.compute.manager [req-6782ae60-035b-4d62-86b4-15cd6377da44 req-a357efbe-bd7e-496f-974b-041b51d3c413 service nova] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Received event network-vif-plugged-819231ee-2f65-441d-b02b-57ef317f0e1e {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:33:27 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-6782ae60-035b-4d62-86b4-15cd6377da44 req-a357efbe-bd7e-496f-974b-041b51d3c413 service nova] Acquiring lock "ed343632-72bc-40f0-9698-fe4bd67c56d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:33:27 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-6782ae60-035b-4d62-86b4-15cd6377da44 req-a357efbe-bd7e-496f-974b-041b51d3c413 service nova] Lock "ed343632-72bc-40f0-9698-fe4bd67c56d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:33:27 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-6782ae60-035b-4d62-86b4-15cd6377da44 req-a357efbe-bd7e-496f-974b-041b51d3c413 service nova] Lock "ed343632-72bc-40f0-9698-fe4bd67c56d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:33:27 user nova-compute[74247]: DEBUG nova.compute.manager [req-6782ae60-035b-4d62-86b4-15cd6377da44 req-a357efbe-bd7e-496f-974b-041b51d3c413 service nova] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] No waiting events found dispatching network-vif-plugged-819231ee-2f65-441d-b02b-57ef317f0e1e {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:33:27 user nova-compute[74247]: WARNING nova.compute.manager [req-6782ae60-035b-4d62-86b4-15cd6377da44 req-a357efbe-bd7e-496f-974b-041b51d3c413 service nova] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Received unexpected event network-vif-plugged-819231ee-2f65-441d-b02b-57ef317f0e1e for instance with vm_state building and task_state spawning.
Oct 16 18:33:27 user nova-compute[74247]: INFO nova.compute.manager [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Took 6.55 seconds to build instance.
Oct 16 18:33:27 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-b95e7ff4-48ce-4ee5-97d8-eb830d1cfe51 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "ed343632-72bc-40f0-9698-fe4bd67c56d7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.638s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:33:29 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:44 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:33:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:33:47 user nova-compute[74247]: DEBUG nova.compute.manager [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 18:33:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:33:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:33:47 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:33:47 user nova-compute[74247]: INFO nova.compute.claims [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Claim successful on node user
Oct 16 18:33:48 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:33:48 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:33:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.441s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:33:48 user nova-compute[74247]: DEBUG nova.compute.manager [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 18:33:48 user nova-compute[74247]: DEBUG nova.compute.manager [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 18:33:48 user nova-compute[74247]: DEBUG nova.network.neutron [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 18:33:48 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 18:33:48 user nova-compute[74247]: DEBUG nova.compute.manager [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 18:33:48 user nova-compute[74247]: DEBUG nova.policy [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b01d3e5d2fcb40bc92c3d2fe1236d509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce6164a392e4cc2a027d12c49145e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 18:33:48 user nova-compute[74247]: INFO nova.virt.block_device [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Booting with blank volume at /dev/vda
Oct 16 18:33:49 user nova-compute[74247]: DEBUG nova.network.neutron [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Successfully created port: b7a0865a-62eb-4517-83ba-eb30ff219e50 {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:33:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:49 user nova-compute[74247]: DEBUG nova.network.neutron [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Successfully updated port: b7a0865a-62eb-4517-83ba-eb30ff219e50 {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:33:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "refresh_cache-7dcc08e9-7439-436b-8d9f-facaf04e22c1" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:33:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquired lock "refresh_cache-7dcc08e9-7439-436b-8d9f-facaf04e22c1" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:33:49 user nova-compute[74247]: DEBUG nova.network.neutron [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:33:49 user nova-compute[74247]: DEBUG nova.compute.manager [req-1e1d73fb-8805-486b-828a-1aca8be2928b req-f14d4061-f9b6-4c1a-825a-a9d5724e36ff service nova] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Received event network-changed-b7a0865a-62eb-4517-83ba-eb30ff219e50 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:33:49 user nova-compute[74247]: DEBUG nova.compute.manager [req-1e1d73fb-8805-486b-828a-1aca8be2928b req-f14d4061-f9b6-4c1a-825a-a9d5724e36ff service nova] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Refreshing instance network info cache due to event network-changed-b7a0865a-62eb-4517-83ba-eb30ff219e50. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:33:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1e1d73fb-8805-486b-828a-1aca8be2928b req-f14d4061-f9b6-4c1a-825a-a9d5724e36ff service nova] Acquiring lock "refresh_cache-7dcc08e9-7439-436b-8d9f-facaf04e22c1" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:33:49 user nova-compute[74247]: DEBUG nova.network.neutron [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:33:50 user nova-compute[74247]: DEBUG nova.network.neutron [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Updating instance_info_cache with network_info: [{"id": "b7a0865a-62eb-4517-83ba-eb30ff219e50", "address": "fa:16:3e:47:07:5d", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a0865a-62", "ovs_interfaceid": "b7a0865a-62eb-4517-83ba-eb30ff219e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:33:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Releasing lock "refresh_cache-7dcc08e9-7439-436b-8d9f-facaf04e22c1" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:33:50 user nova-compute[74247]: DEBUG nova.compute.manager [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Instance network_info: |[{"id": "b7a0865a-62eb-4517-83ba-eb30ff219e50", "address": "fa:16:3e:47:07:5d", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a0865a-62", "ovs_interfaceid": "b7a0865a-62eb-4517-83ba-eb30ff219e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 18:33:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1e1d73fb-8805-486b-828a-1aca8be2928b req-f14d4061-f9b6-4c1a-825a-a9d5724e36ff service nova] Acquired lock "refresh_cache-7dcc08e9-7439-436b-8d9f-facaf04e22c1" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:33:50 user nova-compute[74247]: DEBUG nova.network.neutron [req-1e1d73fb-8805-486b-828a-1aca8be2928b req-f14d4061-f9b6-4c1a-825a-a9d5724e36ff service nova] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Refreshing network info cache for port b7a0865a-62eb-4517-83ba-eb30ff219e50 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:33:50 user nova-compute[74247]: DEBUG nova.network.neutron [req-1e1d73fb-8805-486b-828a-1aca8be2928b req-f14d4061-f9b6-4c1a-825a-a9d5724e36ff service nova] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Updated VIF entry in instance network info cache for port b7a0865a-62eb-4517-83ba-eb30ff219e50. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:33:50 user nova-compute[74247]: DEBUG nova.network.neutron [req-1e1d73fb-8805-486b-828a-1aca8be2928b req-f14d4061-f9b6-4c1a-825a-a9d5724e36ff service nova] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Updating instance_info_cache with network_info: [{"id": "b7a0865a-62eb-4517-83ba-eb30ff219e50", "address": "fa:16:3e:47:07:5d", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a0865a-62", "ovs_interfaceid": "b7a0865a-62eb-4517-83ba-eb30ff219e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:33:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1e1d73fb-8805-486b-828a-1aca8be2928b req-f14d4061-f9b6-4c1a-825a-a9d5724e36ff service nova] Releasing lock "refresh_cache-7dcc08e9-7439-436b-8d9f-facaf04e22c1" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:33:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:52 user nova-compute[74247]: INFO nova.compute.manager [None req-51a7eb39-ea5b-45f8-9d76-bf4be331888c tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Unrescuing
Oct 16 18:33:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-51a7eb39-ea5b-45f8-9d76-bf4be331888c tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Acquiring lock "refresh_cache-7c17a25b-6818-48fa-b406-638dbf1845d4" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:33:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-51a7eb39-ea5b-45f8-9d76-bf4be331888c tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Acquired lock "refresh_cache-7c17a25b-6818-48fa-b406-638dbf1845d4" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:33:52 user nova-compute[74247]: DEBUG nova.network.neutron [None req-51a7eb39-ea5b-45f8-9d76-bf4be331888c tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:33:52 user nova-compute[74247]: DEBUG nova.network.neutron [None req-51a7eb39-ea5b-45f8-9d76-bf4be331888c tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Updating instance_info_cache with network_info: [{"id": "5f5253f2-6e79-44f0-a4aa-167f273e7c6a", "address": "fa:16:3e:f9:f6:64", "network": {"id": "b8a52a8d-7eca-40b7-b94b-820a4ab8687b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1308054402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "021c1d91069e4798af2caae2c29694ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5253f2-6e", "ovs_interfaceid": "5f5253f2-6e79-44f0-a4aa-167f273e7c6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:33:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-51a7eb39-ea5b-45f8-9d76-bf4be331888c tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Releasing lock "refresh_cache-7c17a25b-6818-48fa-b406-638dbf1845d4" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:33:52 user nova-compute[74247]: DEBUG nova.objects.instance [None req-51a7eb39-ea5b-45f8-9d76-bf4be331888c tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lazy-loading 'flavor' on Instance uuid 7c17a25b-6818-48fa-b406-638dbf1845d4 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:33:52 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:52 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:52 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:52 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:53 user nova-compute[74247]: DEBUG nova.compute.manager [req-ea459a1c-68c7-46f0-a7e0-594b761d50f1 req-9b8e0074-0e6e-489a-9024-3e511bcc4faf service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Received event network-vif-unplugged-5f5253f2-6e79-44f0-a4aa-167f273e7c6a {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:33:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-ea459a1c-68c7-46f0-a7e0-594b761d50f1 req-9b8e0074-0e6e-489a-9024-3e511bcc4faf service nova] Acquiring lock "7c17a25b-6818-48fa-b406-638dbf1845d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:33:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-ea459a1c-68c7-46f0-a7e0-594b761d50f1 req-9b8e0074-0e6e-489a-9024-3e511bcc4faf service nova] Lock "7c17a25b-6818-48fa-b406-638dbf1845d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:33:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-ea459a1c-68c7-46f0-a7e0-594b761d50f1 req-9b8e0074-0e6e-489a-9024-3e511bcc4faf service nova] Lock "7c17a25b-6818-48fa-b406-638dbf1845d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:33:53 user nova-compute[74247]: DEBUG nova.compute.manager [req-ea459a1c-68c7-46f0-a7e0-594b761d50f1 req-9b8e0074-0e6e-489a-9024-3e511bcc4faf service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] No waiting events found dispatching network-vif-unplugged-5f5253f2-6e79-44f0-a4aa-167f273e7c6a {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:33:53 user nova-compute[74247]: WARNING nova.compute.manager [req-ea459a1c-68c7-46f0-a7e0-594b761d50f1 req-9b8e0074-0e6e-489a-9024-3e511bcc4faf service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Received unexpected event network-vif-unplugged-5f5253f2-6e79-44f0-a4aa-167f273e7c6a for instance with vm_state rescued and task_state unrescuing.
Oct 16 18:33:53 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Instance destroyed successfully.
Oct 16 18:33:54 user nova-compute[74247]: DEBUG os_brick.utils [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:33:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:54 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fd720f-bb71-42e2-9c95-d68d74bb2634]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:54 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d85ce85-c05b-4754-b150-ec10b329a5ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:54 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c780356-4437-4709-9dc4-28db263af87b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:54 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e37fb1-8580-4de7-8068-77d818547840]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:33:54 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:54 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 18:33:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:33:54 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 18:33:54 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3107f3ad-bce3-4e69-a73f-7eca299d2f4b]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:54 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 18:33:54 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 18:33:54 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 18:33:54 user nova-compute[74247]: DEBUG os_brick.utils [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:33:54 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Updating existing volume attachment record: 4d7fab72-cff3-4403-9111-f1244afea948 {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 18:33:54 user nova-compute[74247]: DEBUG nova.compute.manager [req-93c404db-2433-4f1b-a8a2-04fa4291dc06 req-55fc51d9-3f7a-4753-ad5a-522c1d574ccd service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Received event network-changed-5f5253f2-6e79-44f0-a4aa-167f273e7c6a {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:33:54 user nova-compute[74247]: DEBUG nova.compute.manager [req-93c404db-2433-4f1b-a8a2-04fa4291dc06 req-55fc51d9-3f7a-4753-ad5a-522c1d574ccd service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Refreshing instance network info cache due to event network-changed-5f5253f2-6e79-44f0-a4aa-167f273e7c6a. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:33:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-93c404db-2433-4f1b-a8a2-04fa4291dc06 req-55fc51d9-3f7a-4753-ad5a-522c1d574ccd service nova] Acquiring lock "refresh_cache-7c17a25b-6818-48fa-b406-638dbf1845d4" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:33:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-93c404db-2433-4f1b-a8a2-04fa4291dc06 req-55fc51d9-3f7a-4753-ad5a-522c1d574ccd service nova] Acquired lock "refresh_cache-7c17a25b-6818-48fa-b406-638dbf1845d4" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:33:54 user nova-compute[74247]: DEBUG nova.network.neutron [req-93c404db-2433-4f1b-a8a2-04fa4291dc06 req-55fc51d9-3f7a-4753-ad5a-522c1d574ccd service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Refreshing network info cache for port 5f5253f2-6e79-44f0-a4aa-167f273e7c6a {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:33:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Acquiring lock "a686ee86-272c-47be-8801-9c1500af272f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:33:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lock "a686ee86-272c-47be-8801-9c1500af272f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:33:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Acquiring lock "a686ee86-272c-47be-8801-9c1500af272f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:33:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lock "a686ee86-272c-47be-8801-9c1500af272f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:33:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lock "a686ee86-272c-47be-8801-9c1500af272f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:33:54 user nova-compute[74247]: INFO nova.compute.manager [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Terminating instance
Oct 16 18:33:54 user nova-compute[74247]: DEBUG nova.compute.manager [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 18:33:54 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:54 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:54 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:54 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:54 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:54 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:54 user nova-compute[74247]: DEBUG nova.compute.manager [req-f07bbd3c-4ad8-4238-b906-e0ad54783208 req-ba514214-fff7-4214-909a-8cebf3ed583e service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] Received event network-vif-unplugged-8cb168df-92d2-4ecc-946a-7d9075f75561 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:33:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f07bbd3c-4ad8-4238-b906-e0ad54783208 req-ba514214-fff7-4214-909a-8cebf3ed583e service nova] Acquiring lock "a686ee86-272c-47be-8801-9c1500af272f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:33:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f07bbd3c-4ad8-4238-b906-e0ad54783208 req-ba514214-fff7-4214-909a-8cebf3ed583e service nova] Lock "a686ee86-272c-47be-8801-9c1500af272f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:33:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f07bbd3c-4ad8-4238-b906-e0ad54783208 req-ba514214-fff7-4214-909a-8cebf3ed583e service nova] Lock "a686ee86-272c-47be-8801-9c1500af272f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:33:54 user nova-compute[74247]: DEBUG nova.compute.manager [req-f07bbd3c-4ad8-4238-b906-e0ad54783208 req-ba514214-fff7-4214-909a-8cebf3ed583e service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] No waiting events found dispatching network-vif-unplugged-8cb168df-92d2-4ecc-946a-7d9075f75561 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:33:54 user nova-compute[74247]: DEBUG nova.compute.manager [req-f07bbd3c-4ad8-4238-b906-e0ad54783208 req-ba514214-fff7-4214-909a-8cebf3ed583e service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] Received event network-vif-unplugged-8cb168df-92d2-4ecc-946a-7d9075f75561 for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG nova.network.neutron [req-93c404db-2433-4f1b-a8a2-04fa4291dc06 req-55fc51d9-3f7a-4753-ad5a-522c1d574ccd service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Updated VIF entry in instance network info cache for port 5f5253f2-6e79-44f0-a4aa-167f273e7c6a. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG nova.network.neutron [req-93c404db-2433-4f1b-a8a2-04fa4291dc06 req-55fc51d9-3f7a-4753-ad5a-522c1d574ccd service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Updating instance_info_cache with network_info: [{"id": "5f5253f2-6e79-44f0-a4aa-167f273e7c6a", "address": "fa:16:3e:f9:f6:64", "network": {"id": "b8a52a8d-7eca-40b7-b94b-820a4ab8687b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1308054402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "021c1d91069e4798af2caae2c29694ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5253f2-6e", "ovs_interfaceid": "5f5253f2-6e79-44f0-a4aa-167f273e7c6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG nova.compute.manager [req-36ab7fe9-c012-408c-91bf-baca92941655 req-18b99a7b-cb43-4996-8292-4b7abba1b08d service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Received event network-vif-plugged-5f5253f2-6e79-44f0-a4aa-167f273e7c6a {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-36ab7fe9-c012-408c-91bf-baca92941655 req-18b99a7b-cb43-4996-8292-4b7abba1b08d service nova] Acquiring lock "7c17a25b-6818-48fa-b406-638dbf1845d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-36ab7fe9-c012-408c-91bf-baca92941655 req-18b99a7b-cb43-4996-8292-4b7abba1b08d service nova] Lock "7c17a25b-6818-48fa-b406-638dbf1845d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-36ab7fe9-c012-408c-91bf-baca92941655 req-18b99a7b-cb43-4996-8292-4b7abba1b08d service nova] Lock "7c17a25b-6818-48fa-b406-638dbf1845d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG nova.compute.manager [req-36ab7fe9-c012-408c-91bf-baca92941655 req-18b99a7b-cb43-4996-8292-4b7abba1b08d service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] No waiting events found dispatching network-vif-plugged-5f5253f2-6e79-44f0-a4aa-167f273e7c6a {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:33:55 user nova-compute[74247]: WARNING nova.compute.manager [req-36ab7fe9-c012-408c-91bf-baca92941655 req-18b99a7b-cb43-4996-8292-4b7abba1b08d service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Received unexpected event network-vif-plugged-5f5253f2-6e79-44f0-a4aa-167f273e7c6a for instance with vm_state rescued and task_state unrescuing.
Oct 16 18:33:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-93c404db-2433-4f1b-a8a2-04fa4291dc06 req-55fc51d9-3f7a-4753-ad5a-522c1d574ccd service nova] Releasing lock "refresh_cache-7c17a25b-6818-48fa-b406-638dbf1845d4" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:33:55 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: a686ee86-272c-47be-8801-9c1500af272f] Instance destroyed successfully.
Oct 16 18:33:55 user nova-compute[74247]: DEBUG nova.objects.instance [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lazy-loading 'resources' on Instance uuid a686ee86-272c-47be-8801-9c1500af272f {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:24:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-208936177',display_name='tempest-ServerActionsTestOtherB-server-208936177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-208936177',id=4,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIs9LtanBEbN6S6UJgwgQipMcrzgCgmqD+MSXO/I2jlCfUtIcGHYoW9tgqCxpGH6Qd6bb/kDDqj9dBay7WvsSTTn0A8mddCk4+U9BnAHzFohZU35eWuYV7ckMsEqil5fw==',key_name='tempest-keypair-447758938',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:31:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='973c8310858e4e1dafbc2fa926995940',ramdisk_id='',reservation_id='r-2wkxxe7p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-650770368',owner_user_name='tempest-ServerActionsTestOtherB-650770368-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:31:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b6734bfca1e4bf5b3c75d06eb471220',uuid=a686ee86-272c-47be-8801-9c1500af272f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8cb168df-92d2-4ecc-946a-7d9075f75561", "address": "fa:16:3e:9d:bb:be", "network": {"id": "f12e9b98-2724-4b9c-a299-7286c163458c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1410604293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973c8310858e4e1dafbc2fa926995940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb168df-92", "ovs_interfaceid": "8cb168df-92d2-4ecc-946a-7d9075f75561", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Converting VIF {"id": "8cb168df-92d2-4ecc-946a-7d9075f75561", "address": "fa:16:3e:9d:bb:be", "network": {"id": "f12e9b98-2724-4b9c-a299-7286c163458c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1410604293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973c8310858e4e1dafbc2fa926995940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb168df-92", "ovs_interfaceid": "8cb168df-92d2-4ecc-946a-7d9075f75561", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:bb:be,bridge_name='br-int',has_traffic_filtering=True,id=8cb168df-92d2-4ecc-946a-7d9075f75561,network=Network(f12e9b98-2724-4b9c-a299-7286c163458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb168df-92') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG os_vif [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:bb:be,bridge_name='br-int',has_traffic_filtering=True,id=8cb168df-92d2-4ecc-946a-7d9075f75561,network=Network(f12e9b98-2724-4b9c-a299-7286c163458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb168df-92') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8cb168df-92, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=81494996-c339-4f28-8523-0f0bd6271f38) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:55 user nova-compute[74247]: INFO os_vif [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:bb:be,bridge_name='br-int',has_traffic_filtering=True,id=8cb168df-92d2-4ecc-946a-7d9075f75561,network=Network(f12e9b98-2724-4b9c-a299-7286c163458c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb168df-92')
Oct 16 18:33:55 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MHBuxbDs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:33:55 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:33:55 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e5303c-fc03-4af6-838c-ff122f7b0d3e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 18:33:55 user nova-compute[74247]: No targets found.
Oct 16 18:33:55 user nova-compute[74247]: iSNS:
Oct 16 18:33:55 user nova-compute[74247]: No targets found.
Oct 16 18:33:55 user nova-compute[74247]: STATIC:
Oct 16 18:33:55 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6
Oct 16 18:33:55 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:33:55 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:33:55 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313
Oct 16 18:33:55 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:33:55 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:33:55 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a
Oct 16 18:33:55 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:33:55 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:33:55 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e
Oct 16 18:33:55 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:33:55 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:33:55 user nova-compute[74247]: FIRMWARE:
Oct 16 18:33:55 user nova-compute[74247]: No targets found.
Oct 16 18:33:55 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 18:33:55 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 18:33:55 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[977ff171-d327-44c9-8e74-1ae11674838d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea832f8-c61e-4c04-9c73-5d9dcb4e6fd4]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:33:55 user nova-compute[74247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:33:55 user nova-compute[74247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a (non-flash)
Oct 16 18:33:55 user nova-compute[74247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e (non-flash)
Oct 16 18:33:55 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:33:55 user nova-compute[74247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 (non-flash)
Oct 16 18:33:55 user nova-compute[74247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a (non-flash)
Oct 16 18:33:55 user nova-compute[74247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e (non-flash)
Oct 16 18:33:55 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe0799fd750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6'): ({'sdd'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Removing single pathed devices sdd {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd285147-24f2-4517-a509-de508559656b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a649e518-e77c-4cd1-9655-e5d1035f7295]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Flushing IO for device /dev/sdd {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a5da89-df83-4b0e-b51e-76adf1ea656c]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.059s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13e2466-9940-41fc-92a8-dc01efc7a99a]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] SCSI volumes sdd have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd10734b-e9bc-440e-ada3-da429947d318]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:33:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:56 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a37240-79b3-4d05-b279-a13a36d2413e]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:56 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6, portal: 172.16.0.220,3260]
Oct 16 18:33:56 user nova-compute[74247]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6, portal: 172.16.0.220,3260] successful.
Oct 16 18:33:56 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:33:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:33:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8223babc-be85-42b1-899b-b21e077ad7c6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:33:56 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[11294bdc-9738-49db-9ed2-f6724ea2f48f]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:33:56 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:33:56 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:33:56 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] <== disconnect_volume: return (382ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:33:56 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 18:33:56 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Deleting instance files /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f_del
Oct 16 18:33:56 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Deletion of /opt/stack/data/nova/instances/a686ee86-272c-47be-8801-9c1500af272f_del complete
Oct 16 18:33:56 user nova-compute[74247]: INFO nova.compute.manager [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Took 1.73 seconds to destroy the instance on the hypervisor.
Oct 16 18:33:56 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 18:33:56 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: a686ee86-272c-47be-8801-9c1500af272f] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 18:33:56 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: a686ee86-272c-47be-8801-9c1500af272f] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 18:33:56 user nova-compute[74247]: DEBUG nova.compute.manager [req-a88298c5-a081-4c54-990b-c15a92fac473 req-67aa1703-2b18-45db-831f-55d9dc564304 service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Received event network-changed-5f5253f2-6e79-44f0-a4aa-167f273e7c6a {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:33:56 user nova-compute[74247]: DEBUG nova.compute.manager [req-a88298c5-a081-4c54-990b-c15a92fac473 req-67aa1703-2b18-45db-831f-55d9dc564304 service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Refreshing instance network info cache due to event network-changed-5f5253f2-6e79-44f0-a4aa-167f273e7c6a. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:33:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a88298c5-a081-4c54-990b-c15a92fac473 req-67aa1703-2b18-45db-831f-55d9dc564304 service nova] Acquiring lock "refresh_cache-7c17a25b-6818-48fa-b406-638dbf1845d4" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:33:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a88298c5-a081-4c54-990b-c15a92fac473 req-67aa1703-2b18-45db-831f-55d9dc564304 service nova] Acquired lock "refresh_cache-7c17a25b-6818-48fa-b406-638dbf1845d4" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:33:56 user nova-compute[74247]: DEBUG nova.network.neutron [req-a88298c5-a081-4c54-990b-c15a92fac473 req-67aa1703-2b18-45db-831f-55d9dc564304 service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Refreshing network info cache for port 5f5253f2-6e79-44f0-a4aa-167f273e7c6a {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:33:56 user nova-compute[74247]: DEBUG nova.network.neutron [req-a88298c5-a081-4c54-990b-c15a92fac473 req-67aa1703-2b18-45db-831f-55d9dc564304 service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Updated VIF entry in instance network info cache for port 5f5253f2-6e79-44f0-a4aa-167f273e7c6a. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:33:56 user nova-compute[74247]: DEBUG nova.network.neutron [req-a88298c5-a081-4c54-990b-c15a92fac473 req-67aa1703-2b18-45db-831f-55d9dc564304 service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Updating instance_info_cache with network_info: [{"id": "5f5253f2-6e79-44f0-a4aa-167f273e7c6a", "address": "fa:16:3e:f9:f6:64", "network": {"id": "b8a52a8d-7eca-40b7-b94b-820a4ab8687b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1308054402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "021c1d91069e4798af2caae2c29694ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5253f2-6e", "ovs_interfaceid": "5f5253f2-6e79-44f0-a4aa-167f273e7c6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:33:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a88298c5-a081-4c54-990b-c15a92fac473 req-67aa1703-2b18-45db-831f-55d9dc564304 service nova] Releasing lock "refresh_cache-7c17a25b-6818-48fa-b406-638dbf1845d4" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:33:57 user nova-compute[74247]: DEBUG nova.compute.manager [req-e357a275-95c1-4e73-8f34-898ac097ac4e req-6be6374e-894e-4911-86af-2be5839eda57 service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] Received event network-vif-plugged-8cb168df-92d2-4ecc-946a-7d9075f75561 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:33:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e357a275-95c1-4e73-8f34-898ac097ac4e req-6be6374e-894e-4911-86af-2be5839eda57 service nova] Acquiring lock "a686ee86-272c-47be-8801-9c1500af272f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:33:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e357a275-95c1-4e73-8f34-898ac097ac4e req-6be6374e-894e-4911-86af-2be5839eda57 service nova] Lock "a686ee86-272c-47be-8801-9c1500af272f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:33:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e357a275-95c1-4e73-8f34-898ac097ac4e req-6be6374e-894e-4911-86af-2be5839eda57 service nova] Lock "a686ee86-272c-47be-8801-9c1500af272f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:33:57 user nova-compute[74247]: DEBUG nova.compute.manager [req-e357a275-95c1-4e73-8f34-898ac097ac4e req-6be6374e-894e-4911-86af-2be5839eda57 service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] No waiting events found dispatching network-vif-plugged-8cb168df-92d2-4ecc-946a-7d9075f75561 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:33:57 user nova-compute[74247]: WARNING nova.compute.manager [req-e357a275-95c1-4e73-8f34-898ac097ac4e req-6be6374e-894e-4911-86af-2be5839eda57 service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] Received unexpected event network-vif-plugged-8cb168df-92d2-4ecc-946a-7d9075f75561 for instance with vm_state active and task_state deleting.
Oct 16 18:33:57 user nova-compute[74247]: DEBUG nova.compute.manager [req-fd8f4144-996b-4378-a990-0045c0141e9f req-e3cf47a0-53e8-4bda-a2b2-5347d6525ecd service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Received event network-vif-plugged-5f5253f2-6e79-44f0-a4aa-167f273e7c6a {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:33:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-fd8f4144-996b-4378-a990-0045c0141e9f req-e3cf47a0-53e8-4bda-a2b2-5347d6525ecd service nova] Acquiring lock "7c17a25b-6818-48fa-b406-638dbf1845d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:33:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-fd8f4144-996b-4378-a990-0045c0141e9f req-e3cf47a0-53e8-4bda-a2b2-5347d6525ecd service nova] Lock "7c17a25b-6818-48fa-b406-638dbf1845d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:33:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-fd8f4144-996b-4378-a990-0045c0141e9f req-e3cf47a0-53e8-4bda-a2b2-5347d6525ecd service nova] Lock "7c17a25b-6818-48fa-b406-638dbf1845d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:33:57 user nova-compute[74247]: DEBUG nova.compute.manager [req-fd8f4144-996b-4378-a990-0045c0141e9f req-e3cf47a0-53e8-4bda-a2b2-5347d6525ecd service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] No waiting events found dispatching network-vif-plugged-5f5253f2-6e79-44f0-a4aa-167f273e7c6a {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:33:57 user nova-compute[74247]: WARNING nova.compute.manager [req-fd8f4144-996b-4378-a990-0045c0141e9f req-e3cf47a0-53e8-4bda-a2b2-5347d6525ecd service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Received unexpected event network-vif-plugged-5f5253f2-6e79-44f0-a4aa-167f273e7c6a for instance with vm_state rescued and task_state unrescuing.
Oct 16 18:33:57 user nova-compute[74247]: DEBUG nova.compute.manager [req-fd8f4144-996b-4378-a990-0045c0141e9f req-e3cf47a0-53e8-4bda-a2b2-5347d6525ecd service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Received event network-vif-plugged-5f5253f2-6e79-44f0-a4aa-167f273e7c6a {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:33:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-fd8f4144-996b-4378-a990-0045c0141e9f req-e3cf47a0-53e8-4bda-a2b2-5347d6525ecd service nova] Acquiring lock "7c17a25b-6818-48fa-b406-638dbf1845d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:33:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-fd8f4144-996b-4378-a990-0045c0141e9f req-e3cf47a0-53e8-4bda-a2b2-5347d6525ecd service nova] Lock "7c17a25b-6818-48fa-b406-638dbf1845d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:33:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-fd8f4144-996b-4378-a990-0045c0141e9f req-e3cf47a0-53e8-4bda-a2b2-5347d6525ecd service nova] Lock "7c17a25b-6818-48fa-b406-638dbf1845d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:33:57 user nova-compute[74247]: DEBUG nova.compute.manager [req-fd8f4144-996b-4378-a990-0045c0141e9f req-e3cf47a0-53e8-4bda-a2b2-5347d6525ecd service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] No waiting events found dispatching network-vif-plugged-5f5253f2-6e79-44f0-a4aa-167f273e7c6a {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:33:57 user nova-compute[74247]: WARNING nova.compute.manager [req-fd8f4144-996b-4378-a990-0045c0141e9f req-e3cf47a0-53e8-4bda-a2b2-5347d6525ecd service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Received unexpected event network-vif-plugged-5f5253f2-6e79-44f0-a4aa-167f273e7c6a for instance with vm_state rescued and task_state unrescuing.
Oct 16 18:33:57 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: a686ee86-272c-47be-8801-9c1500af272f] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:33:57 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: a686ee86-272c-47be-8801-9c1500af272f] Took 1.22 seconds to deallocate network for instance.
Oct 16 18:33:58 user nova-compute[74247]: DEBUG nova.compute.manager [None req-51a7eb39-ea5b-45f8-9d76-bf4be331888c tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:33:58 user nova-compute[74247]: INFO nova.compute.manager [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] [instance: a686ee86-272c-47be-8801-9c1500af272f] Took 1.07 seconds to detach 1 volumes for instance.
Oct 16 18:33:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:33:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:33:58 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:33:58 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:33:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.458s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:33:59 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Deleted allocations for instance a686ee86-272c-47be-8801-9c1500af272f
Oct 16 18:33:59 user nova-compute[74247]: DEBUG nova.compute.manager [req-f140bebf-093c-498e-bccf-9c7b082eecac req-bf773092-0b79-40e0-8a7a-ea32fec3b897 service nova] [instance: a686ee86-272c-47be-8801-9c1500af272f] Received event network-vif-deleted-8cb168df-92d2-4ecc-946a-7d9075f75561 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:33:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-52f62cc8-6674-4ce8-9474-bda76ac095a6 tempest-ServerActionsTestOtherB-650770368 tempest-ServerActionsTestOtherB-650770368-project-member] Lock "a686ee86-272c-47be-8801-9c1500af272f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.711s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:34:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:01 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:34:01 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:34:01 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:34:01 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 18:34:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-39dbec7e-8b30-46d3-9d71-04dc2d3c9e54 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "bbec99d1-82a3-4e4d-a3ae-17e00821bee1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:34:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-39dbec7e-8b30-46d3-9d71-04dc2d3c9e54 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "bbec99d1-82a3-4e4d-a3ae-17e00821bee1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:34:01 user nova-compute[74247]: INFO nova.compute.manager [None req-39dbec7e-8b30-46d3-9d71-04dc2d3c9e54 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Detaching volume 91e22910-3fb9-43fd-ac65-70fb0215b313
Oct 16 18:34:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "refresh_cache-7c17a25b-6818-48fa-b406-638dbf1845d4" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:34:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquired lock "refresh_cache-7c17a25b-6818-48fa-b406-638dbf1845d4" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:34:01 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Forcefully refreshing network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 18:34:01 user nova-compute[74247]: INFO nova.virt.block_device [None req-39dbec7e-8b30-46d3-9d71-04dc2d3c9e54 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Attempting to driver detach volume 91e22910-3fb9-43fd-ac65-70fb0215b313 from mountpoint /dev/vdb
Oct 16 18:34:01 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-39dbec7e-8b30-46d3-9d71-04dc2d3c9e54 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Attempting to detach device vdb from instance bbec99d1-82a3-4e4d-a3ae-17e00821bee1 from the persistent domain config. {{(pid=74247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 18:34:01 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-39dbec7e-8b30-46d3-9d71-04dc2d3c9e54 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 18:34:01 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:34:01 user nova-compute[74247]:   <source dev="/dev/sdb"/>
Oct 16 18:34:01 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:34:01 user nova-compute[74247]:   <serial>91e22910-3fb9-43fd-ac65-70fb0215b313</serial>
Oct 16 18:34:01 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 16 18:34:01 user nova-compute[74247]: </disk>
Oct 16 18:34:01 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:34:01 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-39dbec7e-8b30-46d3-9d71-04dc2d3c9e54 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Successfully detached device vdb from instance bbec99d1-82a3-4e4d-a3ae-17e00821bee1 from the persistent domain config.
Oct 16 18:34:01 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-39dbec7e-8b30-46d3-9d71-04dc2d3c9e54 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bbec99d1-82a3-4e4d-a3ae-17e00821bee1 from the live domain config. {{(pid=74247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 18:34:01 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-39dbec7e-8b30-46d3-9d71-04dc2d3c9e54 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 18:34:01 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:34:01 user nova-compute[74247]:   <source dev="/dev/sdb"/>
Oct 16 18:34:01 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:34:01 user nova-compute[74247]:   <serial>91e22910-3fb9-43fd-ac65-70fb0215b313</serial>
Oct 16 18:34:01 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 16 18:34:01 user nova-compute[74247]: </disk>
Oct 16 18:34:01 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:34:02 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Updating instance_info_cache with network_info: [{"id": "5f5253f2-6e79-44f0-a4aa-167f273e7c6a", "address": "fa:16:3e:f9:f6:64", "network": {"id": "b8a52a8d-7eca-40b7-b94b-820a4ab8687b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1308054402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "021c1d91069e4798af2caae2c29694ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5253f2-6e", "ovs_interfaceid": "5f5253f2-6e79-44f0-a4aa-167f273e7c6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:34:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Releasing lock "refresh_cache-7c17a25b-6818-48fa-b406-638dbf1845d4" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:34:02 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Updated the network info_cache for instance {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 18:34:02 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:34:02 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:34:02 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:34:02 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:34:02 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:34:02 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-39dbec7e-8b30-46d3-9d71-04dc2d3c9e54 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bbec99d1-82a3-4e4d-a3ae-17e00821bee1 {{(pid=74247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 18:34:02 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:34:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:34:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:34:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:34:02 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 18:34:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6367b6d-1bc2-4472-b0c4-07baec4a28b0/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6367b6d-1bc2-4472-b0c4-07baec4a28b0/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6367b6d-1bc2-4472-b0c4-07baec4a28b0/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6367b6d-1bc2-4472-b0c4-07baec4a28b0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:34:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed343632-72bc-40f0-9698-fe4bd67c56d7/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed343632-72bc-40f0-9698-fe4bd67c56d7/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed343632-72bc-40f0-9698-fe4bd67c56d7/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed343632-72bc-40f0-9698-fe4bd67c56d7/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:34:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:07 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:34:07 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:34:07 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=7720MB free_disk=25.08935546875GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 18:34:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:34:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:34:07 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance e37fbc27-3404-479a-be08-4d590391cf30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:34:07 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance bbec99d1-82a3-4e4d-a3ae-17e00821bee1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:34:07 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 7c17a25b-6818-48fa-b406-638dbf1845d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:34:07 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance cddf4842-1c25-4cc8-914e-af30849e4d6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:34:07 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance d6367b6d-1bc2-4472-b0c4-07baec4a28b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:34:07 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 958af87e-69d0-4da1-8fcf-90e0f275d62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:34:07 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance d775101d-53a1-48c7-af24-91480be6af61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:34:07 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance ed343632-72bc-40f0-9698-fe4bd67c56d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:34:07 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 7dcc08e9-7439-436b-8d9f-facaf04e22c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:34:07 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 18:34:07 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 18:34:07 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:34:07 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:34:07 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 18:34:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.603s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:34:10 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:10 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:34:10 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 18:34:10 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG nova.compute.manager [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:34:13 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Creating image(s)
Oct 16 18:34:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Did not create local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Ensure instance console log exists: /opt/stack/data/nova/instances/7dcc08e9-7439-436b-8d9f-facaf04e22c1/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Start _get_guest_xml network_info=[{"id": "b7a0865a-62eb-4517-83ba-eb30ff219e50", "address": "fa:16:3e:47:07:5d", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a0865a-62", "ovs_interfaceid": "b7a0865a-62eb-4517-83ba-eb30ff219e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WMKTPjCc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7dcc08e9-7439-436b-8d9f-facaf04e22c1', 'attached_at': '', 'detached_at': '', 'volume_id': 'f18ceae5-8693-41f8-b319-d937cd5052bc', 'serial': 'f18ceae5-8693-41f8-b319-d937cd5052bc'}, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '4d7fab72-cff3-4403-9111-f1244afea948', 'guest_format': None, 'volume_type': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:34:13 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:34:13 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:34:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WMKTPjCc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:34:13 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:34:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:34:13 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:34:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:34:13 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:34:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abadc3c-521e-42bf-b942-12627f57208b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 18:34:13 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e33a1b4-4ba3-4b45-8dc4-8d4a81579a93]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc] added
Oct 16 18:34:13 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[497469d3-e739-45e5-8614-ede81c7e3f0f]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6469b271-73cc-4b96-b00b-04b295854c81]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WMKTPjCc {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WMKTPjCc" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0724d9d-4434-40f0-b40c-ece9399403fd]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WMKTPjCc'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e284693-a25f-4606-9431-16b41a01d71a]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fa8dc7-c3b7-449a-9985-a070217b34c3]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:34:13 user nova-compute[74247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a (non-flash)
Oct 16 18:34:13 user nova-compute[74247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e (non-flash)
Oct 16 18:34:13 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:34:13 user nova-compute[74247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a (non-flash)
Oct 16 18:34:13 user nova-compute[74247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e (non-flash)
Oct 16 18:34:13 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe08663-5853-4391-b6ef-c30c74c36636]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc, portal: 172.16.0.220,3260]
Oct 16 18:34:13 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc, portal: 172.16.0.220,3260] successful.
Oct 16 18:34:13 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1354b7bd-a9c7-4930-8100-ea9bd0ec0ea7]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a12e04-dd38-4a3a-9355-37c42f87025a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:34:13 user nova-compute[74247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a (non-flash)
Oct 16 18:34:13 user nova-compute[74247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e (non-flash)
Oct 16 18:34:13 user nova-compute[74247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:34:13 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:34:13 user nova-compute[74247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a (non-flash)
Oct 16 18:34:13 user nova-compute[74247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e (non-flash)
Oct 16 18:34:13 user nova-compute[74247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:34:13 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3dc366-06bf-4898-8156-a32a556d5d23]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:34:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WMKTPjCc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:34:14 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:34:14 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23637393464323764', 'path': '/dev/sdc'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:34:14 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637393464323764', 'path': '/dev/sdc'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:34:14 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:33:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1738372672',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1738372672',id=22,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bce6164a392e4cc2a027d12c49145e6d',ramdisk_id='',reservation_id='r-lqc3f0nm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-656520712',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:33:49Z,user_data=None,user_id='b01d3e5d2fcb40bc92c3d2fe1236d509',uuid=7dcc08e9-7439-436b-8d9f-facaf04e22c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7a0865a-62eb-4517-83ba-eb30ff219e50", "address": "fa:16:3e:47:07:5d", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a0865a-62", "ovs_interfaceid": "b7a0865a-62eb-4517-83ba-eb30ff219e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:34:14 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Converting VIF {"id": "b7a0865a-62eb-4517-83ba-eb30ff219e50", "address": "fa:16:3e:47:07:5d", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a0865a-62", "ovs_interfaceid": "b7a0865a-62eb-4517-83ba-eb30ff219e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:34:14 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:07:5d,bridge_name='br-int',has_traffic_filtering=True,id=b7a0865a-62eb-4517-83ba-eb30ff219e50,network=Network(2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7a0865a-62') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:34:14 user nova-compute[74247]: DEBUG nova.objects.instance [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lazy-loading 'pci_devices' on Instance uuid 7dcc08e9-7439-436b-8d9f-facaf04e22c1 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:34:14 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:34:14 user nova-compute[74247]:   <uuid>7dcc08e9-7439-436b-8d9f-facaf04e22c1</uuid>
Oct 16 18:34:14 user nova-compute[74247]:   <name>instance-00000016</name>
Oct 16 18:34:14 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:34:14 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:34:14 user nova-compute[74247]:   <metadata>
Oct 16 18:34:14 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:34:14 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:34:14 user nova-compute[74247]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1738372672</nova:name>
Oct 16 18:34:14 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:34:13</nova:creationTime>
Oct 16 18:34:14 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:34:14 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:34:14 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:34:14 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:34:14 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:34:14 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:34:14 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:34:14 user nova-compute[74247]:       <nova:owner>
Oct 16 18:34:14 user nova-compute[74247]:         <nova:user uuid="b01d3e5d2fcb40bc92c3d2fe1236d509">tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member</nova:user>
Oct 16 18:34:14 user nova-compute[74247]:         <nova:project uuid="bce6164a392e4cc2a027d12c49145e6d">tempest-ServerBootFromVolumeStableRescueTest-656520712</nova:project>
Oct 16 18:34:14 user nova-compute[74247]:       </nova:owner>
Oct 16 18:34:14 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:34:14 user nova-compute[74247]:       <nova:ports>
Oct 16 18:34:14 user nova-compute[74247]:         <nova:port uuid="b7a0865a-62eb-4517-83ba-eb30ff219e50">
Oct 16 18:34:14 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 16 18:34:14 user nova-compute[74247]:         </nova:port>
Oct 16 18:34:14 user nova-compute[74247]:       </nova:ports>
Oct 16 18:34:14 user nova-compute[74247]:     </nova:instance>
Oct 16 18:34:14 user nova-compute[74247]:   </metadata>
Oct 16 18:34:14 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:34:14 user nova-compute[74247]:     <system>
Oct 16 18:34:14 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:34:14 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:34:14 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:34:14 user nova-compute[74247]:       <entry name="serial">7dcc08e9-7439-436b-8d9f-facaf04e22c1</entry>
Oct 16 18:34:14 user nova-compute[74247]:       <entry name="uuid">7dcc08e9-7439-436b-8d9f-facaf04e22c1</entry>
Oct 16 18:34:14 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:34:14 user nova-compute[74247]:     </system>
Oct 16 18:34:14 user nova-compute[74247]:   </sysinfo>
Oct 16 18:34:14 user nova-compute[74247]:   <os>
Oct 16 18:34:14 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:34:14 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:34:14 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:34:14 user nova-compute[74247]:   </os>
Oct 16 18:34:14 user nova-compute[74247]:   <features>
Oct 16 18:34:14 user nova-compute[74247]:     <acpi/>
Oct 16 18:34:14 user nova-compute[74247]:     <apic/>
Oct 16 18:34:14 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:34:14 user nova-compute[74247]:   </features>
Oct 16 18:34:14 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:34:14 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:34:14 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:34:14 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:34:14 user nova-compute[74247]:   </clock>
Oct 16 18:34:14 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:34:14 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:34:14 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:34:14 user nova-compute[74247]:   </cpu>
Oct 16 18:34:14 user nova-compute[74247]:   <devices>
Oct 16 18:34:14 user nova-compute[74247]:     <disk type="block" device="disk">
Oct 16 18:34:14 user nova-compute[74247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:34:14 user nova-compute[74247]:       <source dev="/dev/sdc"/>
Oct 16 18:34:14 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:34:14 user nova-compute[74247]:       <serial>f18ceae5-8693-41f8-b319-d937cd5052bc</serial>
Oct 16 18:34:14 user nova-compute[74247]:     </disk>
Oct 16 18:34:14 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:34:14 user nova-compute[74247]:       <mac address="fa:16:3e:47:07:5d"/>
Oct 16 18:34:14 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:34:14 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:34:14 user nova-compute[74247]:       <target dev="tapb7a0865a-62"/>
Oct 16 18:34:14 user nova-compute[74247]:     </interface>
Oct 16 18:34:14 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:34:14 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/7dcc08e9-7439-436b-8d9f-facaf04e22c1/console.log" append="off"/>
Oct 16 18:34:14 user nova-compute[74247]:     </serial>
Oct 16 18:34:14 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:34:14 user nova-compute[74247]:     <video>
Oct 16 18:34:14 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:34:14 user nova-compute[74247]:     </video>
Oct 16 18:34:14 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:34:14 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:34:14 user nova-compute[74247]:     </rng>
Oct 16 18:34:14 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:34:14 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:34:14 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:34:14 user nova-compute[74247]:     </memballoon>
Oct 16 18:34:14 user nova-compute[74247]:   </devices>
Oct 16 18:34:14 user nova-compute[74247]: </domain>
Oct 16 18:34:14 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:34:14 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:33:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1738372672',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1738372672',id=22,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bce6164a392e4cc2a027d12c49145e6d',ramdisk_id='',reservation_id='r-lqc3f0nm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-656520712',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:33:49Z,user_data=None,user_id='b01d3e5d2fcb40bc92c3d2fe1236d509',uuid=7dcc08e9-7439-436b-8d9f-facaf04e22c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7a0865a-62eb-4517-83ba-eb30ff219e50", "address": "fa:16:3e:47:07:5d", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a0865a-62", "ovs_interfaceid": "b7a0865a-62eb-4517-83ba-eb30ff219e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:34:14 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Converting VIF {"id": "b7a0865a-62eb-4517-83ba-eb30ff219e50", "address": "fa:16:3e:47:07:5d", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a0865a-62", "ovs_interfaceid": "b7a0865a-62eb-4517-83ba-eb30ff219e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:34:14 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:07:5d,bridge_name='br-int',has_traffic_filtering=True,id=b7a0865a-62eb-4517-83ba-eb30ff219e50,network=Network(2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7a0865a-62') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:34:14 user nova-compute[74247]: DEBUG os_vif [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:07:5d,bridge_name='br-int',has_traffic_filtering=True,id=b7a0865a-62eb-4517-83ba-eb30ff219e50,network=Network(2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7a0865a-62') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:34:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:34:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:34:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '00ace358-2b60-5b48-ae17-28b0b026c5f5', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:34:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:34:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7a0865a-62, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:34:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb7a0865a-62, col_values=(('qos', UUID('16ae8413-1cd5-4683-a847-b8017ffb425f')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:34:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb7a0865a-62, col_values=(('external_ids', {'iface-id': 'b7a0865a-62eb-4517-83ba-eb30ff219e50', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:07:5d', 'vm-uuid': '7dcc08e9-7439-436b-8d9f-facaf04e22c1'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:34:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:34:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:15 user nova-compute[74247]: INFO os_vif [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:07:5d,bridge_name='br-int',has_traffic_filtering=True,id=b7a0865a-62eb-4517-83ba-eb30ff219e50,network=Network(2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7a0865a-62')
Oct 16 18:34:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:34:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] No VIF found with MAC fa:16:3e:47:07:5d, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:34:15 user nova-compute[74247]: INFO nova.compute.manager [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] Rescuing
Oct 16 18:34:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquiring lock "refresh_cache-d775101d-53a1-48c7-af24-91480be6af61" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:34:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquired lock "refresh_cache-d775101d-53a1-48c7-af24-91480be6af61" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:34:15 user nova-compute[74247]: DEBUG nova.network.neutron [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:34:15 user nova-compute[74247]: DEBUG nova.network.neutron [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] Updating instance_info_cache with network_info: [{"id": "646f5b58-acad-402e-bdf5-e5bd423c69e8", "address": "fa:16:3e:45:9e:7d", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap646f5b58-ac", "ovs_interfaceid": "646f5b58-acad-402e-bdf5-e5bd423c69e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:34:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Releasing lock "refresh_cache-d775101d-53a1-48c7-af24-91480be6af61" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:34:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:16 user nova-compute[74247]: DEBUG nova.compute.manager [req-17811a46-682b-46f7-b069-069ec957cfca req-a5d9a6a4-f11f-4a61-8a2a-0a40ac925e0f service nova] [instance: d775101d-53a1-48c7-af24-91480be6af61] Received event network-vif-unplugged-646f5b58-acad-402e-bdf5-e5bd423c69e8 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:34:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-17811a46-682b-46f7-b069-069ec957cfca req-a5d9a6a4-f11f-4a61-8a2a-0a40ac925e0f service nova] Acquiring lock "d775101d-53a1-48c7-af24-91480be6af61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:34:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-17811a46-682b-46f7-b069-069ec957cfca req-a5d9a6a4-f11f-4a61-8a2a-0a40ac925e0f service nova] Lock "d775101d-53a1-48c7-af24-91480be6af61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:34:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-17811a46-682b-46f7-b069-069ec957cfca req-a5d9a6a4-f11f-4a61-8a2a-0a40ac925e0f service nova] Lock "d775101d-53a1-48c7-af24-91480be6af61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:34:16 user nova-compute[74247]: DEBUG nova.compute.manager [req-17811a46-682b-46f7-b069-069ec957cfca req-a5d9a6a4-f11f-4a61-8a2a-0a40ac925e0f service nova] [instance: d775101d-53a1-48c7-af24-91480be6af61] No waiting events found dispatching network-vif-unplugged-646f5b58-acad-402e-bdf5-e5bd423c69e8 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:34:16 user nova-compute[74247]: WARNING nova.compute.manager [req-17811a46-682b-46f7-b069-069ec957cfca req-a5d9a6a4-f11f-4a61-8a2a-0a40ac925e0f service nova] [instance: d775101d-53a1-48c7-af24-91480be6af61] Received unexpected event network-vif-unplugged-646f5b58-acad-402e-bdf5-e5bd423c69e8 for instance with vm_state active and task_state rescuing.
Oct 16 18:34:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:16 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: d775101d-53a1-48c7-af24-91480be6af61] Instance destroyed successfully.
Oct 16 18:34:16 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] Attempting rescue
Oct 16 18:34:16 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74247) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 16 18:34:16 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] Instance directory exists: not creating {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 16 18:34:16 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] Creating image(s)
Oct 16 18:34:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquiring lock "/opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:34:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "/opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:34:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "/opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:34:16 user nova-compute[74247]: DEBUG nova.objects.instance [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lazy-loading 'trusted_certs' on Instance uuid d775101d-53a1-48c7-af24-91480be6af61 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:34:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquiring lock "37399febbd18f60b85fd0f833558f6a3539ab231" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:34:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:34:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.254s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue" returned: 0 in 0.062s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.319s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:34:17 user nova-compute[74247]: DEBUG nova.objects.instance [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lazy-loading 'migration_context' on Instance uuid d775101d-53a1-48c7-af24-91480be6af61 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:34:17 user nova-compute[74247]: DEBUG nova.compute.manager [req-ea0cd90f-d15b-440b-ad0f-3d7b6de4f898 req-ea4cbd68-dc03-4ead-868a-5139aa82021a service nova] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Received event network-vif-plugged-b7a0865a-62eb-4517-83ba-eb30ff219e50 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:34:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-ea0cd90f-d15b-440b-ad0f-3d7b6de4f898 req-ea4cbd68-dc03-4ead-868a-5139aa82021a service nova] Acquiring lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:34:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-ea0cd90f-d15b-440b-ad0f-3d7b6de4f898 req-ea4cbd68-dc03-4ead-868a-5139aa82021a service nova] Lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:34:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-ea0cd90f-d15b-440b-ad0f-3d7b6de4f898 req-ea4cbd68-dc03-4ead-868a-5139aa82021a service nova] Lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:34:17 user nova-compute[74247]: DEBUG nova.compute.manager [req-ea0cd90f-d15b-440b-ad0f-3d7b6de4f898 req-ea4cbd68-dc03-4ead-868a-5139aa82021a service nova] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] No waiting events found dispatching network-vif-plugged-b7a0865a-62eb-4517-83ba-eb30ff219e50 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:34:17 user nova-compute[74247]: WARNING nova.compute.manager [req-ea0cd90f-d15b-440b-ad0f-3d7b6de4f898 req-ea4cbd68-dc03-4ead-868a-5139aa82021a service nova] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Received unexpected event network-vif-plugged-b7a0865a-62eb-4517-83ba-eb30ff219e50 for instance with vm_state building and task_state spawning.
Oct 16 18:34:17 user nova-compute[74247]: DEBUG nova.objects.base [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Object Instance<d775101d-53a1-48c7-af24-91480be6af61> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:34:17 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 18:34:17 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] Start _get_guest_xml network_info=[{"id": "646f5b58-acad-402e-bdf5-e5bd423c69e8", "address": "fa:16:3e:45:9e:7d", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "vif_mac": "fa:16:3e:45:9e:7d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap646f5b58-ac", "ovs_interfaceid": "646f5b58-acad-402e-bdf5-e5bd423c69e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '83126bb1-29f5-42fe-8620-72ab0797f776', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:34:17 user nova-compute[74247]: DEBUG nova.objects.instance [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lazy-loading 'resources' on Instance uuid d775101d-53a1-48c7-af24-91480be6af61 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:34:17 user nova-compute[74247]: DEBUG nova.objects.base [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Object Instance<d775101d-53a1-48c7-af24-91480be6af61> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:34:17 user nova-compute[74247]: DEBUG nova.objects.instance [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lazy-loading 'numa_topology' on Instance uuid d775101d-53a1-48c7-af24-91480be6af61 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:34:17 user nova-compute[74247]: DEBUG nova.objects.base [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Object Instance<d775101d-53a1-48c7-af24-91480be6af61> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:34:17 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:34:17 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:34:17 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:34:17 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:34:17 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:34:17 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:34:17 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:34:17 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:34:17 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:34:17 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:34:17 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:34:17 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:34:17 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:34:17 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:34:17 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:34:17 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:34:17 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:34:17 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:34:17 user nova-compute[74247]: DEBUG nova.objects.instance [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lazy-loading 'vcpu_model' on Instance uuid d775101d-53a1-48c7-af24-91480be6af61 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:34:17 user nova-compute[74247]: DEBUG nova.objects.base [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Object Instance<d775101d-53a1-48c7-af24-91480be6af61> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:34:17 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:32:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-456531951',display_name='tempest-ServerRescueNegativeTestJSON-server-456531951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-456531951',id=20,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:32:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16160dad45544c6e8d9758e883089822',ramdisk_id='',reservation_id='r-p6ml07y9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2007731322',owner_user_name='tempest-ServerRescueNegativeTestJSON-2007731322-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:32:32Z,user_data=None,user_id='51026968ba1f49eaa8e0cc27a81855db',uuid=d775101d-53a1-48c7-af24-91480be6af61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "646f5b58-acad-402e-bdf5-e5bd423c69e8", "address": "fa:16:3e:45:9e:7d", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "vif_mac": "fa:16:3e:45:9e:7d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap646f5b58-ac", "ovs_interfaceid": "646f5b58-acad-402e-bdf5-e5bd423c69e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:34:17 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Converting VIF {"id": "646f5b58-acad-402e-bdf5-e5bd423c69e8", "address": "fa:16:3e:45:9e:7d", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "vif_mac": "fa:16:3e:45:9e:7d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap646f5b58-ac", "ovs_interfaceid": "646f5b58-acad-402e-bdf5-e5bd423c69e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:34:17 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:9e:7d,bridge_name='br-int',has_traffic_filtering=True,id=646f5b58-acad-402e-bdf5-e5bd423c69e8,network=Network(57ee1ccc-d7df-4a86-9234-c3c5f447e051),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap646f5b58-ac') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:34:17 user nova-compute[74247]: DEBUG nova.objects.instance [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lazy-loading 'pci_devices' on Instance uuid d775101d-53a1-48c7-af24-91480be6af61 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:34:17 user nova-compute[74247]: DEBUG nova.objects.base [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Object Instance<d775101d-53a1-48c7-af24-91480be6af61> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:34:17 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:34:17 user nova-compute[74247]:   <uuid>d775101d-53a1-48c7-af24-91480be6af61</uuid>
Oct 16 18:34:17 user nova-compute[74247]:   <name>instance-00000014</name>
Oct 16 18:34:17 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:34:17 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:34:17 user nova-compute[74247]:   <metadata>
Oct 16 18:34:17 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:34:17 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:34:17 user nova-compute[74247]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-456531951</nova:name>
Oct 16 18:34:17 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:34:17</nova:creationTime>
Oct 16 18:34:17 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:34:17 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:34:17 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:34:17 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:34:17 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:34:17 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:34:17 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:34:17 user nova-compute[74247]:       <nova:owner>
Oct 16 18:34:17 user nova-compute[74247]:         <nova:user uuid="51026968ba1f49eaa8e0cc27a81855db">tempest-ServerRescueNegativeTestJSON-2007731322-project-member</nova:user>
Oct 16 18:34:17 user nova-compute[74247]:         <nova:project uuid="16160dad45544c6e8d9758e883089822">tempest-ServerRescueNegativeTestJSON-2007731322</nova:project>
Oct 16 18:34:17 user nova-compute[74247]:       </nova:owner>
Oct 16 18:34:17 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:34:17 user nova-compute[74247]:       <nova:ports>
Oct 16 18:34:17 user nova-compute[74247]:         <nova:port uuid="646f5b58-acad-402e-bdf5-e5bd423c69e8">
Oct 16 18:34:17 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 16 18:34:17 user nova-compute[74247]:         </nova:port>
Oct 16 18:34:17 user nova-compute[74247]:       </nova:ports>
Oct 16 18:34:17 user nova-compute[74247]:     </nova:instance>
Oct 16 18:34:17 user nova-compute[74247]:   </metadata>
Oct 16 18:34:17 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:34:17 user nova-compute[74247]:     <system>
Oct 16 18:34:17 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:34:17 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:34:17 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:34:17 user nova-compute[74247]:       <entry name="serial">d775101d-53a1-48c7-af24-91480be6af61</entry>
Oct 16 18:34:17 user nova-compute[74247]:       <entry name="uuid">d775101d-53a1-48c7-af24-91480be6af61</entry>
Oct 16 18:34:17 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:34:17 user nova-compute[74247]:     </system>
Oct 16 18:34:17 user nova-compute[74247]:   </sysinfo>
Oct 16 18:34:17 user nova-compute[74247]:   <os>
Oct 16 18:34:17 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:34:17 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:34:17 user nova-compute[74247]:   </os>
Oct 16 18:34:17 user nova-compute[74247]:   <features>
Oct 16 18:34:17 user nova-compute[74247]:     <acpi/>
Oct 16 18:34:17 user nova-compute[74247]:     <apic/>
Oct 16 18:34:17 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:34:17 user nova-compute[74247]:   </features>
Oct 16 18:34:17 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:34:17 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:34:17 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:34:17 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:34:17 user nova-compute[74247]:   </clock>
Oct 16 18:34:17 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:34:17 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:34:17 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:34:17 user nova-compute[74247]:   </cpu>
Oct 16 18:34:17 user nova-compute[74247]:   <devices>
Oct 16 18:34:17 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:34:17 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:34:17 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue"/>
Oct 16 18:34:17 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:34:17 user nova-compute[74247]:     </disk>
Oct 16 18:34:17 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:34:17 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:34:17 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk"/>
Oct 16 18:34:17 user nova-compute[74247]:       <target dev="vdb" bus="virtio"/>
Oct 16 18:34:17 user nova-compute[74247]:     </disk>
Oct 16 18:34:17 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:34:17 user nova-compute[74247]:       <mac address="fa:16:3e:45:9e:7d"/>
Oct 16 18:34:17 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:34:17 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:34:17 user nova-compute[74247]:       <target dev="tap646f5b58-ac"/>
Oct 16 18:34:17 user nova-compute[74247]:     </interface>
Oct 16 18:34:17 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:34:17 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/console.log" append="off"/>
Oct 16 18:34:17 user nova-compute[74247]:     </serial>
Oct 16 18:34:17 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:34:17 user nova-compute[74247]:     <video>
Oct 16 18:34:17 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:34:17 user nova-compute[74247]:     </video>
Oct 16 18:34:17 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:34:17 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:34:17 user nova-compute[74247]:     </rng>
Oct 16 18:34:17 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:34:17 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:34:17 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:34:17 user nova-compute[74247]:     </memballoon>
Oct 16 18:34:17 user nova-compute[74247]:   </devices>
Oct 16 18:34:17 user nova-compute[74247]: </domain>
Oct 16 18:34:17 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:34:17 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: d775101d-53a1-48c7-af24-91480be6af61] Instance destroyed successfully.
Oct 16 18:34:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:17 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:34:17 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:34:17 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] No VIF found with MAC fa:16:3e:45:9e:7d, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:34:18 user nova-compute[74247]: DEBUG nova.compute.manager [req-c8698720-71f4-49d3-8412-4ab7414d8126 req-02ebd1ac-5fa5-4e9e-b18b-b046f7d40a83 service nova] [instance: d775101d-53a1-48c7-af24-91480be6af61] Received event network-vif-plugged-646f5b58-acad-402e-bdf5-e5bd423c69e8 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:34:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c8698720-71f4-49d3-8412-4ab7414d8126 req-02ebd1ac-5fa5-4e9e-b18b-b046f7d40a83 service nova] Acquiring lock "d775101d-53a1-48c7-af24-91480be6af61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:34:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c8698720-71f4-49d3-8412-4ab7414d8126 req-02ebd1ac-5fa5-4e9e-b18b-b046f7d40a83 service nova] Lock "d775101d-53a1-48c7-af24-91480be6af61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:34:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c8698720-71f4-49d3-8412-4ab7414d8126 req-02ebd1ac-5fa5-4e9e-b18b-b046f7d40a83 service nova] Lock "d775101d-53a1-48c7-af24-91480be6af61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:34:18 user nova-compute[74247]: DEBUG nova.compute.manager [req-c8698720-71f4-49d3-8412-4ab7414d8126 req-02ebd1ac-5fa5-4e9e-b18b-b046f7d40a83 service nova] [instance: d775101d-53a1-48c7-af24-91480be6af61] No waiting events found dispatching network-vif-plugged-646f5b58-acad-402e-bdf5-e5bd423c69e8 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:34:18 user nova-compute[74247]: WARNING nova.compute.manager [req-c8698720-71f4-49d3-8412-4ab7414d8126 req-02ebd1ac-5fa5-4e9e-b18b-b046f7d40a83 service nova] [instance: d775101d-53a1-48c7-af24-91480be6af61] Received unexpected event network-vif-plugged-646f5b58-acad-402e-bdf5-e5bd423c69e8 for instance with vm_state active and task_state rescuing.
Oct 16 18:34:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:19 user nova-compute[74247]: DEBUG nova.compute.manager [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:34:19 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:34:19 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Instance spawned successfully.
Oct 16 18:34:19 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 18:34:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:19 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:34:19 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:34:19 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:34:19 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:34:19 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:34:19 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:34:19 user nova-compute[74247]: INFO nova.compute.manager [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Took 5.78 seconds to spawn the instance on the hypervisor.
Oct 16 18:34:19 user nova-compute[74247]: DEBUG nova.compute.manager [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:34:19 user nova-compute[74247]: DEBUG nova.compute.manager [req-e9642fa7-cdee-42a4-9cc0-210f34989fa0 req-7934366f-6d46-4fbf-8512-7148825cf118 service nova] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Received event network-vif-plugged-b7a0865a-62eb-4517-83ba-eb30ff219e50 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:34:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e9642fa7-cdee-42a4-9cc0-210f34989fa0 req-7934366f-6d46-4fbf-8512-7148825cf118 service nova] Acquiring lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:34:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e9642fa7-cdee-42a4-9cc0-210f34989fa0 req-7934366f-6d46-4fbf-8512-7148825cf118 service nova] Lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:34:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e9642fa7-cdee-42a4-9cc0-210f34989fa0 req-7934366f-6d46-4fbf-8512-7148825cf118 service nova] Lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:34:19 user nova-compute[74247]: DEBUG nova.compute.manager [req-e9642fa7-cdee-42a4-9cc0-210f34989fa0 req-7934366f-6d46-4fbf-8512-7148825cf118 service nova] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] No waiting events found dispatching network-vif-plugged-b7a0865a-62eb-4517-83ba-eb30ff219e50 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:34:19 user nova-compute[74247]: WARNING nova.compute.manager [req-e9642fa7-cdee-42a4-9cc0-210f34989fa0 req-7934366f-6d46-4fbf-8512-7148825cf118 service nova] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Received unexpected event network-vif-plugged-b7a0865a-62eb-4517-83ba-eb30ff219e50 for instance with vm_state building and task_state spawning.
Oct 16 18:34:19 user nova-compute[74247]: INFO nova.compute.manager [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Took 31.47 seconds to build instance.
Oct 16 18:34:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0de4f773-3067-486d-bc1f-1f28c529bb8b tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.597s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:34:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:20 user nova-compute[74247]: DEBUG nova.compute.manager [req-f32a8a80-4841-4730-bf73-0ee910645811 req-a90ae750-531c-42a3-a2b6-076612efd998 service nova] [instance: d775101d-53a1-48c7-af24-91480be6af61] Received event network-vif-plugged-646f5b58-acad-402e-bdf5-e5bd423c69e8 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:34:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f32a8a80-4841-4730-bf73-0ee910645811 req-a90ae750-531c-42a3-a2b6-076612efd998 service nova] Acquiring lock "d775101d-53a1-48c7-af24-91480be6af61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:34:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f32a8a80-4841-4730-bf73-0ee910645811 req-a90ae750-531c-42a3-a2b6-076612efd998 service nova] Lock "d775101d-53a1-48c7-af24-91480be6af61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:34:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f32a8a80-4841-4730-bf73-0ee910645811 req-a90ae750-531c-42a3-a2b6-076612efd998 service nova] Lock "d775101d-53a1-48c7-af24-91480be6af61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:34:20 user nova-compute[74247]: DEBUG nova.compute.manager [req-f32a8a80-4841-4730-bf73-0ee910645811 req-a90ae750-531c-42a3-a2b6-076612efd998 service nova] [instance: d775101d-53a1-48c7-af24-91480be6af61] No waiting events found dispatching network-vif-plugged-646f5b58-acad-402e-bdf5-e5bd423c69e8 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:34:20 user nova-compute[74247]: WARNING nova.compute.manager [req-f32a8a80-4841-4730-bf73-0ee910645811 req-a90ae750-531c-42a3-a2b6-076612efd998 service nova] [instance: d775101d-53a1-48c7-af24-91480be6af61] Received unexpected event network-vif-plugged-646f5b58-acad-402e-bdf5-e5bd423c69e8 for instance with vm_state active and task_state rescuing.
Oct 16 18:34:20 user nova-compute[74247]: DEBUG nova.compute.manager [req-f32a8a80-4841-4730-bf73-0ee910645811 req-a90ae750-531c-42a3-a2b6-076612efd998 service nova] [instance: d775101d-53a1-48c7-af24-91480be6af61] Received event network-vif-plugged-646f5b58-acad-402e-bdf5-e5bd423c69e8 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:34:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f32a8a80-4841-4730-bf73-0ee910645811 req-a90ae750-531c-42a3-a2b6-076612efd998 service nova] Acquiring lock "d775101d-53a1-48c7-af24-91480be6af61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:34:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f32a8a80-4841-4730-bf73-0ee910645811 req-a90ae750-531c-42a3-a2b6-076612efd998 service nova] Lock "d775101d-53a1-48c7-af24-91480be6af61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:34:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f32a8a80-4841-4730-bf73-0ee910645811 req-a90ae750-531c-42a3-a2b6-076612efd998 service nova] Lock "d775101d-53a1-48c7-af24-91480be6af61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:34:20 user nova-compute[74247]: DEBUG nova.compute.manager [req-f32a8a80-4841-4730-bf73-0ee910645811 req-a90ae750-531c-42a3-a2b6-076612efd998 service nova] [instance: d775101d-53a1-48c7-af24-91480be6af61] No waiting events found dispatching network-vif-plugged-646f5b58-acad-402e-bdf5-e5bd423c69e8 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:34:20 user nova-compute[74247]: WARNING nova.compute.manager [req-f32a8a80-4841-4730-bf73-0ee910645811 req-a90ae750-531c-42a3-a2b6-076612efd998 service nova] [instance: d775101d-53a1-48c7-af24-91480be6af61] Received unexpected event network-vif-plugged-646f5b58-acad-402e-bdf5-e5bd423c69e8 for instance with vm_state active and task_state rescuing.
Oct 16 18:34:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:21 user nova-compute[74247]: DEBUG nova.compute.manager [None req-79d479c9-97bc-4c14-8e26-28407101108a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:34:22 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-39dbec7e-8b30-46d3-9d71-04dc2d3c9e54 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bbec99d1-82a3-4e4d-a3ae-17e00821bee1 is timed out.
Oct 16 18:34:22 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-39dbec7e-8b30-46d3-9d71-04dc2d3c9e54 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Successfully detached device vdb from instance bbec99d1-82a3-4e4d-a3ae-17e00821bee1 from the live domain config.
Oct 16 18:34:22 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39dbec7e-8b30-46d3-9d71-04dc2d3c9e54 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-39dbec7e-8b30-46d3-9d71-04dc2d3c9e54 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KFNyGMIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:34:22 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-39dbec7e-8b30-46d3-9d71-04dc2d3c9e54 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:34:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-39dbec7e-8b30-46d3-9d71-04dc2d3c9e54 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-39dbec7e-8b30-46d3-9d71-04dc2d3c9e54 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e88866f-0442-4c83-a1b9-1469b1bc7956]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-39dbec7e-8b30-46d3-9d71-04dc2d3c9e54 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 18:34:22 user nova-compute[74247]: No targets found.
Oct 16 18:34:22 user nova-compute[74247]: iSNS:
Oct 16 18:34:22 user nova-compute[74247]: No targets found.
Oct 16 18:34:22 user nova-compute[74247]: STATIC:
Oct 16 18:34:22 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313
Oct 16 18:34:22 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:34:22 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:34:22 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a
Oct 16 18:34:22 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:34:22 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:34:22 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e
Oct 16 18:34:22 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:34:22 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:34:22 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc
Oct 16 18:34:22 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:34:22 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:34:22 user nova-compute[74247]: FIRMWARE:
Oct 16 18:34:22 user nova-compute[74247]: No targets found.
Oct 16 18:34:22 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-39dbec7e-8b30-46d3-9d71-04dc2d3c9e54 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 18:34:22 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 18:34:22 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-39dbec7e-8b30-46d3-9d71-04dc2d3c9e54 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0426220-7464-48c8-b6a2-70a39f21e577]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b28ce3-1d52-495b-b275-d3ab439a6328]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-39dbec7e-8b30-46d3-9d71-04dc2d3c9e54 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:34:22 user nova-compute[74247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a (non-flash)
Oct 16 18:34:22 user nova-compute[74247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e (non-flash)
Oct 16 18:34:22 user nova-compute[74247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:34:22 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-39dbec7e-8b30-46d3-9d71-04dc2d3c9e54 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 (non-flash)
Oct 16 18:34:22 user nova-compute[74247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a (non-flash)
Oct 16 18:34:22 user nova-compute[74247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e (non-flash)
Oct 16 18:34:22 user nova-compute[74247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:34:22 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-39dbec7e-8b30-46d3-9d71-04dc2d3c9e54 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe048799d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313'): ({'sdb'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-39dbec7e-8b30-46d3-9d71-04dc2d3c9e54 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Removing single pathed devices sdb {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16bf879-fbba-4af0-945f-c2d7ac7d67e3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[791fcdec-cdbc-4bd0-9b83-aac60f201a42]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-39dbec7e-8b30-46d3-9d71-04dc2d3c9e54 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Flushing IO for device /dev/sdb {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[682929fa-e1cf-4581-9b75-119683c5bd4a]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-39dbec7e-8b30-46d3-9d71-04dc2d3c9e54 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d86e314-4d9f-4339-b67d-06ced2393065]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-39dbec7e-8b30-46d3-9d71-04dc2d3c9e54 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-39dbec7e-8b30-46d3-9d71-04dc2d3c9e54 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] SCSI volumes sdb have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-39dbec7e-8b30-46d3-9d71-04dc2d3c9e54 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[55dd367f-89a2-4a6d-b1c8-02b883f2183e]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-39dbec7e-8b30-46d3-9d71-04dc2d3c9e54 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b0fc23-a92b-4e97-962f-d8c122ccdd62]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-39dbec7e-8b30-46d3-9d71-04dc2d3c9e54 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313, portal: 172.16.0.220,3260]
Oct 16 18:34:22 user nova-compute[74247]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313, portal: 172.16.0.220,3260] successful.
Oct 16 18:34:22 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91e22910-3fb9-43fd-ac65-70fb0215b313 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49061b3-c526-44f8-87db-9a6b093f0ba1]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-39dbec7e-8b30-46d3-9d71-04dc2d3c9e54 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-39dbec7e-8b30-46d3-9d71-04dc2d3c9e54 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-39dbec7e-8b30-46d3-9d71-04dc2d3c9e54 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] <== disconnect_volume: return (372ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:34:22 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39dbec7e-8b30-46d3-9d71-04dc2d3c9e54 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 18:34:23 user nova-compute[74247]: DEBUG nova.objects.instance [None req-39dbec7e-8b30-46d3-9d71-04dc2d3c9e54 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lazy-loading 'flavor' on Instance uuid bbec99d1-82a3-4e4d-a3ae-17e00821bee1 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:34:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-39dbec7e-8b30-46d3-9d71-04dc2d3c9e54 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "bbec99d1-82a3-4e4d-a3ae-17e00821bee1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.090s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:34:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-52ec4079-41ad-4693-bf48-31dfec4e0e38 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Acquiring lock "7c17a25b-6818-48fa-b406-638dbf1845d4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:34:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-52ec4079-41ad-4693-bf48-31dfec4e0e38 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lock "7c17a25b-6818-48fa-b406-638dbf1845d4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:34:26 user nova-compute[74247]: INFO nova.compute.manager [None req-52ec4079-41ad-4693-bf48-31dfec4e0e38 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Detaching volume 434ea0ef-34e5-4e31-aef0-3886568d333a
Oct 16 18:34:26 user nova-compute[74247]: INFO nova.virt.block_device [None req-52ec4079-41ad-4693-bf48-31dfec4e0e38 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Attempting to driver detach volume 434ea0ef-34e5-4e31-aef0-3886568d333a from mountpoint /dev/vdb
Oct 16 18:34:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-52ec4079-41ad-4693-bf48-31dfec4e0e38 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Attempting to detach device vdb from instance 7c17a25b-6818-48fa-b406-638dbf1845d4 from the persistent domain config. {{(pid=74247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 18:34:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-52ec4079-41ad-4693-bf48-31dfec4e0e38 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 18:34:26 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:34:26 user nova-compute[74247]:   <source dev="/dev/sdg"/>
Oct 16 18:34:26 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:34:26 user nova-compute[74247]:   <serial>434ea0ef-34e5-4e31-aef0-3886568d333a</serial>
Oct 16 18:34:26 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 18:34:26 user nova-compute[74247]: </disk>
Oct 16 18:34:26 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:34:26 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-52ec4079-41ad-4693-bf48-31dfec4e0e38 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Successfully detached device vdb from instance 7c17a25b-6818-48fa-b406-638dbf1845d4 from the persistent domain config.
Oct 16 18:34:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-52ec4079-41ad-4693-bf48-31dfec4e0e38 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7c17a25b-6818-48fa-b406-638dbf1845d4 from the live domain config. {{(pid=74247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 18:34:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-52ec4079-41ad-4693-bf48-31dfec4e0e38 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 18:34:26 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:34:26 user nova-compute[74247]:   <source dev="/dev/sdg"/>
Oct 16 18:34:26 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:34:26 user nova-compute[74247]:   <serial>434ea0ef-34e5-4e31-aef0-3886568d333a</serial>
Oct 16 18:34:26 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 18:34:26 user nova-compute[74247]: </disk>
Oct 16 18:34:26 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:34:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-52ec4079-41ad-4693-bf48-31dfec4e0e38 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7c17a25b-6818-48fa-b406-638dbf1845d4 {{(pid=74247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 18:34:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:40 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:46 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:46 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-52ec4079-41ad-4693-bf48-31dfec4e0e38 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7c17a25b-6818-48fa-b406-638dbf1845d4 is timed out.
Oct 16 18:34:46 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-52ec4079-41ad-4693-bf48-31dfec4e0e38 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Successfully detached device vdb from instance 7c17a25b-6818-48fa-b406-638dbf1845d4 from the live domain config.
Oct 16 18:34:46 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52ec4079-41ad-4693-bf48-31dfec4e0e38 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 18:34:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ec4079-41ad-4693-bf48-31dfec4e0e38 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tNSdcMQl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:34:46 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-52ec4079-41ad-4693-bf48-31dfec4e0e38 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:34:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-52ec4079-41ad-4693-bf48-31dfec4e0e38 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:34:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-52ec4079-41ad-4693-bf48-31dfec4e0e38 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:34:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:46 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcb5cb6-24d6-4579-8d05-b331024fe196]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:34:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ec4079-41ad-4693-bf48-31dfec4e0e38 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 18:34:46 user nova-compute[74247]: No targets found.
Oct 16 18:34:46 user nova-compute[74247]: iSNS:
Oct 16 18:34:46 user nova-compute[74247]: No targets found.
Oct 16 18:34:46 user nova-compute[74247]: STATIC:
Oct 16 18:34:46 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a
Oct 16 18:34:46 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:34:46 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:34:46 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e
Oct 16 18:34:46 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:34:46 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:34:46 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc
Oct 16 18:34:46 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:34:46 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:34:46 user nova-compute[74247]: FIRMWARE:
Oct 16 18:34:46 user nova-compute[74247]: No targets found.
Oct 16 18:34:46 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:34:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ec4079-41ad-4693-bf48-31dfec4e0e38 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 18:34:46 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 18:34:46 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 18:34:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ec4079-41ad-4693-bf48-31dfec4e0e38 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 18:34:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:46 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[84236162-6033-4e55-ba9e-3b69157c5f9d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:34:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:46 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8409fb3-47e6-49b5-b71b-8b7928b04eea]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:34:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ec4079-41ad-4693-bf48-31dfec4e0e38 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a (non-flash)
Oct 16 18:34:46 user nova-compute[74247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e (non-flash)
Oct 16 18:34:46 user nova-compute[74247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:34:46 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:34:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ec4079-41ad-4693-bf48-31dfec4e0e38 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a (non-flash)
Oct 16 18:34:46 user nova-compute[74247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e (non-flash)
Oct 16 18:34:46 user nova-compute[74247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:34:46 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:34:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ec4079-41ad-4693-bf48-31dfec4e0e38 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe0484404c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a'): ({'sdg'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 18:34:46 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-52ec4079-41ad-4693-bf48-31dfec4e0e38 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Removing single pathed devices sdg {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 18:34:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:47 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb769c6-b5b5-4a91-9783-ff32a0dd2a3a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:34:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:47 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c23cea-8672-4ee2-a900-4b3d24126162]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:34:47 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-52ec4079-41ad-4693-bf48-31dfec4e0e38 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Flushing IO for device /dev/sdg {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 18:34:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:47 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2dac908-208d-4bfc-bf22-0950e62db2e1]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:34:47 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-52ec4079-41ad-4693-bf48-31dfec4e0e38 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 18:34:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.039s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:47 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[88eb7ff1-12be-43bd-b87b-b6d0d0e1a018]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:34:47 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-52ec4079-41ad-4693-bf48-31dfec4e0e38 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 18:34:47 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-52ec4079-41ad-4693-bf48-31dfec4e0e38 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] SCSI volumes sdg have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 18:34:47 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ec4079-41ad-4693-bf48-31dfec4e0e38 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 18:34:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.075s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:47 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[314d7165-c0c4-4578-a969-e7f6608aeff6]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:34:47 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ec4079-41ad-4693-bf48-31dfec4e0e38 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:34:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:47 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5177327-385c-4e6f-9e96-ef6a34ef1ade]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:34:47 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ec4079-41ad-4693-bf48-31dfec4e0e38 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a, portal: 172.16.0.220,3260]
Oct 16 18:34:47 user nova-compute[74247]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a, portal: 172.16.0.220,3260] successful.
Oct 16 18:34:47 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:34:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:34:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:434ea0ef-34e5-4e31-aef0-3886568d333a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:34:47 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[37047a67-5e71-451a-ac62-1176f17a4cd8]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:34:47 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ec4079-41ad-4693-bf48-31dfec4e0e38 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:34:47 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-52ec4079-41ad-4693-bf48-31dfec4e0e38 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:34:47 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ec4079-41ad-4693-bf48-31dfec4e0e38 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] <== disconnect_volume: return (378ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:34:47 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52ec4079-41ad-4693-bf48-31dfec4e0e38 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 18:34:47 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:34:47 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Cleaning up deleted instances with incomplete migration  {{(pid=74247) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 16 18:34:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0c46cc51-98de-4602-b38d-8d9e2789d138 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "bbec99d1-82a3-4e4d-a3ae-17e00821bee1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:34:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0c46cc51-98de-4602-b38d-8d9e2789d138 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "bbec99d1-82a3-4e4d-a3ae-17e00821bee1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:34:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0c46cc51-98de-4602-b38d-8d9e2789d138 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "bbec99d1-82a3-4e4d-a3ae-17e00821bee1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:34:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0c46cc51-98de-4602-b38d-8d9e2789d138 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "bbec99d1-82a3-4e4d-a3ae-17e00821bee1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:34:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0c46cc51-98de-4602-b38d-8d9e2789d138 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "bbec99d1-82a3-4e4d-a3ae-17e00821bee1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:34:52 user nova-compute[74247]: INFO nova.compute.manager [None req-0c46cc51-98de-4602-b38d-8d9e2789d138 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Terminating instance
Oct 16 18:34:52 user nova-compute[74247]: DEBUG nova.compute.manager [None req-0c46cc51-98de-4602-b38d-8d9e2789d138 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 18:34:52 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:52 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:52 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:52 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:52 user nova-compute[74247]: DEBUG nova.compute.manager [req-e89f9381-c6cf-4f11-9c4d-c16ecc649336 req-db8e698f-f430-451f-8694-be3da396fb33 service nova] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Received event network-vif-unplugged-db973a04-4ef6-40c2-a694-c7a12631bc59 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:34:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e89f9381-c6cf-4f11-9c4d-c16ecc649336 req-db8e698f-f430-451f-8694-be3da396fb33 service nova] Acquiring lock "bbec99d1-82a3-4e4d-a3ae-17e00821bee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:34:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e89f9381-c6cf-4f11-9c4d-c16ecc649336 req-db8e698f-f430-451f-8694-be3da396fb33 service nova] Lock "bbec99d1-82a3-4e4d-a3ae-17e00821bee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:34:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e89f9381-c6cf-4f11-9c4d-c16ecc649336 req-db8e698f-f430-451f-8694-be3da396fb33 service nova] Lock "bbec99d1-82a3-4e4d-a3ae-17e00821bee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:34:52 user nova-compute[74247]: DEBUG nova.compute.manager [req-e89f9381-c6cf-4f11-9c4d-c16ecc649336 req-db8e698f-f430-451f-8694-be3da396fb33 service nova] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] No waiting events found dispatching network-vif-unplugged-db973a04-4ef6-40c2-a694-c7a12631bc59 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:34:52 user nova-compute[74247]: DEBUG nova.compute.manager [req-e89f9381-c6cf-4f11-9c4d-c16ecc649336 req-db8e698f-f430-451f-8694-be3da396fb33 service nova] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Received event network-vif-unplugged-db973a04-4ef6-40c2-a694-c7a12631bc59 for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:34:53 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Instance destroyed successfully.
Oct 16 18:34:53 user nova-compute[74247]: DEBUG nova.objects.instance [None req-0c46cc51-98de-4602-b38d-8d9e2789d138 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lazy-loading 'resources' on Instance uuid bbec99d1-82a3-4e4d-a3ae-17e00821bee1 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:34:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-0c46cc51-98de-4602-b38d-8d9e2789d138 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T18:27:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1420825392',display_name='tempest-ServerActionsTestOtherA-server-584745225',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1420825392',id=13,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/3EvcYxSkv6EajRRkIzaFJ7f6uQhbqAKTds5ThHn386Pv+2tTgzyep551R0scho5zPYioOvrd00bJSB88s5K62otshFm+0x2KfMMxvYgCDs49Lx6Y3dzbzd3EgGqdZmw==',key_name='tempest-keypair-461314413',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:31:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42bd3eb752f04fd48dfe0623fdf2fe9f',ramdisk_id='',reservation_id='r-vea0fn6c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-291765974',owner_user_name='tempest-ServerActionsTestOtherA-291765974-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:31:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3635a30f06234f0d9a8e0604c25f1208',uuid=bbec99d1-82a3-4e4d-a3ae-17e00821bee1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db973a04-4ef6-40c2-a694-c7a12631bc59", "address": "fa:16:3e:d4:26:c0", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb973a04-4e", "ovs_interfaceid": "db973a04-4ef6-40c2-a694-c7a12631bc59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:34:53 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-0c46cc51-98de-4602-b38d-8d9e2789d138 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Converting VIF {"id": "db973a04-4ef6-40c2-a694-c7a12631bc59", "address": "fa:16:3e:d4:26:c0", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb973a04-4e", "ovs_interfaceid": "db973a04-4ef6-40c2-a694-c7a12631bc59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:34:53 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-0c46cc51-98de-4602-b38d-8d9e2789d138 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:26:c0,bridge_name='br-int',has_traffic_filtering=True,id=db973a04-4ef6-40c2-a694-c7a12631bc59,network=Network(0a61bae1-2607-4e42-b573-e74ac3edf09a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb973a04-4e') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:34:53 user nova-compute[74247]: DEBUG os_vif [None req-0c46cc51-98de-4602-b38d-8d9e2789d138 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:26:c0,bridge_name='br-int',has_traffic_filtering=True,id=db973a04-4ef6-40c2-a694-c7a12631bc59,network=Network(0a61bae1-2607-4e42-b573-e74ac3edf09a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb973a04-4e') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:34:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb973a04-4e, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:34:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:34:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0d3b27c6-9402-4b2d-bc10-191219e67685) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:34:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:53 user nova-compute[74247]: INFO os_vif [None req-0c46cc51-98de-4602-b38d-8d9e2789d138 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:26:c0,bridge_name='br-int',has_traffic_filtering=True,id=db973a04-4ef6-40c2-a694-c7a12631bc59,network=Network(0a61bae1-2607-4e42-b573-e74ac3edf09a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb973a04-4e')
Oct 16 18:34:53 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-0c46cc51-98de-4602-b38d-8d9e2789d138 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Deleting instance files /opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1_del
Oct 16 18:34:53 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-0c46cc51-98de-4602-b38d-8d9e2789d138 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Deletion of /opt/stack/data/nova/instances/bbec99d1-82a3-4e4d-a3ae-17e00821bee1_del complete
Oct 16 18:34:53 user nova-compute[74247]: INFO nova.compute.manager [None req-0c46cc51-98de-4602-b38d-8d9e2789d138 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Took 0.93 seconds to destroy the instance on the hypervisor.
Oct 16 18:34:53 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-0c46cc51-98de-4602-b38d-8d9e2789d138 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 18:34:53 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 18:34:53 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 18:34:53 user nova-compute[74247]: DEBUG nova.objects.instance [None req-52ec4079-41ad-4693-bf48-31dfec4e0e38 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lazy-loading 'flavor' on Instance uuid 7c17a25b-6818-48fa-b406-638dbf1845d4 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:34:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-52ec4079-41ad-4693-bf48-31dfec4e0e38 tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lock "7c17a25b-6818-48fa-b406-638dbf1845d4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 27.477s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:34:54 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:34:54 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Took 1.39 seconds to deallocate network for instance.
Oct 16 18:34:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0c46cc51-98de-4602-b38d-8d9e2789d138 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:34:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0c46cc51-98de-4602-b38d-8d9e2789d138 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:34:54 user nova-compute[74247]: DEBUG nova.compute.manager [req-1fed96ba-7c44-4987-914b-da00b7fbc3dc req-84787747-9e72-48d8-a7a5-5d074a471c42 service nova] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Received event network-vif-plugged-db973a04-4ef6-40c2-a694-c7a12631bc59 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:34:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1fed96ba-7c44-4987-914b-da00b7fbc3dc req-84787747-9e72-48d8-a7a5-5d074a471c42 service nova] Acquiring lock "bbec99d1-82a3-4e4d-a3ae-17e00821bee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:34:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1fed96ba-7c44-4987-914b-da00b7fbc3dc req-84787747-9e72-48d8-a7a5-5d074a471c42 service nova] Lock "bbec99d1-82a3-4e4d-a3ae-17e00821bee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:34:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1fed96ba-7c44-4987-914b-da00b7fbc3dc req-84787747-9e72-48d8-a7a5-5d074a471c42 service nova] Lock "bbec99d1-82a3-4e4d-a3ae-17e00821bee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:34:54 user nova-compute[74247]: DEBUG nova.compute.manager [req-1fed96ba-7c44-4987-914b-da00b7fbc3dc req-84787747-9e72-48d8-a7a5-5d074a471c42 service nova] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] No waiting events found dispatching network-vif-plugged-db973a04-4ef6-40c2-a694-c7a12631bc59 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:34:54 user nova-compute[74247]: WARNING nova.compute.manager [req-1fed96ba-7c44-4987-914b-da00b7fbc3dc req-84787747-9e72-48d8-a7a5-5d074a471c42 service nova] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Received unexpected event network-vif-plugged-db973a04-4ef6-40c2-a694-c7a12631bc59 for instance with vm_state deleted and task_state None.
Oct 16 18:34:54 user nova-compute[74247]: DEBUG nova.compute.manager [req-1fed96ba-7c44-4987-914b-da00b7fbc3dc req-84787747-9e72-48d8-a7a5-5d074a471c42 service nova] [instance: bbec99d1-82a3-4e4d-a3ae-17e00821bee1] Received event network-vif-deleted-db973a04-4ef6-40c2-a694-c7a12631bc59 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:34:55 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-0c46cc51-98de-4602-b38d-8d9e2789d138 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:34:55 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-0c46cc51-98de-4602-b38d-8d9e2789d138 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:34:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0c46cc51-98de-4602-b38d-8d9e2789d138 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.554s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:34:55 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-0c46cc51-98de-4602-b38d-8d9e2789d138 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Deleted allocations for instance bbec99d1-82a3-4e4d-a3ae-17e00821bee1
Oct 16 18:34:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0c46cc51-98de-4602-b38d-8d9e2789d138 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "bbec99d1-82a3-4e4d-a3ae-17e00821bee1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.123s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:34:55 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:34:55 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Cleaning up deleted instances {{(pid=74247) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 16 18:34:55 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] There are 0 instances to clean {{(pid=74247) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 16 18:34:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:57 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:34:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:34:58 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:34:58 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 18:34:58 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Didn't find any instances for network info cache update. {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 18:34:58 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:34:58 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:34:58 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:34:59 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:35:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:00 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:35:01 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:35:02 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:35:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:35:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:35:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:35:02 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 18:35:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6367b6d-1bc2-4472-b0c4-07baec4a28b0/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:35:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6367b6d-1bc2-4472-b0c4-07baec4a28b0/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:35:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6367b6d-1bc2-4472-b0c4-07baec4a28b0/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:35:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6367b6d-1bc2-4472-b0c4-07baec4a28b0/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:35:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:35:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:35:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:35:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:35:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:35:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed343632-72bc-40f0-9698-fe4bd67c56d7/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:35:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed343632-72bc-40f0-9698-fe4bd67c56d7/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:35:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed343632-72bc-40f0-9698-fe4bd67c56d7/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:35:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed343632-72bc-40f0-9698-fe4bd67c56d7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:35:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:35:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:35:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:35:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:35:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:35:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:35:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:35:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:35:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:35:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:35:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:35:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:35:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:35:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:35:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:35:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:35:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:35:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:35:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:35:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:35:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:35:06 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:35:06 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:35:06 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=7748MB free_disk=25.093921661376953GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 18:35:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:35:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:35:06 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance e37fbc27-3404-479a-be08-4d590391cf30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:35:06 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 7c17a25b-6818-48fa-b406-638dbf1845d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:35:06 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance cddf4842-1c25-4cc8-914e-af30849e4d6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:35:06 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance d6367b6d-1bc2-4472-b0c4-07baec4a28b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:35:06 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 958af87e-69d0-4da1-8fcf-90e0f275d62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:35:06 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance d775101d-53a1-48c7-af24-91480be6af61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:35:06 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance ed343632-72bc-40f0-9698-fe4bd67c56d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:35:06 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 7dcc08e9-7439-436b-8d9f-facaf04e22c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:35:06 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 18:35:06 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 18:35:06 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Refreshing inventories for resource provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 16 18:35:06 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Updating ProviderTree inventory for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 16 18:35:06 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Updating inventory in ProviderTree for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 16 18:35:06 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Refreshing aggregate associations for resource provider 7b8a7b7b-c686-4162-903b-700fbc4d7273, aggregates: None {{(pid=74247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 16 18:35:07 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Refreshing trait associations for resource provider 7b8a7b7b-c686-4162-903b-700fbc4d7273, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=74247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 16 18:35:07 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:35:07 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:35:07 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 18:35:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.570s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:35:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:35:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:10 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:35:10 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 18:35:10 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:12 user nova-compute[74247]: DEBUG nova.compute.manager [req-b728905a-3d7b-4e6a-8065-f36e95c93c43 req-a327e61e-b37b-411f-a5f9-a8972fb075b0 service nova] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Received event network-changed-819231ee-2f65-441d-b02b-57ef317f0e1e {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:35:12 user nova-compute[74247]: DEBUG nova.compute.manager [req-b728905a-3d7b-4e6a-8065-f36e95c93c43 req-a327e61e-b37b-411f-a5f9-a8972fb075b0 service nova] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Refreshing instance network info cache due to event network-changed-819231ee-2f65-441d-b02b-57ef317f0e1e. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:35:12 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-b728905a-3d7b-4e6a-8065-f36e95c93c43 req-a327e61e-b37b-411f-a5f9-a8972fb075b0 service nova] Acquiring lock "refresh_cache-ed343632-72bc-40f0-9698-fe4bd67c56d7" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:35:12 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-b728905a-3d7b-4e6a-8065-f36e95c93c43 req-a327e61e-b37b-411f-a5f9-a8972fb075b0 service nova] Acquired lock "refresh_cache-ed343632-72bc-40f0-9698-fe4bd67c56d7" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:35:12 user nova-compute[74247]: DEBUG nova.network.neutron [req-b728905a-3d7b-4e6a-8065-f36e95c93c43 req-a327e61e-b37b-411f-a5f9-a8972fb075b0 service nova] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Refreshing network info cache for port 819231ee-2f65-441d-b02b-57ef317f0e1e {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:35:12 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-55ae318d-ccd7-4045-b1d8-2e0608a350be tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "ed343632-72bc-40f0-9698-fe4bd67c56d7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:35:12 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-55ae318d-ccd7-4045-b1d8-2e0608a350be tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "ed343632-72bc-40f0-9698-fe4bd67c56d7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:35:12 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-55ae318d-ccd7-4045-b1d8-2e0608a350be tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "ed343632-72bc-40f0-9698-fe4bd67c56d7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:35:12 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-55ae318d-ccd7-4045-b1d8-2e0608a350be tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "ed343632-72bc-40f0-9698-fe4bd67c56d7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:35:12 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-55ae318d-ccd7-4045-b1d8-2e0608a350be tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "ed343632-72bc-40f0-9698-fe4bd67c56d7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:35:12 user nova-compute[74247]: INFO nova.compute.manager [None req-55ae318d-ccd7-4045-b1d8-2e0608a350be tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Terminating instance
Oct 16 18:35:12 user nova-compute[74247]: DEBUG nova.compute.manager [None req-55ae318d-ccd7-4045-b1d8-2e0608a350be tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 18:35:12 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:12 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:13 user nova-compute[74247]: DEBUG nova.network.neutron [req-b728905a-3d7b-4e6a-8065-f36e95c93c43 req-a327e61e-b37b-411f-a5f9-a8972fb075b0 service nova] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Updated VIF entry in instance network info cache for port 819231ee-2f65-441d-b02b-57ef317f0e1e. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:35:13 user nova-compute[74247]: DEBUG nova.network.neutron [req-b728905a-3d7b-4e6a-8065-f36e95c93c43 req-a327e61e-b37b-411f-a5f9-a8972fb075b0 service nova] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Updating instance_info_cache with network_info: [{"id": "819231ee-2f65-441d-b02b-57ef317f0e1e", "address": "fa:16:3e:69:eb:2e", "network": {"id": "fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1988491128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96ced9d4c0c474fbc7edeed6f73324a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap819231ee-2f", "ovs_interfaceid": "819231ee-2f65-441d-b02b-57ef317f0e1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:35:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-b728905a-3d7b-4e6a-8065-f36e95c93c43 req-a327e61e-b37b-411f-a5f9-a8972fb075b0 service nova] Releasing lock "refresh_cache-ed343632-72bc-40f0-9698-fe4bd67c56d7" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:35:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:13 user nova-compute[74247]: DEBUG nova.compute.manager [req-475452b0-4b61-4aa0-a050-ed095d284e13 req-bdbd966e-e530-4c58-918a-251057b5cbd1 service nova] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Received event network-vif-unplugged-819231ee-2f65-441d-b02b-57ef317f0e1e {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:35:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-475452b0-4b61-4aa0-a050-ed095d284e13 req-bdbd966e-e530-4c58-918a-251057b5cbd1 service nova] Acquiring lock "ed343632-72bc-40f0-9698-fe4bd67c56d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:35:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-475452b0-4b61-4aa0-a050-ed095d284e13 req-bdbd966e-e530-4c58-918a-251057b5cbd1 service nova] Lock "ed343632-72bc-40f0-9698-fe4bd67c56d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:35:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-475452b0-4b61-4aa0-a050-ed095d284e13 req-bdbd966e-e530-4c58-918a-251057b5cbd1 service nova] Lock "ed343632-72bc-40f0-9698-fe4bd67c56d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:35:13 user nova-compute[74247]: DEBUG nova.compute.manager [req-475452b0-4b61-4aa0-a050-ed095d284e13 req-bdbd966e-e530-4c58-918a-251057b5cbd1 service nova] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] No waiting events found dispatching network-vif-unplugged-819231ee-2f65-441d-b02b-57ef317f0e1e {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:35:13 user nova-compute[74247]: DEBUG nova.compute.manager [req-475452b0-4b61-4aa0-a050-ed095d284e13 req-bdbd966e-e530-4c58-918a-251057b5cbd1 service nova] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Received event network-vif-unplugged-819231ee-2f65-441d-b02b-57ef317f0e1e for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:35:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:13 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Instance destroyed successfully.
Oct 16 18:35:13 user nova-compute[74247]: DEBUG nova.objects.instance [None req-55ae318d-ccd7-4045-b1d8-2e0608a350be tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lazy-loading 'resources' on Instance uuid ed343632-72bc-40f0-9698-fe4bd67c56d7 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:35:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-55ae318d-ccd7-4045-b1d8-2e0608a350be tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:33:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-66152859',display_name='tempest-AttachVolumeNegativeTest-server-66152859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-66152859',id=21,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+BQnWXCr6juEzLQ9elUzo2VhDYD9XdUJOq42txq/yR3B32aUKTk8SDwxKLzugG5SBLiaM3QGcRGxzEfVJ+hRLbj2uYOfVA2F26nK6uVHGBoOWFBwJZNowi1hAOBVb9+A==',key_name='tempest-keypair-638332018',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:33:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c96ced9d4c0c474fbc7edeed6f73324a',ramdisk_id='',reservation_id='r-cktorekz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1731725928',owner_user_name='tempest-AttachVolumeNegativeTest-1731725928-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:33:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bd70613da1f489f86227655ff364795',uuid=ed343632-72bc-40f0-9698-fe4bd67c56d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "819231ee-2f65-441d-b02b-57ef317f0e1e", "address": "fa:16:3e:69:eb:2e", "network": {"id": "fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1988491128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96ced9d4c0c474fbc7edeed6f73324a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap819231ee-2f", "ovs_interfaceid": "819231ee-2f65-441d-b02b-57ef317f0e1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:35:13 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-55ae318d-ccd7-4045-b1d8-2e0608a350be tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Converting VIF {"id": "819231ee-2f65-441d-b02b-57ef317f0e1e", "address": "fa:16:3e:69:eb:2e", "network": {"id": "fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1988491128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96ced9d4c0c474fbc7edeed6f73324a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap819231ee-2f", "ovs_interfaceid": "819231ee-2f65-441d-b02b-57ef317f0e1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:35:13 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-55ae318d-ccd7-4045-b1d8-2e0608a350be tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:eb:2e,bridge_name='br-int',has_traffic_filtering=True,id=819231ee-2f65-441d-b02b-57ef317f0e1e,network=Network(fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap819231ee-2f') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:35:13 user nova-compute[74247]: DEBUG os_vif [None req-55ae318d-ccd7-4045-b1d8-2e0608a350be tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:eb:2e,bridge_name='br-int',has_traffic_filtering=True,id=819231ee-2f65-441d-b02b-57ef317f0e1e,network=Network(fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap819231ee-2f') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:35:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap819231ee-2f, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:35:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:35:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eef056ba-7f14-4e2a-b33d-10c400014f5d) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:35:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:35:13 user nova-compute[74247]: INFO os_vif [None req-55ae318d-ccd7-4045-b1d8-2e0608a350be tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:eb:2e,bridge_name='br-int',has_traffic_filtering=True,id=819231ee-2f65-441d-b02b-57ef317f0e1e,network=Network(fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap819231ee-2f')
Oct 16 18:35:13 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-55ae318d-ccd7-4045-b1d8-2e0608a350be tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Deleting instance files /opt/stack/data/nova/instances/ed343632-72bc-40f0-9698-fe4bd67c56d7_del
Oct 16 18:35:13 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-55ae318d-ccd7-4045-b1d8-2e0608a350be tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Deletion of /opt/stack/data/nova/instances/ed343632-72bc-40f0-9698-fe4bd67c56d7_del complete
Oct 16 18:35:13 user nova-compute[74247]: INFO nova.compute.manager [None req-55ae318d-ccd7-4045-b1d8-2e0608a350be tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 16 18:35:13 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-55ae318d-ccd7-4045-b1d8-2e0608a350be tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 18:35:13 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 18:35:13 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 18:35:14 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:35:14 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Took 0.70 seconds to deallocate network for instance.
Oct 16 18:35:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-55ae318d-ccd7-4045-b1d8-2e0608a350be tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:35:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-55ae318d-ccd7-4045-b1d8-2e0608a350be tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:35:14 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-55ae318d-ccd7-4045-b1d8-2e0608a350be tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:35:14 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-55ae318d-ccd7-4045-b1d8-2e0608a350be tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:35:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-55ae318d-ccd7-4045-b1d8-2e0608a350be tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.307s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:35:14 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-55ae318d-ccd7-4045-b1d8-2e0608a350be tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Deleted allocations for instance ed343632-72bc-40f0-9698-fe4bd67c56d7
Oct 16 18:35:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-55ae318d-ccd7-4045-b1d8-2e0608a350be tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "ed343632-72bc-40f0-9698-fe4bd67c56d7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.080s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:35:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:15 user nova-compute[74247]: DEBUG nova.compute.manager [req-74ca512a-2a35-42da-88c9-1f4a75d73c97 req-7b66aefc-da00-4c7a-bae6-06e9a849972c service nova] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Received event network-vif-plugged-819231ee-2f65-441d-b02b-57ef317f0e1e {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:35:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-74ca512a-2a35-42da-88c9-1f4a75d73c97 req-7b66aefc-da00-4c7a-bae6-06e9a849972c service nova] Acquiring lock "ed343632-72bc-40f0-9698-fe4bd67c56d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:35:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-74ca512a-2a35-42da-88c9-1f4a75d73c97 req-7b66aefc-da00-4c7a-bae6-06e9a849972c service nova] Lock "ed343632-72bc-40f0-9698-fe4bd67c56d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:35:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-74ca512a-2a35-42da-88c9-1f4a75d73c97 req-7b66aefc-da00-4c7a-bae6-06e9a849972c service nova] Lock "ed343632-72bc-40f0-9698-fe4bd67c56d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:35:15 user nova-compute[74247]: DEBUG nova.compute.manager [req-74ca512a-2a35-42da-88c9-1f4a75d73c97 req-7b66aefc-da00-4c7a-bae6-06e9a849972c service nova] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] No waiting events found dispatching network-vif-plugged-819231ee-2f65-441d-b02b-57ef317f0e1e {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:35:15 user nova-compute[74247]: WARNING nova.compute.manager [req-74ca512a-2a35-42da-88c9-1f4a75d73c97 req-7b66aefc-da00-4c7a-bae6-06e9a849972c service nova] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Received unexpected event network-vif-plugged-819231ee-2f65-441d-b02b-57ef317f0e1e for instance with vm_state deleted and task_state None.
Oct 16 18:35:15 user nova-compute[74247]: DEBUG nova.compute.manager [req-74ca512a-2a35-42da-88c9-1f4a75d73c97 req-7b66aefc-da00-4c7a-bae6-06e9a849972c service nova] [instance: ed343632-72bc-40f0-9698-fe4bd67c56d7] Received event network-vif-deleted-819231ee-2f65-441d-b02b-57ef317f0e1e {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:35:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-981b4cb8-15f4-4fa3-b0a4-dbfafec6e70c tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Acquiring lock "7c17a25b-6818-48fa-b406-638dbf1845d4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:35:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-981b4cb8-15f4-4fa3-b0a4-dbfafec6e70c tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lock "7c17a25b-6818-48fa-b406-638dbf1845d4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:35:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-981b4cb8-15f4-4fa3-b0a4-dbfafec6e70c tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Acquiring lock "7c17a25b-6818-48fa-b406-638dbf1845d4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:35:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-981b4cb8-15f4-4fa3-b0a4-dbfafec6e70c tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lock "7c17a25b-6818-48fa-b406-638dbf1845d4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:35:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-981b4cb8-15f4-4fa3-b0a4-dbfafec6e70c tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lock "7c17a25b-6818-48fa-b406-638dbf1845d4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:35:17 user nova-compute[74247]: INFO nova.compute.manager [None req-981b4cb8-15f4-4fa3-b0a4-dbfafec6e70c tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Terminating instance
Oct 16 18:35:17 user nova-compute[74247]: DEBUG nova.compute.manager [None req-981b4cb8-15f4-4fa3-b0a4-dbfafec6e70c tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 18:35:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:17 user nova-compute[74247]: DEBUG nova.compute.manager [req-db8ca1f3-7969-46ae-a232-c9d4a994a33a req-1d90ecd5-73bf-4000-8705-f85083431b8c service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Received event network-vif-unplugged-5f5253f2-6e79-44f0-a4aa-167f273e7c6a {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:35:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-db8ca1f3-7969-46ae-a232-c9d4a994a33a req-1d90ecd5-73bf-4000-8705-f85083431b8c service nova] Acquiring lock "7c17a25b-6818-48fa-b406-638dbf1845d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:35:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-db8ca1f3-7969-46ae-a232-c9d4a994a33a req-1d90ecd5-73bf-4000-8705-f85083431b8c service nova] Lock "7c17a25b-6818-48fa-b406-638dbf1845d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:35:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-db8ca1f3-7969-46ae-a232-c9d4a994a33a req-1d90ecd5-73bf-4000-8705-f85083431b8c service nova] Lock "7c17a25b-6818-48fa-b406-638dbf1845d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:35:17 user nova-compute[74247]: DEBUG nova.compute.manager [req-db8ca1f3-7969-46ae-a232-c9d4a994a33a req-1d90ecd5-73bf-4000-8705-f85083431b8c service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] No waiting events found dispatching network-vif-unplugged-5f5253f2-6e79-44f0-a4aa-167f273e7c6a {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:35:17 user nova-compute[74247]: DEBUG nova.compute.manager [req-db8ca1f3-7969-46ae-a232-c9d4a994a33a req-1d90ecd5-73bf-4000-8705-f85083431b8c service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Received event network-vif-unplugged-5f5253f2-6e79-44f0-a4aa-167f273e7c6a for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:35:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:17 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Instance destroyed successfully.
Oct 16 18:35:17 user nova-compute[74247]: DEBUG nova.objects.instance [None req-981b4cb8-15f4-4fa3-b0a4-dbfafec6e70c tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lazy-loading 'resources' on Instance uuid 7c17a25b-6818-48fa-b406-638dbf1845d4 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:35:17 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-981b4cb8-15f4-4fa3-b0a4-dbfafec6e70c tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:27:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2056095538',display_name='tempest-ServerStableDeviceRescueTest-server-2056095538',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2056095538',id=14,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNw4l9zlgXNO30XsKe4Vj/du/OZkqc9heI+vCPA/3reIdMuWdthuZZGAOiDNP07hjzSUKEhxbgz+Vel73d0eDePuZLQtInh8vruuIgwyafEohXs7W0XS/37cHW8FQVpNBg==',key_name='tempest-keypair-1094775864',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:32:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='021c1d91069e4798af2caae2c29694ba',ramdisk_id='',reservation_id='r-oa4qirax',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1208025923',owner_user_name='tempest-ServerStableDeviceRescueTest-1208025923-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:33:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7601cab932f74be396a6d8a59568dc9f',uuid=7c17a25b-6818-48fa-b406-638dbf1845d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f5253f2-6e79-44f0-a4aa-167f273e7c6a", "address": "fa:16:3e:f9:f6:64", "network": {"id": "b8a52a8d-7eca-40b7-b94b-820a4ab8687b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1308054402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "021c1d91069e4798af2caae2c29694ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5253f2-6e", "ovs_interfaceid": "5f5253f2-6e79-44f0-a4aa-167f273e7c6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:35:17 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-981b4cb8-15f4-4fa3-b0a4-dbfafec6e70c tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Converting VIF {"id": "5f5253f2-6e79-44f0-a4aa-167f273e7c6a", "address": "fa:16:3e:f9:f6:64", "network": {"id": "b8a52a8d-7eca-40b7-b94b-820a4ab8687b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1308054402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "021c1d91069e4798af2caae2c29694ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5253f2-6e", "ovs_interfaceid": "5f5253f2-6e79-44f0-a4aa-167f273e7c6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:35:17 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-981b4cb8-15f4-4fa3-b0a4-dbfafec6e70c tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:f6:64,bridge_name='br-int',has_traffic_filtering=True,id=5f5253f2-6e79-44f0-a4aa-167f273e7c6a,network=Network(b8a52a8d-7eca-40b7-b94b-820a4ab8687b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5253f2-6e') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:35:17 user nova-compute[74247]: DEBUG os_vif [None req-981b4cb8-15f4-4fa3-b0a4-dbfafec6e70c tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:f6:64,bridge_name='br-int',has_traffic_filtering=True,id=5f5253f2-6e79-44f0-a4aa-167f273e7c6a,network=Network(b8a52a8d-7eca-40b7-b94b-820a4ab8687b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5253f2-6e') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:35:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f5253f2-6e, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:35:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:35:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2e0e6440-9e7e-4a35-adae-b7b212fa5881) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:35:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:35:17 user nova-compute[74247]: INFO os_vif [None req-981b4cb8-15f4-4fa3-b0a4-dbfafec6e70c tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:f6:64,bridge_name='br-int',has_traffic_filtering=True,id=5f5253f2-6e79-44f0-a4aa-167f273e7c6a,network=Network(b8a52a8d-7eca-40b7-b94b-820a4ab8687b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5253f2-6e')
Oct 16 18:35:17 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-981b4cb8-15f4-4fa3-b0a4-dbfafec6e70c tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Deleting instance files /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4_del
Oct 16 18:35:17 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-981b4cb8-15f4-4fa3-b0a4-dbfafec6e70c tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Deletion of /opt/stack/data/nova/instances/7c17a25b-6818-48fa-b406-638dbf1845d4_del complete
Oct 16 18:35:17 user nova-compute[74247]: INFO nova.compute.manager [None req-981b4cb8-15f4-4fa3-b0a4-dbfafec6e70c tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Took 0.98 seconds to destroy the instance on the hypervisor.
Oct 16 18:35:17 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-981b4cb8-15f4-4fa3-b0a4-dbfafec6e70c tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 18:35:17 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 18:35:17 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 18:35:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:19 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:35:19 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Took 1.30 seconds to deallocate network for instance.
Oct 16 18:35:19 user nova-compute[74247]: DEBUG nova.compute.manager [req-4e7f37ba-cb54-468d-aa89-8f768c4fa8ac req-ba1144e5-4c14-468e-b00b-6ffaa5f5c95f service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Received event network-vif-deleted-5f5253f2-6e79-44f0-a4aa-167f273e7c6a {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:35:19 user nova-compute[74247]: INFO nova.compute.manager [req-4e7f37ba-cb54-468d-aa89-8f768c4fa8ac req-ba1144e5-4c14-468e-b00b-6ffaa5f5c95f service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Neutron deleted interface 5f5253f2-6e79-44f0-a4aa-167f273e7c6a; detaching it from the instance and deleting it from the info cache
Oct 16 18:35:19 user nova-compute[74247]: DEBUG nova.network.neutron [req-4e7f37ba-cb54-468d-aa89-8f768c4fa8ac req-ba1144e5-4c14-468e-b00b-6ffaa5f5c95f service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:35:19 user nova-compute[74247]: DEBUG nova.compute.manager [req-4e7f37ba-cb54-468d-aa89-8f768c4fa8ac req-ba1144e5-4c14-468e-b00b-6ffaa5f5c95f service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Detach interface failed, port_id=5f5253f2-6e79-44f0-a4aa-167f273e7c6a, reason: Instance 7c17a25b-6818-48fa-b406-638dbf1845d4 could not be found. {{(pid=74247) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 18:35:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-981b4cb8-15f4-4fa3-b0a4-dbfafec6e70c tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:35:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-981b4cb8-15f4-4fa3-b0a4-dbfafec6e70c tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:35:19 user nova-compute[74247]: DEBUG nova.compute.manager [req-70503349-2a2e-4115-a29d-2a88cf8e406e req-c85e6d70-9ebf-401f-99f3-2be949288388 service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Received event network-vif-plugged-5f5253f2-6e79-44f0-a4aa-167f273e7c6a {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:35:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-70503349-2a2e-4115-a29d-2a88cf8e406e req-c85e6d70-9ebf-401f-99f3-2be949288388 service nova] Acquiring lock "7c17a25b-6818-48fa-b406-638dbf1845d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:35:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-70503349-2a2e-4115-a29d-2a88cf8e406e req-c85e6d70-9ebf-401f-99f3-2be949288388 service nova] Lock "7c17a25b-6818-48fa-b406-638dbf1845d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:35:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-70503349-2a2e-4115-a29d-2a88cf8e406e req-c85e6d70-9ebf-401f-99f3-2be949288388 service nova] Lock "7c17a25b-6818-48fa-b406-638dbf1845d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:35:19 user nova-compute[74247]: DEBUG nova.compute.manager [req-70503349-2a2e-4115-a29d-2a88cf8e406e req-c85e6d70-9ebf-401f-99f3-2be949288388 service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] No waiting events found dispatching network-vif-plugged-5f5253f2-6e79-44f0-a4aa-167f273e7c6a {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:35:19 user nova-compute[74247]: WARNING nova.compute.manager [req-70503349-2a2e-4115-a29d-2a88cf8e406e req-c85e6d70-9ebf-401f-99f3-2be949288388 service nova] [instance: 7c17a25b-6818-48fa-b406-638dbf1845d4] Received unexpected event network-vif-plugged-5f5253f2-6e79-44f0-a4aa-167f273e7c6a for instance with vm_state deleted and task_state None.
Oct 16 18:35:19 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-981b4cb8-15f4-4fa3-b0a4-dbfafec6e70c tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:35:19 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-981b4cb8-15f4-4fa3-b0a4-dbfafec6e70c tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:35:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-981b4cb8-15f4-4fa3-b0a4-dbfafec6e70c tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.369s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:35:19 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-981b4cb8-15f4-4fa3-b0a4-dbfafec6e70c tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Deleted allocations for instance 7c17a25b-6818-48fa-b406-638dbf1845d4
Oct 16 18:35:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-981b4cb8-15f4-4fa3-b0a4-dbfafec6e70c tempest-ServerStableDeviceRescueTest-1208025923 tempest-ServerStableDeviceRescueTest-1208025923-project-member] Lock "7c17a25b-6818-48fa-b406-638dbf1845d4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.917s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:35:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Acquiring lock "eb56c456-005d-4d2d-b163-7ab281ca11fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:35:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Lock "eb56c456-005d-4d2d-b163-7ab281ca11fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:35:20 user nova-compute[74247]: DEBUG nova.compute.manager [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 18:35:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:35:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:35:20 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:35:20 user nova-compute[74247]: INFO nova.compute.claims [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Claim successful on node user
Oct 16 18:35:20 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:35:20 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:35:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.400s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:35:21 user nova-compute[74247]: DEBUG nova.compute.manager [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 18:35:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:21 user nova-compute[74247]: DEBUG nova.compute.manager [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 18:35:21 user nova-compute[74247]: DEBUG nova.network.neutron [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 18:35:21 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 18:35:21 user nova-compute[74247]: DEBUG nova.compute.manager [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 18:35:21 user nova-compute[74247]: DEBUG nova.policy [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3dc6b6ae77ff442189499323b61a2dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc4afc6abf94662a5f2ab6b14308276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 18:35:21 user nova-compute[74247]: DEBUG nova.compute.manager [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 18:35:21 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:35:21 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Creating image(s)
Oct 16 18:35:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Acquiring lock "/opt/stack/data/nova/instances/eb56c456-005d-4d2d-b163-7ab281ca11fb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:35:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Lock "/opt/stack/data/nova/instances/eb56c456-005d-4d2d-b163-7ab281ca11fb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:35:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Lock "/opt/stack/data/nova/instances/eb56c456-005d-4d2d-b163-7ab281ca11fb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:35:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:35:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.196s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:35:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Acquiring lock "37399febbd18f60b85fd0f833558f6a3539ab231" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:35:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:35:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:35:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.237s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:35:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/eb56c456-005d-4d2d-b163-7ab281ca11fb/disk 1073741824 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:35:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/eb56c456-005d-4d2d-b163-7ab281ca11fb/disk 1073741824" returned: 0 in 0.064s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:35:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.310s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:35:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:35:21 user nova-compute[74247]: DEBUG nova.network.neutron [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Successfully created port: a4c9d956-6c6e-49d2-b683-13cf32c4340e {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:35:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.209s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:35:21 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eb56c456-005d-4d2d-b163-7ab281ca11fb/disk. size=1073741824 {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 18:35:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb56c456-005d-4d2d-b163-7ab281ca11fb/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:35:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb56c456-005d-4d2d-b163-7ab281ca11fb/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:35:22 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Cannot resize image /opt/stack/data/nova/instances/eb56c456-005d-4d2d-b163-7ab281ca11fb/disk to a smaller size. {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 18:35:22 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 18:35:22 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Ensure instance console log exists: /opt/stack/data/nova/instances/eb56c456-005d-4d2d-b163-7ab281ca11fb/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:35:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:35:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:35:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:35:22 user nova-compute[74247]: DEBUG nova.network.neutron [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Successfully updated port: a4c9d956-6c6e-49d2-b683-13cf32c4340e {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:35:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Acquiring lock "refresh_cache-eb56c456-005d-4d2d-b163-7ab281ca11fb" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:35:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Acquired lock "refresh_cache-eb56c456-005d-4d2d-b163-7ab281ca11fb" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:35:22 user nova-compute[74247]: DEBUG nova.network.neutron [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:35:22 user nova-compute[74247]: DEBUG nova.compute.manager [req-96584749-77ed-4e2a-a8ca-a0217ebfbf6d req-65d5b2ec-a5f7-48b3-9ea6-81acee4d859a service nova] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Received event network-changed-a4c9d956-6c6e-49d2-b683-13cf32c4340e {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:35:22 user nova-compute[74247]: DEBUG nova.compute.manager [req-96584749-77ed-4e2a-a8ca-a0217ebfbf6d req-65d5b2ec-a5f7-48b3-9ea6-81acee4d859a service nova] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Refreshing instance network info cache due to event network-changed-a4c9d956-6c6e-49d2-b683-13cf32c4340e. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:35:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-96584749-77ed-4e2a-a8ca-a0217ebfbf6d req-65d5b2ec-a5f7-48b3-9ea6-81acee4d859a service nova] Acquiring lock "refresh_cache-eb56c456-005d-4d2d-b163-7ab281ca11fb" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:35:22 user nova-compute[74247]: DEBUG nova.network.neutron [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:35:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:22 user nova-compute[74247]: DEBUG nova.network.neutron [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Updating instance_info_cache with network_info: [{"id": "a4c9d956-6c6e-49d2-b683-13cf32c4340e", "address": "fa:16:3e:5f:1f:fd", "network": {"id": "7d7d83a4-4978-4615-bdc2-96d8d1479470", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1489624033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc4afc6abf94662a5f2ab6b14308276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c9d956-6c", "ovs_interfaceid": "a4c9d956-6c6e-49d2-b683-13cf32c4340e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:35:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Releasing lock "refresh_cache-eb56c456-005d-4d2d-b163-7ab281ca11fb" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:35:22 user nova-compute[74247]: DEBUG nova.compute.manager [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Instance network_info: |[{"id": "a4c9d956-6c6e-49d2-b683-13cf32c4340e", "address": "fa:16:3e:5f:1f:fd", "network": {"id": "7d7d83a4-4978-4615-bdc2-96d8d1479470", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1489624033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc4afc6abf94662a5f2ab6b14308276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c9d956-6c", "ovs_interfaceid": "a4c9d956-6c6e-49d2-b683-13cf32c4340e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 18:35:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-96584749-77ed-4e2a-a8ca-a0217ebfbf6d req-65d5b2ec-a5f7-48b3-9ea6-81acee4d859a service nova] Acquired lock "refresh_cache-eb56c456-005d-4d2d-b163-7ab281ca11fb" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:35:22 user nova-compute[74247]: DEBUG nova.network.neutron [req-96584749-77ed-4e2a-a8ca-a0217ebfbf6d req-65d5b2ec-a5f7-48b3-9ea6-81acee4d859a service nova] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Refreshing network info cache for port a4c9d956-6c6e-49d2-b683-13cf32c4340e {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:35:22 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Start _get_guest_xml network_info=[{"id": "a4c9d956-6c6e-49d2-b683-13cf32c4340e", "address": "fa:16:3e:5f:1f:fd", "network": {"id": "7d7d83a4-4978-4615-bdc2-96d8d1479470", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1489624033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc4afc6abf94662a5f2ab6b14308276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c9d956-6c", "ovs_interfaceid": "a4c9d956-6c6e-49d2-b683-13cf32c4340e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': '83126bb1-29f5-42fe-8620-72ab0797f776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:35:23 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:35:23 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:35:23 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:35:23 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:35:23 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:35:23 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:35:23 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:35:23 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:35:23 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:35:23 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:35:23 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:35:23 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:35:23 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:35:23 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:35:23 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:35:23 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:35:23 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:35:23 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:35:23 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:35:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-373110214',display_name='tempest-VolumesActionsTest-instance-373110214',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-373110214',id=23,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dcc4afc6abf94662a5f2ab6b14308276',ramdisk_id='',reservation_id='r-990lqw4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-919370460',owner_user_name='tempest-VolumesActionsTest-919370460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:35:21Z,user_data=None,user_id='3dc6b6ae77ff442189499323b61a2dbb',uuid=eb56c456-005d-4d2d-b163-7ab281ca11fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4c9d956-6c6e-49d2-b683-13cf32c4340e", "address": "fa:16:3e:5f:1f:fd", "network": {"id": "7d7d83a4-4978-4615-bdc2-96d8d1479470", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1489624033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc4afc6abf94662a5f2ab6b14308276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c9d956-6c", "ovs_interfaceid": "a4c9d956-6c6e-49d2-b683-13cf32c4340e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:35:23 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Converting VIF {"id": "a4c9d956-6c6e-49d2-b683-13cf32c4340e", "address": "fa:16:3e:5f:1f:fd", "network": {"id": "7d7d83a4-4978-4615-bdc2-96d8d1479470", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1489624033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc4afc6abf94662a5f2ab6b14308276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c9d956-6c", "ovs_interfaceid": "a4c9d956-6c6e-49d2-b683-13cf32c4340e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:35:23 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:1f:fd,bridge_name='br-int',has_traffic_filtering=True,id=a4c9d956-6c6e-49d2-b683-13cf32c4340e,network=Network(7d7d83a4-4978-4615-bdc2-96d8d1479470),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4c9d956-6c') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:35:23 user nova-compute[74247]: DEBUG nova.objects.instance [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Lazy-loading 'pci_devices' on Instance uuid eb56c456-005d-4d2d-b163-7ab281ca11fb {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:35:23 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:35:23 user nova-compute[74247]:   <uuid>eb56c456-005d-4d2d-b163-7ab281ca11fb</uuid>
Oct 16 18:35:23 user nova-compute[74247]:   <name>instance-00000017</name>
Oct 16 18:35:23 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:35:23 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:35:23 user nova-compute[74247]:   <metadata>
Oct 16 18:35:23 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:35:23 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:35:23 user nova-compute[74247]:       <nova:name>tempest-VolumesActionsTest-instance-373110214</nova:name>
Oct 16 18:35:23 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:35:23</nova:creationTime>
Oct 16 18:35:23 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:35:23 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:35:23 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:35:23 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:35:23 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:35:23 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:35:23 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:35:23 user nova-compute[74247]:       <nova:owner>
Oct 16 18:35:23 user nova-compute[74247]:         <nova:user uuid="3dc6b6ae77ff442189499323b61a2dbb">tempest-VolumesActionsTest-919370460-project-member</nova:user>
Oct 16 18:35:23 user nova-compute[74247]:         <nova:project uuid="dcc4afc6abf94662a5f2ab6b14308276">tempest-VolumesActionsTest-919370460</nova:project>
Oct 16 18:35:23 user nova-compute[74247]:       </nova:owner>
Oct 16 18:35:23 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:35:23 user nova-compute[74247]:       <nova:ports>
Oct 16 18:35:23 user nova-compute[74247]:         <nova:port uuid="a4c9d956-6c6e-49d2-b683-13cf32c4340e">
Oct 16 18:35:23 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 16 18:35:23 user nova-compute[74247]:         </nova:port>
Oct 16 18:35:23 user nova-compute[74247]:       </nova:ports>
Oct 16 18:35:23 user nova-compute[74247]:     </nova:instance>
Oct 16 18:35:23 user nova-compute[74247]:   </metadata>
Oct 16 18:35:23 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:35:23 user nova-compute[74247]:     <system>
Oct 16 18:35:23 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:35:23 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:35:23 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:35:23 user nova-compute[74247]:       <entry name="serial">eb56c456-005d-4d2d-b163-7ab281ca11fb</entry>
Oct 16 18:35:23 user nova-compute[74247]:       <entry name="uuid">eb56c456-005d-4d2d-b163-7ab281ca11fb</entry>
Oct 16 18:35:23 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:35:23 user nova-compute[74247]:     </system>
Oct 16 18:35:23 user nova-compute[74247]:   </sysinfo>
Oct 16 18:35:23 user nova-compute[74247]:   <os>
Oct 16 18:35:23 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:35:23 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:35:23 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:35:23 user nova-compute[74247]:   </os>
Oct 16 18:35:23 user nova-compute[74247]:   <features>
Oct 16 18:35:23 user nova-compute[74247]:     <acpi/>
Oct 16 18:35:23 user nova-compute[74247]:     <apic/>
Oct 16 18:35:23 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:35:23 user nova-compute[74247]:   </features>
Oct 16 18:35:23 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:35:23 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:35:23 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:35:23 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:35:23 user nova-compute[74247]:   </clock>
Oct 16 18:35:23 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:35:23 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:35:23 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:35:23 user nova-compute[74247]:   </cpu>
Oct 16 18:35:23 user nova-compute[74247]:   <devices>
Oct 16 18:35:23 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:35:23 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:35:23 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/eb56c456-005d-4d2d-b163-7ab281ca11fb/disk"/>
Oct 16 18:35:23 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:35:23 user nova-compute[74247]:     </disk>
Oct 16 18:35:23 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:35:23 user nova-compute[74247]:       <mac address="fa:16:3e:5f:1f:fd"/>
Oct 16 18:35:23 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:35:23 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:35:23 user nova-compute[74247]:       <target dev="tapa4c9d956-6c"/>
Oct 16 18:35:23 user nova-compute[74247]:     </interface>
Oct 16 18:35:23 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:35:23 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/eb56c456-005d-4d2d-b163-7ab281ca11fb/console.log" append="off"/>
Oct 16 18:35:23 user nova-compute[74247]:     </serial>
Oct 16 18:35:23 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:35:23 user nova-compute[74247]:     <video>
Oct 16 18:35:23 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:35:23 user nova-compute[74247]:     </video>
Oct 16 18:35:23 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:35:23 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:35:23 user nova-compute[74247]:     </rng>
Oct 16 18:35:23 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:35:23 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:35:23 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:35:23 user nova-compute[74247]:     </memballoon>
Oct 16 18:35:23 user nova-compute[74247]:   </devices>
Oct 16 18:35:23 user nova-compute[74247]: </domain>
Oct 16 18:35:23 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:35:23 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:35:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-373110214',display_name='tempest-VolumesActionsTest-instance-373110214',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-373110214',id=23,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dcc4afc6abf94662a5f2ab6b14308276',ramdisk_id='',reservation_id='r-990lqw4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-919370460',owner_user_name='tempest-VolumesActionsTest-919370460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:35:21Z,user_data=None,user_id='3dc6b6ae77ff442189499323b61a2dbb',uuid=eb56c456-005d-4d2d-b163-7ab281ca11fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4c9d956-6c6e-49d2-b683-13cf32c4340e", "address": "fa:16:3e:5f:1f:fd", "network": {"id": "7d7d83a4-4978-4615-bdc2-96d8d1479470", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1489624033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc4afc6abf94662a5f2ab6b14308276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c9d956-6c", "ovs_interfaceid": "a4c9d956-6c6e-49d2-b683-13cf32c4340e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:35:23 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Converting VIF {"id": "a4c9d956-6c6e-49d2-b683-13cf32c4340e", "address": "fa:16:3e:5f:1f:fd", "network": {"id": "7d7d83a4-4978-4615-bdc2-96d8d1479470", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1489624033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc4afc6abf94662a5f2ab6b14308276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c9d956-6c", "ovs_interfaceid": "a4c9d956-6c6e-49d2-b683-13cf32c4340e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:35:23 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:1f:fd,bridge_name='br-int',has_traffic_filtering=True,id=a4c9d956-6c6e-49d2-b683-13cf32c4340e,network=Network(7d7d83a4-4978-4615-bdc2-96d8d1479470),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4c9d956-6c') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:35:23 user nova-compute[74247]: DEBUG os_vif [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:1f:fd,bridge_name='br-int',has_traffic_filtering=True,id=a4c9d956-6c6e-49d2-b683-13cf32c4340e,network=Network(7d7d83a4-4978-4615-bdc2-96d8d1479470),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4c9d956-6c') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:35:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:35:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:35:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dc11d31a-adb9-5976-a196-04e38388c657', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:35:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa4c9d956-6c, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:35:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa4c9d956-6c, col_values=(('qos', UUID('0497e584-fabb-41a7-810d-b018cbb2337c')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:35:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa4c9d956-6c, col_values=(('external_ids', {'iface-id': 'a4c9d956-6c6e-49d2-b683-13cf32c4340e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:1f:fd', 'vm-uuid': 'eb56c456-005d-4d2d-b163-7ab281ca11fb'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:35:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:35:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:23 user nova-compute[74247]: INFO os_vif [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:1f:fd,bridge_name='br-int',has_traffic_filtering=True,id=a4c9d956-6c6e-49d2-b683-13cf32c4340e,network=Network(7d7d83a4-4978-4615-bdc2-96d8d1479470),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4c9d956-6c')
Oct 16 18:35:23 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:35:23 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] No VIF found with MAC fa:16:3e:5f:1f:fd, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:35:23 user nova-compute[74247]: DEBUG nova.network.neutron [req-96584749-77ed-4e2a-a8ca-a0217ebfbf6d req-65d5b2ec-a5f7-48b3-9ea6-81acee4d859a service nova] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Updated VIF entry in instance network info cache for port a4c9d956-6c6e-49d2-b683-13cf32c4340e. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:35:23 user nova-compute[74247]: DEBUG nova.network.neutron [req-96584749-77ed-4e2a-a8ca-a0217ebfbf6d req-65d5b2ec-a5f7-48b3-9ea6-81acee4d859a service nova] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Updating instance_info_cache with network_info: [{"id": "a4c9d956-6c6e-49d2-b683-13cf32c4340e", "address": "fa:16:3e:5f:1f:fd", "network": {"id": "7d7d83a4-4978-4615-bdc2-96d8d1479470", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1489624033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc4afc6abf94662a5f2ab6b14308276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c9d956-6c", "ovs_interfaceid": "a4c9d956-6c6e-49d2-b683-13cf32c4340e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:35:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-96584749-77ed-4e2a-a8ca-a0217ebfbf6d req-65d5b2ec-a5f7-48b3-9ea6-81acee4d859a service nova] Releasing lock "refresh_cache-eb56c456-005d-4d2d-b163-7ab281ca11fb" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:35:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:24 user nova-compute[74247]: DEBUG nova.compute.manager [req-53c53740-f909-4074-830b-47374643c6cf req-f1bbe047-96af-4878-abbf-37324e71cc5d service nova] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Received event network-vif-plugged-a4c9d956-6c6e-49d2-b683-13cf32c4340e {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:35:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-53c53740-f909-4074-830b-47374643c6cf req-f1bbe047-96af-4878-abbf-37324e71cc5d service nova] Acquiring lock "eb56c456-005d-4d2d-b163-7ab281ca11fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:35:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-53c53740-f909-4074-830b-47374643c6cf req-f1bbe047-96af-4878-abbf-37324e71cc5d service nova] Lock "eb56c456-005d-4d2d-b163-7ab281ca11fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:35:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-53c53740-f909-4074-830b-47374643c6cf req-f1bbe047-96af-4878-abbf-37324e71cc5d service nova] Lock "eb56c456-005d-4d2d-b163-7ab281ca11fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:35:24 user nova-compute[74247]: DEBUG nova.compute.manager [req-53c53740-f909-4074-830b-47374643c6cf req-f1bbe047-96af-4878-abbf-37324e71cc5d service nova] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] No waiting events found dispatching network-vif-plugged-a4c9d956-6c6e-49d2-b683-13cf32c4340e {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:35:24 user nova-compute[74247]: WARNING nova.compute.manager [req-53c53740-f909-4074-830b-47374643c6cf req-f1bbe047-96af-4878-abbf-37324e71cc5d service nova] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Received unexpected event network-vif-plugged-a4c9d956-6c6e-49d2-b683-13cf32c4340e for instance with vm_state building and task_state spawning.
Oct 16 18:35:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:26 user nova-compute[74247]: DEBUG nova.compute.manager [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:35:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:35:26 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Instance spawned successfully.
Oct 16 18:35:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 18:35:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:35:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:35:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:35:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:35:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:35:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:35:26 user nova-compute[74247]: INFO nova.compute.manager [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Took 5.52 seconds to spawn the instance on the hypervisor.
Oct 16 18:35:26 user nova-compute[74247]: DEBUG nova.compute.manager [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:35:26 user nova-compute[74247]: DEBUG nova.compute.manager [req-0edc382d-1124-48e8-8770-7d0cd7becdd9 req-fe8fc67c-4455-49f8-9728-0d80ed77eef0 service nova] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Received event network-vif-plugged-a4c9d956-6c6e-49d2-b683-13cf32c4340e {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:35:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0edc382d-1124-48e8-8770-7d0cd7becdd9 req-fe8fc67c-4455-49f8-9728-0d80ed77eef0 service nova] Acquiring lock "eb56c456-005d-4d2d-b163-7ab281ca11fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:35:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0edc382d-1124-48e8-8770-7d0cd7becdd9 req-fe8fc67c-4455-49f8-9728-0d80ed77eef0 service nova] Lock "eb56c456-005d-4d2d-b163-7ab281ca11fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:35:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0edc382d-1124-48e8-8770-7d0cd7becdd9 req-fe8fc67c-4455-49f8-9728-0d80ed77eef0 service nova] Lock "eb56c456-005d-4d2d-b163-7ab281ca11fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:35:26 user nova-compute[74247]: DEBUG nova.compute.manager [req-0edc382d-1124-48e8-8770-7d0cd7becdd9 req-fe8fc67c-4455-49f8-9728-0d80ed77eef0 service nova] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] No waiting events found dispatching network-vif-plugged-a4c9d956-6c6e-49d2-b683-13cf32c4340e {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:35:26 user nova-compute[74247]: WARNING nova.compute.manager [req-0edc382d-1124-48e8-8770-7d0cd7becdd9 req-fe8fc67c-4455-49f8-9728-0d80ed77eef0 service nova] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Received unexpected event network-vif-plugged-a4c9d956-6c6e-49d2-b683-13cf32c4340e for instance with vm_state building and task_state spawning.
Oct 16 18:35:26 user nova-compute[74247]: INFO nova.compute.manager [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Took 6.26 seconds to build instance.
Oct 16 18:35:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-598f1699-29eb-4de4-b8ac-a39a8938c819 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Lock "eb56c456-005d-4d2d-b163-7ab281ca11fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.370s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:35:28 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:31 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Acquiring lock "e23e7124-676c-4b64-a77f-e9c7b46f0f18" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:35:31 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Lock "e23e7124-676c-4b64-a77f-e9c7b46f0f18" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:35:31 user nova-compute[74247]: DEBUG nova.compute.manager [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 18:35:31 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:35:31 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:35:31 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:35:31 user nova-compute[74247]: INFO nova.compute.claims [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Claim successful on node user
Oct 16 18:35:32 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:35:32 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:35:32 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.513s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:35:32 user nova-compute[74247]: DEBUG nova.compute.manager [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 18:35:32 user nova-compute[74247]: DEBUG nova.compute.manager [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 18:35:32 user nova-compute[74247]: DEBUG nova.network.neutron [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 18:35:32 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 18:35:32 user nova-compute[74247]: DEBUG nova.compute.manager [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 18:35:32 user nova-compute[74247]: DEBUG nova.compute.manager [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 18:35:32 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:35:32 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Creating image(s)
Oct 16 18:35:32 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Acquiring lock "/opt/stack/data/nova/instances/e23e7124-676c-4b64-a77f-e9c7b46f0f18/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:35:32 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Lock "/opt/stack/data/nova/instances/e23e7124-676c-4b64-a77f-e9c7b46f0f18/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:35:32 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Lock "/opt/stack/data/nova/instances/e23e7124-676c-4b64-a77f-e9c7b46f0f18/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:35:32 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:35:32 user nova-compute[74247]: DEBUG nova.policy [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'beca1b1c120c420e979c21a591143b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6657cd3ef50342c78db1bc9551de094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 18:35:32 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.209s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:35:32 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Acquiring lock "37399febbd18f60b85fd0f833558f6a3539ab231" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:35:32 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:35:32 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:35:32 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.210s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:35:32 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/e23e7124-676c-4b64-a77f-e9c7b46f0f18/disk 1073741824 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:35:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/e23e7124-676c-4b64-a77f-e9c7b46f0f18/disk 1073741824" returned: 0 in 0.165s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:35:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.386s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:35:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:35:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.176s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:35:33 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e23e7124-676c-4b64-a77f-e9c7b46f0f18/disk. size=1073741824 {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 18:35:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23e7124-676c-4b64-a77f-e9c7b46f0f18/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:35:33 user nova-compute[74247]: DEBUG nova.network.neutron [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Successfully created port: af4e0bec-8cec-4373-b21f-9d65fb7e0eff {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:35:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23e7124-676c-4b64-a77f-e9c7b46f0f18/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:35:33 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Cannot resize image /opt/stack/data/nova/instances/e23e7124-676c-4b64-a77f-e9c7b46f0f18/disk to a smaller size. {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 18:35:33 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 18:35:33 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Ensure instance console log exists: /opt/stack/data/nova/instances/e23e7124-676c-4b64-a77f-e9c7b46f0f18/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:35:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:35:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:35:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG nova.network.neutron [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Successfully updated port: af4e0bec-8cec-4373-b21f-9d65fb7e0eff {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Acquiring lock "refresh_cache-e23e7124-676c-4b64-a77f-e9c7b46f0f18" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Acquired lock "refresh_cache-e23e7124-676c-4b64-a77f-e9c7b46f0f18" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG nova.network.neutron [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG nova.compute.manager [req-c9129e5d-60a5-4ba2-8360-1148d2921ecf req-3ada316f-5cae-4899-b469-d725dd06247a service nova] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Received event network-changed-af4e0bec-8cec-4373-b21f-9d65fb7e0eff {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG nova.compute.manager [req-c9129e5d-60a5-4ba2-8360-1148d2921ecf req-3ada316f-5cae-4899-b469-d725dd06247a service nova] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Refreshing instance network info cache due to event network-changed-af4e0bec-8cec-4373-b21f-9d65fb7e0eff. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c9129e5d-60a5-4ba2-8360-1148d2921ecf req-3ada316f-5cae-4899-b469-d725dd06247a service nova] Acquiring lock "refresh_cache-e23e7124-676c-4b64-a77f-e9c7b46f0f18" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG nova.network.neutron [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG nova.network.neutron [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Updating instance_info_cache with network_info: [{"id": "af4e0bec-8cec-4373-b21f-9d65fb7e0eff", "address": "fa:16:3e:62:f4:30", "network": {"id": "b6946b9d-ee0d-466d-abd8-24ecf8486b3d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "12ee40b874d34e56adcfd74c16123017", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4e0bec-8c", "ovs_interfaceid": "af4e0bec-8cec-4373-b21f-9d65fb7e0eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Releasing lock "refresh_cache-e23e7124-676c-4b64-a77f-e9c7b46f0f18" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG nova.compute.manager [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Instance network_info: |[{"id": "af4e0bec-8cec-4373-b21f-9d65fb7e0eff", "address": "fa:16:3e:62:f4:30", "network": {"id": "b6946b9d-ee0d-466d-abd8-24ecf8486b3d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "12ee40b874d34e56adcfd74c16123017", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4e0bec-8c", "ovs_interfaceid": "af4e0bec-8cec-4373-b21f-9d65fb7e0eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c9129e5d-60a5-4ba2-8360-1148d2921ecf req-3ada316f-5cae-4899-b469-d725dd06247a service nova] Acquired lock "refresh_cache-e23e7124-676c-4b64-a77f-e9c7b46f0f18" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG nova.network.neutron [req-c9129e5d-60a5-4ba2-8360-1148d2921ecf req-3ada316f-5cae-4899-b469-d725dd06247a service nova] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Refreshing network info cache for port af4e0bec-8cec-4373-b21f-9d65fb7e0eff {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Start _get_guest_xml network_info=[{"id": "af4e0bec-8cec-4373-b21f-9d65fb7e0eff", "address": "fa:16:3e:62:f4:30", "network": {"id": "b6946b9d-ee0d-466d-abd8-24ecf8486b3d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "12ee40b874d34e56adcfd74c16123017", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4e0bec-8c", "ovs_interfaceid": "af4e0bec-8cec-4373-b21f-9d65fb7e0eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': '83126bb1-29f5-42fe-8620-72ab0797f776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:35:34 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:35:34 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:35:34 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:35:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-977611080',display_name='tempest-VolumesNegativeTest-instance-977611080',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-977611080',id=24,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6657cd3ef50342c78db1bc9551de094b',ramdisk_id='',reservation_id='r-4aqgxb6m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1617705614',owner_user_name='tempest-VolumesNegativeTest-1617705614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:35:32Z,user_data=None,user_id='beca1b1c120c420e979c21a591143b49',uuid=e23e7124-676c-4b64-a77f-e9c7b46f0f18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af4e0bec-8cec-4373-b21f-9d65fb7e0eff", "address": "fa:16:3e:62:f4:30", "network": {"id": "b6946b9d-ee0d-466d-abd8-24ecf8486b3d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "12ee40b874d34e56adcfd74c16123017", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4e0bec-8c", "ovs_interfaceid": "af4e0bec-8cec-4373-b21f-9d65fb7e0eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Converting VIF {"id": "af4e0bec-8cec-4373-b21f-9d65fb7e0eff", "address": "fa:16:3e:62:f4:30", "network": {"id": "b6946b9d-ee0d-466d-abd8-24ecf8486b3d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "12ee40b874d34e56adcfd74c16123017", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4e0bec-8c", "ovs_interfaceid": "af4e0bec-8cec-4373-b21f-9d65fb7e0eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:f4:30,bridge_name='br-int',has_traffic_filtering=True,id=af4e0bec-8cec-4373-b21f-9d65fb7e0eff,network=Network(b6946b9d-ee0d-466d-abd8-24ecf8486b3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf4e0bec-8c') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG nova.objects.instance [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Lazy-loading 'pci_devices' on Instance uuid e23e7124-676c-4b64-a77f-e9c7b46f0f18 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:35:34 user nova-compute[74247]:   <uuid>e23e7124-676c-4b64-a77f-e9c7b46f0f18</uuid>
Oct 16 18:35:34 user nova-compute[74247]:   <name>instance-00000018</name>
Oct 16 18:35:34 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:35:34 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:35:34 user nova-compute[74247]:   <metadata>
Oct 16 18:35:34 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:35:34 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:35:34 user nova-compute[74247]:       <nova:name>tempest-VolumesNegativeTest-instance-977611080</nova:name>
Oct 16 18:35:34 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:35:34</nova:creationTime>
Oct 16 18:35:34 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:35:34 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:35:34 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:35:34 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:35:34 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:35:34 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:35:34 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:35:34 user nova-compute[74247]:       <nova:owner>
Oct 16 18:35:34 user nova-compute[74247]:         <nova:user uuid="beca1b1c120c420e979c21a591143b49">tempest-VolumesNegativeTest-1617705614-project-member</nova:user>
Oct 16 18:35:34 user nova-compute[74247]:         <nova:project uuid="6657cd3ef50342c78db1bc9551de094b">tempest-VolumesNegativeTest-1617705614</nova:project>
Oct 16 18:35:34 user nova-compute[74247]:       </nova:owner>
Oct 16 18:35:34 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:35:34 user nova-compute[74247]:       <nova:ports>
Oct 16 18:35:34 user nova-compute[74247]:         <nova:port uuid="af4e0bec-8cec-4373-b21f-9d65fb7e0eff">
Oct 16 18:35:34 user nova-compute[74247]:           <nova:ip type="fixed" address="192.168.233.16" ipVersion="4"/>
Oct 16 18:35:34 user nova-compute[74247]:         </nova:port>
Oct 16 18:35:34 user nova-compute[74247]:       </nova:ports>
Oct 16 18:35:34 user nova-compute[74247]:     </nova:instance>
Oct 16 18:35:34 user nova-compute[74247]:   </metadata>
Oct 16 18:35:34 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:35:34 user nova-compute[74247]:     <system>
Oct 16 18:35:34 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:35:34 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:35:34 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:35:34 user nova-compute[74247]:       <entry name="serial">e23e7124-676c-4b64-a77f-e9c7b46f0f18</entry>
Oct 16 18:35:34 user nova-compute[74247]:       <entry name="uuid">e23e7124-676c-4b64-a77f-e9c7b46f0f18</entry>
Oct 16 18:35:34 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:35:34 user nova-compute[74247]:     </system>
Oct 16 18:35:34 user nova-compute[74247]:   </sysinfo>
Oct 16 18:35:34 user nova-compute[74247]:   <os>
Oct 16 18:35:34 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:35:34 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:35:34 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:35:34 user nova-compute[74247]:   </os>
Oct 16 18:35:34 user nova-compute[74247]:   <features>
Oct 16 18:35:34 user nova-compute[74247]:     <acpi/>
Oct 16 18:35:34 user nova-compute[74247]:     <apic/>
Oct 16 18:35:34 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:35:34 user nova-compute[74247]:   </features>
Oct 16 18:35:34 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:35:34 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:35:34 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:35:34 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:35:34 user nova-compute[74247]:   </clock>
Oct 16 18:35:34 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:35:34 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:35:34 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:35:34 user nova-compute[74247]:   </cpu>
Oct 16 18:35:34 user nova-compute[74247]:   <devices>
Oct 16 18:35:34 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:35:34 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:35:34 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/e23e7124-676c-4b64-a77f-e9c7b46f0f18/disk"/>
Oct 16 18:35:34 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:35:34 user nova-compute[74247]:     </disk>
Oct 16 18:35:34 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:35:34 user nova-compute[74247]:       <mac address="fa:16:3e:62:f4:30"/>
Oct 16 18:35:34 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:35:34 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:35:34 user nova-compute[74247]:       <target dev="tapaf4e0bec-8c"/>
Oct 16 18:35:34 user nova-compute[74247]:     </interface>
Oct 16 18:35:34 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:35:34 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/e23e7124-676c-4b64-a77f-e9c7b46f0f18/console.log" append="off"/>
Oct 16 18:35:34 user nova-compute[74247]:     </serial>
Oct 16 18:35:34 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:35:34 user nova-compute[74247]:     <video>
Oct 16 18:35:34 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:35:34 user nova-compute[74247]:     </video>
Oct 16 18:35:34 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:35:34 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:35:34 user nova-compute[74247]:     </rng>
Oct 16 18:35:34 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:35:34 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:35:34 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:35:34 user nova-compute[74247]:     </memballoon>
Oct 16 18:35:34 user nova-compute[74247]:   </devices>
Oct 16 18:35:34 user nova-compute[74247]: </domain>
Oct 16 18:35:34 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:35:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-977611080',display_name='tempest-VolumesNegativeTest-instance-977611080',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-977611080',id=24,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6657cd3ef50342c78db1bc9551de094b',ramdisk_id='',reservation_id='r-4aqgxb6m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1617705614',owner_user_name='tempest-VolumesNegativeTest-1617705614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:35:32Z,user_data=None,user_id='beca1b1c120c420e979c21a591143b49',uuid=e23e7124-676c-4b64-a77f-e9c7b46f0f18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af4e0bec-8cec-4373-b21f-9d65fb7e0eff", "address": "fa:16:3e:62:f4:30", "network": {"id": "b6946b9d-ee0d-466d-abd8-24ecf8486b3d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "12ee40b874d34e56adcfd74c16123017", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4e0bec-8c", "ovs_interfaceid": "af4e0bec-8cec-4373-b21f-9d65fb7e0eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Converting VIF {"id": "af4e0bec-8cec-4373-b21f-9d65fb7e0eff", "address": "fa:16:3e:62:f4:30", "network": {"id": "b6946b9d-ee0d-466d-abd8-24ecf8486b3d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "12ee40b874d34e56adcfd74c16123017", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4e0bec-8c", "ovs_interfaceid": "af4e0bec-8cec-4373-b21f-9d65fb7e0eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:f4:30,bridge_name='br-int',has_traffic_filtering=True,id=af4e0bec-8cec-4373-b21f-9d65fb7e0eff,network=Network(b6946b9d-ee0d-466d-abd8-24ecf8486b3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf4e0bec-8c') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG os_vif [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:f4:30,bridge_name='br-int',has_traffic_filtering=True,id=af4e0bec-8cec-4373-b21f-9d65fb7e0eff,network=Network(b6946b9d-ee0d-466d-abd8-24ecf8486b3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf4e0bec-8c') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '09f3c2e5-7717-5706-9c8d-0e8f2bbdf2f3', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf4e0bec-8c, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaf4e0bec-8c, col_values=(('qos', UUID('b54ca7cd-76f3-41fc-8483-58a862aaa719')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaf4e0bec-8c, col_values=(('external_ids', {'iface-id': 'af4e0bec-8cec-4373-b21f-9d65fb7e0eff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:f4:30', 'vm-uuid': 'e23e7124-676c-4b64-a77f-e9c7b46f0f18'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:34 user nova-compute[74247]: INFO os_vif [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:f4:30,bridge_name='br-int',has_traffic_filtering=True,id=af4e0bec-8cec-4373-b21f-9d65fb7e0eff,network=Network(b6946b9d-ee0d-466d-abd8-24ecf8486b3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf4e0bec-8c')
Oct 16 18:35:34 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:35:34 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] No VIF found with MAC fa:16:3e:62:f4:30, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:35:35 user nova-compute[74247]: DEBUG nova.network.neutron [req-c9129e5d-60a5-4ba2-8360-1148d2921ecf req-3ada316f-5cae-4899-b469-d725dd06247a service nova] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Updated VIF entry in instance network info cache for port af4e0bec-8cec-4373-b21f-9d65fb7e0eff. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:35:35 user nova-compute[74247]: DEBUG nova.network.neutron [req-c9129e5d-60a5-4ba2-8360-1148d2921ecf req-3ada316f-5cae-4899-b469-d725dd06247a service nova] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Updating instance_info_cache with network_info: [{"id": "af4e0bec-8cec-4373-b21f-9d65fb7e0eff", "address": "fa:16:3e:62:f4:30", "network": {"id": "b6946b9d-ee0d-466d-abd8-24ecf8486b3d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "12ee40b874d34e56adcfd74c16123017", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4e0bec-8c", "ovs_interfaceid": "af4e0bec-8cec-4373-b21f-9d65fb7e0eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:35:35 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c9129e5d-60a5-4ba2-8360-1148d2921ecf req-3ada316f-5cae-4899-b469-d725dd06247a service nova] Releasing lock "refresh_cache-e23e7124-676c-4b64-a77f-e9c7b46f0f18" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:35:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:36 user nova-compute[74247]: DEBUG nova.compute.manager [req-5df5c4c1-2642-4529-b450-57793b159c13 req-149b5854-ac63-4e3b-8298-05e5003f58ea service nova] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Received event network-vif-plugged-af4e0bec-8cec-4373-b21f-9d65fb7e0eff {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:35:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-5df5c4c1-2642-4529-b450-57793b159c13 req-149b5854-ac63-4e3b-8298-05e5003f58ea service nova] Acquiring lock "e23e7124-676c-4b64-a77f-e9c7b46f0f18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:35:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-5df5c4c1-2642-4529-b450-57793b159c13 req-149b5854-ac63-4e3b-8298-05e5003f58ea service nova] Lock "e23e7124-676c-4b64-a77f-e9c7b46f0f18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:35:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-5df5c4c1-2642-4529-b450-57793b159c13 req-149b5854-ac63-4e3b-8298-05e5003f58ea service nova] Lock "e23e7124-676c-4b64-a77f-e9c7b46f0f18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:35:36 user nova-compute[74247]: DEBUG nova.compute.manager [req-5df5c4c1-2642-4529-b450-57793b159c13 req-149b5854-ac63-4e3b-8298-05e5003f58ea service nova] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] No waiting events found dispatching network-vif-plugged-af4e0bec-8cec-4373-b21f-9d65fb7e0eff {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:35:36 user nova-compute[74247]: WARNING nova.compute.manager [req-5df5c4c1-2642-4529-b450-57793b159c13 req-149b5854-ac63-4e3b-8298-05e5003f58ea service nova] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Received unexpected event network-vif-plugged-af4e0bec-8cec-4373-b21f-9d65fb7e0eff for instance with vm_state building and task_state spawning.
Oct 16 18:35:37 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:37 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:38 user nova-compute[74247]: DEBUG nova.compute.manager [req-0031b082-022c-4373-aef1-82dd72d0b114 req-62185372-e60f-4a50-8302-e075efd29a6c service nova] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Received event network-vif-plugged-af4e0bec-8cec-4373-b21f-9d65fb7e0eff {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:35:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0031b082-022c-4373-aef1-82dd72d0b114 req-62185372-e60f-4a50-8302-e075efd29a6c service nova] Acquiring lock "e23e7124-676c-4b64-a77f-e9c7b46f0f18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:35:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0031b082-022c-4373-aef1-82dd72d0b114 req-62185372-e60f-4a50-8302-e075efd29a6c service nova] Lock "e23e7124-676c-4b64-a77f-e9c7b46f0f18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:35:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0031b082-022c-4373-aef1-82dd72d0b114 req-62185372-e60f-4a50-8302-e075efd29a6c service nova] Lock "e23e7124-676c-4b64-a77f-e9c7b46f0f18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:35:38 user nova-compute[74247]: DEBUG nova.compute.manager [req-0031b082-022c-4373-aef1-82dd72d0b114 req-62185372-e60f-4a50-8302-e075efd29a6c service nova] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] No waiting events found dispatching network-vif-plugged-af4e0bec-8cec-4373-b21f-9d65fb7e0eff {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:35:38 user nova-compute[74247]: WARNING nova.compute.manager [req-0031b082-022c-4373-aef1-82dd72d0b114 req-62185372-e60f-4a50-8302-e075efd29a6c service nova] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Received unexpected event network-vif-plugged-af4e0bec-8cec-4373-b21f-9d65fb7e0eff for instance with vm_state building and task_state spawning.
Oct 16 18:35:38 user nova-compute[74247]: DEBUG nova.compute.manager [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:35:38 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:35:38 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Instance spawned successfully.
Oct 16 18:35:38 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 18:35:38 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:35:38 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:35:38 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:35:38 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:35:38 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:35:38 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:35:38 user nova-compute[74247]: INFO nova.compute.manager [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Took 6.33 seconds to spawn the instance on the hypervisor.
Oct 16 18:35:38 user nova-compute[74247]: DEBUG nova.compute.manager [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:35:38 user nova-compute[74247]: INFO nova.compute.manager [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Took 7.25 seconds to build instance.
Oct 16 18:35:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-02fad3f8-b3fb-4a06-896d-647421d9d1c3 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Lock "e23e7124-676c-4b64-a77f-e9c7b46f0f18" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.390s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:35:39 user nova-compute[74247]: INFO nova.compute.manager [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Rescuing
Oct 16 18:35:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "refresh_cache-7dcc08e9-7439-436b-8d9f-facaf04e22c1" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:35:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquired lock "refresh_cache-7dcc08e9-7439-436b-8d9f-facaf04e22c1" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:35:39 user nova-compute[74247]: DEBUG nova.network.neutron [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:35:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:40 user nova-compute[74247]: DEBUG nova.network.neutron [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Updating instance_info_cache with network_info: [{"id": "b7a0865a-62eb-4517-83ba-eb30ff219e50", "address": "fa:16:3e:47:07:5d", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a0865a-62", "ovs_interfaceid": "b7a0865a-62eb-4517-83ba-eb30ff219e50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:35:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Releasing lock "refresh_cache-7dcc08e9-7439-436b-8d9f-facaf04e22c1" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:35:40 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:40 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:40 user nova-compute[74247]: DEBUG nova.compute.manager [req-3500b03a-e28e-4e44-a563-f8fa9dcbfdb6 req-b54963f9-b320-4c9a-9b4c-35723baf24aa service nova] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Received event network-vif-unplugged-b7a0865a-62eb-4517-83ba-eb30ff219e50 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:35:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3500b03a-e28e-4e44-a563-f8fa9dcbfdb6 req-b54963f9-b320-4c9a-9b4c-35723baf24aa service nova] Acquiring lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:35:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3500b03a-e28e-4e44-a563-f8fa9dcbfdb6 req-b54963f9-b320-4c9a-9b4c-35723baf24aa service nova] Lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:35:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3500b03a-e28e-4e44-a563-f8fa9dcbfdb6 req-b54963f9-b320-4c9a-9b4c-35723baf24aa service nova] Lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:35:40 user nova-compute[74247]: DEBUG nova.compute.manager [req-3500b03a-e28e-4e44-a563-f8fa9dcbfdb6 req-b54963f9-b320-4c9a-9b4c-35723baf24aa service nova] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] No waiting events found dispatching network-vif-unplugged-b7a0865a-62eb-4517-83ba-eb30ff219e50 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:35:40 user nova-compute[74247]: WARNING nova.compute.manager [req-3500b03a-e28e-4e44-a563-f8fa9dcbfdb6 req-b54963f9-b320-4c9a-9b4c-35723baf24aa service nova] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Received unexpected event network-vif-unplugged-b7a0865a-62eb-4517-83ba-eb30ff219e50 for instance with vm_state active and task_state rescuing.
Oct 16 18:35:40 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:40 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:41 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Instance destroyed successfully.
Oct 16 18:35:41 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Attempting a stable device rescue
Oct 16 18:35:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:41 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74247) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 16 18:35:41 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Instance directory exists: not creating {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 16 18:35:41 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Creating image(s)
Oct 16 18:35:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "/opt/stack/data/nova/instances/7dcc08e9-7439-436b-8d9f-facaf04e22c1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:35:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "/opt/stack/data/nova/instances/7dcc08e9-7439-436b-8d9f-facaf04e22c1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:35:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "/opt/stack/data/nova/instances/7dcc08e9-7439-436b-8d9f-facaf04e22c1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:35:41 user nova-compute[74247]: DEBUG nova.objects.instance [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7dcc08e9-7439-436b-8d9f-facaf04e22c1 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:35:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "59135e1b0fa50f04cac3a2f62863e34646a9e058" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:35:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "59135e1b0fa50f04cac3a2f62863e34646a9e058" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:35:42 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59135e1b0fa50f04cac3a2f62863e34646a9e058.part --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:35:42 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59135e1b0fa50f04cac3a2f62863e34646a9e058.part --force-share --output=json" returned: 0 in 0.178s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:35:42 user nova-compute[74247]: DEBUG nova.virt.images [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] 0a16cbbf-0d85-43cb-a5e0-0b6de72127d0 was qcow2, converting to raw {{(pid=74247) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 16 18:35:42 user nova-compute[74247]: DEBUG nova.privsep.utils [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74247) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 18:35:42 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/59135e1b0fa50f04cac3a2f62863e34646a9e058.part /opt/stack/data/nova/instances/_base/59135e1b0fa50f04cac3a2f62863e34646a9e058.converted {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:35:42 user nova-compute[74247]: DEBUG nova.compute.manager [req-c75612ef-01cb-4862-9373-9d30b6a5a369 req-e701895d-dc59-4d4e-b890-80f5bd6e0a1f service nova] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Received event network-vif-plugged-b7a0865a-62eb-4517-83ba-eb30ff219e50 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:35:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c75612ef-01cb-4862-9373-9d30b6a5a369 req-e701895d-dc59-4d4e-b890-80f5bd6e0a1f service nova] Acquiring lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:35:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c75612ef-01cb-4862-9373-9d30b6a5a369 req-e701895d-dc59-4d4e-b890-80f5bd6e0a1f service nova] Lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:35:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c75612ef-01cb-4862-9373-9d30b6a5a369 req-e701895d-dc59-4d4e-b890-80f5bd6e0a1f service nova] Lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:35:42 user nova-compute[74247]: DEBUG nova.compute.manager [req-c75612ef-01cb-4862-9373-9d30b6a5a369 req-e701895d-dc59-4d4e-b890-80f5bd6e0a1f service nova] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] No waiting events found dispatching network-vif-plugged-b7a0865a-62eb-4517-83ba-eb30ff219e50 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:35:42 user nova-compute[74247]: WARNING nova.compute.manager [req-c75612ef-01cb-4862-9373-9d30b6a5a369 req-e701895d-dc59-4d4e-b890-80f5bd6e0a1f service nova] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Received unexpected event network-vif-plugged-b7a0865a-62eb-4517-83ba-eb30ff219e50 for instance with vm_state active and task_state rescuing.
Oct 16 18:35:42 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/59135e1b0fa50f04cac3a2f62863e34646a9e058.part /opt/stack/data/nova/instances/_base/59135e1b0fa50f04cac3a2f62863e34646a9e058.converted" returned: 0 in 0.458s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:35:42 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59135e1b0fa50f04cac3a2f62863e34646a9e058.converted --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59135e1b0fa50f04cac3a2f62863e34646a9e058.converted --force-share --output=json" returned: 0 in 0.196s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "59135e1b0fa50f04cac3a2f62863e34646a9e058" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.885s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "59135e1b0fa50f04cac3a2f62863e34646a9e058" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "59135e1b0fa50f04cac3a2f62863e34646a9e058" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59135e1b0fa50f04cac3a2f62863e34646a9e058 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59135e1b0fa50f04cac3a2f62863e34646a9e058 --force-share --output=json" returned: 0 in 0.174s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59135e1b0fa50f04cac3a2f62863e34646a9e058,backing_fmt=raw /opt/stack/data/nova/instances/7dcc08e9-7439-436b-8d9f-facaf04e22c1/disk.rescue {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59135e1b0fa50f04cac3a2f62863e34646a9e058,backing_fmt=raw /opt/stack/data/nova/instances/7dcc08e9-7439-436b-8d9f-facaf04e22c1/disk.rescue" returned: 0 in 0.049s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "59135e1b0fa50f04cac3a2f62863e34646a9e058" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG nova.objects.instance [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lazy-loading 'migration_context' on Instance uuid 7dcc08e9-7439-436b-8d9f-facaf04e22c1 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG nova.objects.base [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Object Instance<7dcc08e9-7439-436b-8d9f-facaf04e22c1> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Start _get_guest_xml network_info=[{"id": "b7a0865a-62eb-4517-83ba-eb30ff219e50", "address": "fa:16:3e:47:07:5d", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "vif_mac": "fa:16:3e:47:07:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a0865a-62", "ovs_interfaceid": "b7a0865a-62eb-4517-83ba-eb30ff219e50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0a16cbbf-0d85-43cb-a5e0-0b6de72127d0', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WMKTPjCc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '7dcc08e9-7439-436b-8d9f-facaf04e22c1', 'attached_at': '', 'detached_at': '', 'volume_id': 'f18ceae5-8693-41f8-b319-d937cd5052bc', 'serial': 'f18ceae5-8693-41f8-b319-d937cd5052bc'}, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '4d7fab72-cff3-4403-9111-f1244afea948', 'guest_format': None, 'volume_type': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG nova.objects.instance [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lazy-loading 'resources' on Instance uuid 7dcc08e9-7439-436b-8d9f-facaf04e22c1 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG nova.objects.base [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Object Instance<7dcc08e9-7439-436b-8d9f-facaf04e22c1> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG nova.objects.instance [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lazy-loading 'numa_topology' on Instance uuid 7dcc08e9-7439-436b-8d9f-facaf04e22c1 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG nova.objects.base [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Object Instance<7dcc08e9-7439-436b-8d9f-facaf04e22c1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:35:43 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:35:43 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:35:43 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG nova.objects.instance [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7dcc08e9-7439-436b-8d9f-facaf04e22c1 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG nova.objects.base [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Object Instance<7dcc08e9-7439-436b-8d9f-facaf04e22c1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WMKTPjCc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:35:43 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:35:43 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:35:43 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:35:43 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:35:43 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:35:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc -p 172.16.0.220:3260" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a64667-a334-44ef-a9b4-cf68c850f5c1]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = WMKTPjCc\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 16 18:35:43 user nova-compute[74247]: node.name = iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc
Oct 16 18:35:43 user nova-compute[74247]: node.tpgt = -1
Oct 16 18:35:43 user nova-compute[74247]: node.startup = automatic
Oct 16 18:35:43 user nova-compute[74247]: node.leading_login = No
Oct 16 18:35:43 user nova-compute[74247]: iface.iscsi_ifacename = default
Oct 16 18:35:43 user nova-compute[74247]: iface.net_ifacename = <empty>
Oct 16 18:35:43 user nova-compute[74247]: iface.ipaddress = <empty>
Oct 16 18:35:43 user nova-compute[74247]: iface.prefix_len = 0
Oct 16 18:35:43 user nova-compute[74247]: iface.hwaddress = <empty>
Oct 16 18:35:43 user nova-compute[74247]: iface.transport_name = tcp
Oct 16 18:35:43 user nova-compute[74247]: iface.initiatorname = <empty>
Oct 16 18:35:43 user nova-compute[74247]: iface.state = <empty>
Oct 16 18:35:43 user nova-compute[74247]: iface.vlan_id = 0
Oct 16 18:35:43 user nova-compute[74247]: iface.vlan_priority = 0
Oct 16 18:35:43 user nova-compute[74247]: iface.vlan_state = <empty>
Oct 16 18:35:43 user nova-compute[74247]: iface.iface_num = 0
Oct 16 18:35:43 user nova-compute[74247]: iface.mtu = 0
Oct 16 18:35:43 user nova-compute[74247]: iface.port = 0
Oct 16 18:35:43 user nova-compute[74247]: iface.bootproto = <empty>
Oct 16 18:35:43 user nova-compute[74247]: iface.subnet_mask = <empty>
Oct 16 18:35:43 user nova-compute[74247]: iface.gateway = <empty>
Oct 16 18:35:43 user nova-compute[74247]: iface.dhcp_alt_client_id_state = <empty>
Oct 16 18:35:43 user nova-compute[74247]: iface.dhcp_alt_client_id = <empty>
Oct 16 18:35:43 user nova-compute[74247]: iface.dhcp_dns = <empty>
Oct 16 18:35:43 user nova-compute[74247]: iface.dhcp_learn_iqn = <empty>
Oct 16 18:35:43 user nova-compute[74247]: iface.dhcp_req_vendor_id_state = <empty>
Oct 16 18:35:43 user nova-compute[74247]: iface.dhcp_vendor_id_state = <empty>
Oct 16 18:35:43 user nova-compute[74247]: iface.dhcp_vendor_id = <empty>
Oct 16 18:35:43 user nova-compute[74247]: iface.dhcp_slp_da = <empty>
Oct 16 18:35:43 user nova-compute[74247]: iface.fragmentation = <empty>
Oct 16 18:35:43 user nova-compute[74247]: iface.gratuitous_arp = <empty>
Oct 16 18:35:43 user nova-compute[74247]: iface.incoming_forwarding = <empty>
Oct 16 18:35:43 user nova-compute[74247]: iface.tos_state = <empty>
Oct 16 18:35:43 user nova-compute[74247]: iface.tos = 0
Oct 16 18:35:43 user nova-compute[74247]: iface.ttl = 0
Oct 16 18:35:43 user nova-compute[74247]: iface.delayed_ack = <empty>
Oct 16 18:35:43 user nova-compute[74247]: iface.tcp_nagle = <empty>
Oct 16 18:35:43 user nova-compute[74247]: iface.tcp_wsf_state = <empty>
Oct 16 18:35:43 user nova-compute[74247]: iface.tcp_wsf = 0
Oct 16 18:35:43 user nova-compute[74247]: iface.tcp_timer_scale = 0
Oct 16 18:35:43 user nova-compute[74247]: iface.tcp_timestamp = <empty>
Oct 16 18:35:43 user nova-compute[74247]: iface.redirect = <empty>
Oct 16 18:35:43 user nova-compute[74247]: iface.def_task_mgmt_timeout = 0
Oct 16 18:35:43 user nova-compute[74247]: iface.header_digest = <empty>
Oct 16 18:35:43 user nova-compute[74247]: iface.data_digest = <empty>
Oct 16 18:35:43 user nova-compute[74247]: iface.immediate_data = <empty>
Oct 16 18:35:43 user nova-compute[74247]: iface.initial_r2t = <empty>
Oct 16 18:35:43 user nova-compute[74247]: iface.data_seq_inorder = <empty>
Oct 16 18:35:43 user nova-compute[74247]: iface.data_pdu_inorder = <empty>
Oct 16 18:35:43 user nova-compute[74247]: iface.erl = 0
Oct 16 18:35:43 user nova-compute[74247]: iface.max_receive_data_len = 0
Oct 16 18:35:43 user nova-compute[74247]: iface.first_burst_len = 0
Oct 16 18:35:43 user nova-compute[74247]: iface.max_outstanding_r2t = 0
Oct 16 18:35:43 user nova-compute[74247]: iface.max_burst_len = 0
Oct 16 18:35:43 user nova-compute[74247]: iface.chap_auth = <empty>
Oct 16 18:35:43 user nova-compute[74247]: iface.bidi_chap = <empty>
Oct 16 18:35:43 user nova-compute[74247]: iface.strict_login_compliance = <empty>
Oct 16 18:35:43 user nova-compute[74247]: iface.discovery_auth = <empty>
Oct 16 18:35:43 user nova-compute[74247]: iface.discovery_logout = <empty>
Oct 16 18:35:43 user nova-compute[74247]: node.discovery_address = <empty>
Oct 16 18:35:43 user nova-compute[74247]: node.discovery_port = 0
Oct 16 18:35:43 user nova-compute[74247]: node.discovery_type = static
Oct 16 18:35:43 user nova-compute[74247]: node.session.initial_cmdsn = 0
Oct 16 18:35:43 user nova-compute[74247]: node.session.initial_login_retry_max = 8
Oct 16 18:35:43 user nova-compute[74247]: node.session.xmit_thread_priority = -20
Oct 16 18:35:43 user nova-compute[74247]: node.session.cmds_max = 128
Oct 16 18:35:43 user nova-compute[74247]: node.session.queue_depth = 32
Oct 16 18:35:43 user nova-compute[74247]: node.session.nr_sessions = 1
Oct 16 18:35:43 user nova-compute[74247]: node.session.auth.authmethod = CHAP
Oct 16 18:35:43 user nova-compute[74247]: node.session.auth.username = WMKTPjCc
Oct 16 18:35:43 user nova-compute[74247]: node.session.auth.password = ***
Oct 16 18:35:43 user nova-compute[74247]: node.session.auth.username_in = <empty>
Oct 16 18:35:43 user nova-compute[74247]: node.session.auth.password_in = <empty>
Oct 16 18:35:43 user nova-compute[74247]: node.session.auth.chap_algs = MD5
Oct 16 18:35:43 user nova-compute[74247]: node.session.timeo.replacement_timeout = 120
Oct 16 18:35:43 user nova-compute[74247]: node.session.err_timeo.abort_timeout = 15
Oct 16 18:35:43 user nova-compute[74247]: node.session.err_timeo.lu_reset_timeout = 30
Oct 16 18:35:43 user nova-compute[74247]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 16 18:35:43 user nova-compute[74247]: node.session.err_timeo.host_reset_timeout = 60
Oct 16 18:35:43 user nova-compute[74247]: node.session.iscsi.FastAbort = Yes
Oct 16 18:35:43 user nova-compute[74247]: node.session.iscsi.InitialR2T = No
Oct 16 18:35:43 user nova-compute[74247]: node.session.iscsi.ImmediateData = Yes
Oct 16 18:35:43 user nova-compute[74247]: node.session.iscsi.FirstBurstLength = 262144
Oct 16 18:35:43 user nova-compute[74247]: node.session.iscsi.MaxBurstLength = 16776192
Oct 16 18:35:43 user nova-compute[74247]: node.session.iscsi.DefaultTime2Retain = 0
Oct 16 18:35:43 user nova-compute[74247]: node.session.iscsi.DefaultTime2Wait = 2
Oct 16 18:35:43 user nova-compute[74247]: node.session.iscsi.MaxConnections = 1
Oct 16 18:35:43 user nova-compute[74247]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 16 18:35:43 user nova-compute[74247]: node.session.iscsi.ERL = 0
Oct 16 18:35:43 user nova-compute[74247]: node.session.scan = manual
Oct 16 18:35:43 user nova-compute[74247]: node.session.reopen_max = 0
Oct 16 18:35:43 user nova-compute[74247]: node.conn[0].address = 172.16.0.220
Oct 16 18:35:43 user nova-compute[74247]: node.conn[0].port = 3260
Oct 16 18:35:43 user nova-compute[74247]: node.conn[0].startup = manual
Oct 16 18:35:43 user nova-compute[74247]: node.conn[0].tcp.window_size = 524288
Oct 16 18:35:43 user nova-compute[74247]: node.conn[0].tcp.type_of_service = 0
Oct 16 18:35:43 user nova-compute[74247]: node.conn[0].timeo.logout_timeout = 15
Oct 16 18:35:43 user nova-compute[74247]: node.conn[0].timeo.login_timeout = 15
Oct 16 18:35:43 user nova-compute[74247]: node.conn[0].timeo.auth_timeout = 45
Oct 16 18:35:43 user nova-compute[74247]: node.conn[0].timeo.noop_out_interval = 5
Oct 16 18:35:43 user nova-compute[74247]: node.conn[0].timeo.noop_out_timeout = 5
Oct 16 18:35:43 user nova-compute[74247]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 16 18:35:43 user nova-compute[74247]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 16 18:35:43 user nova-compute[74247]: node.conn[0].iscsi.HeaderDigest = None
Oct 16 18:35:43 user nova-compute[74247]: node.conn[0].iscsi.DataDigest = None
Oct 16 18:35:43 user nova-compute[74247]: node.conn[0].iscsi.IFMarker = No
Oct 16 18:35:43 user nova-compute[74247]: node.conn[0].iscsi.OFMarker = No
Oct 16 18:35:43 user nova-compute[74247]: # END RECORD
Oct 16 18:35:43 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f984f7cc-2a27-460b-9578-934f09142f43]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd1700e-39fa-4378-9ed3-f762e36ae71a]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WMKTPjCc {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WMKTPjCc" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c05939-60ff-414f-98be-8c7b186a3c9d]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WMKTPjCc'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5801c4ed-7062-4bf0-b21d-213cb575167d]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0669618f-4415-443c-99ea-cb87f3882a0d]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e (non-flash)
Oct 16 18:35:43 user nova-compute[74247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:35:43 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e (non-flash)
Oct 16 18:35:43 user nova-compute[74247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:35:43 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.158s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] HCTL ('34', '0', '0', 0) found on session 23 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[927a8c12-b6f4-457b-930e-6a081e62d885]: (4, ('0 0 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Searching for a device in session 23 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WMKTPjCc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.184s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] <== connect_volume: return (186ms) {'type': 'block', 'scsi_wwn': '23637393464323764', 'path': '/dev/sdc'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637393464323764', 'path': '/dev/sdc'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:33:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1738372672',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1738372672',id=22,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:34:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bce6164a392e4cc2a027d12c49145e6d',ramdisk_id='',reservation_id='r-lqc3f0nm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-656520712',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:34:19Z,user_data=None,user_id='b01d3e5d2fcb40bc92c3d2fe1236d509',uuid=7dcc08e9-7439-436b-8d9f-facaf04e22c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7a0865a-62eb-4517-83ba-eb30ff219e50", "address": "fa:16:3e:47:07:5d", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "vif_mac": "fa:16:3e:47:07:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a0865a-62", "ovs_interfaceid": "b7a0865a-62eb-4517-83ba-eb30ff219e50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Converting VIF {"id": "b7a0865a-62eb-4517-83ba-eb30ff219e50", "address": "fa:16:3e:47:07:5d", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "vif_mac": "fa:16:3e:47:07:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a0865a-62", "ovs_interfaceid": "b7a0865a-62eb-4517-83ba-eb30ff219e50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:07:5d,bridge_name='br-int',has_traffic_filtering=True,id=b7a0865a-62eb-4517-83ba-eb30ff219e50,network=Network(2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7a0865a-62') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG nova.objects.instance [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lazy-loading 'pci_devices' on Instance uuid 7dcc08e9-7439-436b-8d9f-facaf04e22c1 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG nova.objects.base [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Object Instance<7dcc08e9-7439-436b-8d9f-facaf04e22c1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:35:43 user nova-compute[74247]:   <uuid>7dcc08e9-7439-436b-8d9f-facaf04e22c1</uuid>
Oct 16 18:35:43 user nova-compute[74247]:   <name>instance-00000016</name>
Oct 16 18:35:43 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:35:43 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:35:43 user nova-compute[74247]:   <metadata>
Oct 16 18:35:43 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:35:43 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:35:43 user nova-compute[74247]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1738372672</nova:name>
Oct 16 18:35:43 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:35:43</nova:creationTime>
Oct 16 18:35:43 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:35:43 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:35:43 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:35:43 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:35:43 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:35:43 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:35:43 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:35:43 user nova-compute[74247]:       <nova:owner>
Oct 16 18:35:43 user nova-compute[74247]:         <nova:user uuid="b01d3e5d2fcb40bc92c3d2fe1236d509">tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member</nova:user>
Oct 16 18:35:43 user nova-compute[74247]:         <nova:project uuid="bce6164a392e4cc2a027d12c49145e6d">tempest-ServerBootFromVolumeStableRescueTest-656520712</nova:project>
Oct 16 18:35:43 user nova-compute[74247]:       </nova:owner>
Oct 16 18:35:43 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:35:43 user nova-compute[74247]:       <nova:ports>
Oct 16 18:35:43 user nova-compute[74247]:         <nova:port uuid="b7a0865a-62eb-4517-83ba-eb30ff219e50">
Oct 16 18:35:43 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 16 18:35:43 user nova-compute[74247]:         </nova:port>
Oct 16 18:35:43 user nova-compute[74247]:       </nova:ports>
Oct 16 18:35:43 user nova-compute[74247]:     </nova:instance>
Oct 16 18:35:43 user nova-compute[74247]:   </metadata>
Oct 16 18:35:43 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:35:43 user nova-compute[74247]:     <system>
Oct 16 18:35:43 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:35:43 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:35:43 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:35:43 user nova-compute[74247]:       <entry name="serial">7dcc08e9-7439-436b-8d9f-facaf04e22c1</entry>
Oct 16 18:35:43 user nova-compute[74247]:       <entry name="uuid">7dcc08e9-7439-436b-8d9f-facaf04e22c1</entry>
Oct 16 18:35:43 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:35:43 user nova-compute[74247]:     </system>
Oct 16 18:35:43 user nova-compute[74247]:   </sysinfo>
Oct 16 18:35:43 user nova-compute[74247]:   <os>
Oct 16 18:35:43 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:35:43 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:35:43 user nova-compute[74247]:   </os>
Oct 16 18:35:43 user nova-compute[74247]:   <features>
Oct 16 18:35:43 user nova-compute[74247]:     <acpi/>
Oct 16 18:35:43 user nova-compute[74247]:     <apic/>
Oct 16 18:35:43 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:35:43 user nova-compute[74247]:   </features>
Oct 16 18:35:43 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:35:43 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:35:43 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:35:43 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:35:43 user nova-compute[74247]:   </clock>
Oct 16 18:35:43 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:35:43 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:35:43 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:35:43 user nova-compute[74247]:   </cpu>
Oct 16 18:35:43 user nova-compute[74247]:   <devices>
Oct 16 18:35:43 user nova-compute[74247]:     <disk type="block" device="disk">
Oct 16 18:35:43 user nova-compute[74247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:35:43 user nova-compute[74247]:       <source dev="/dev/sdc"/>
Oct 16 18:35:43 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:35:43 user nova-compute[74247]:       <serial>f18ceae5-8693-41f8-b319-d937cd5052bc</serial>
Oct 16 18:35:43 user nova-compute[74247]:     </disk>
Oct 16 18:35:43 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:35:43 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:35:43 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/7dcc08e9-7439-436b-8d9f-facaf04e22c1/disk.rescue"/>
Oct 16 18:35:43 user nova-compute[74247]:       <target dev="vdb" bus="virtio"/>
Oct 16 18:35:43 user nova-compute[74247]:       <boot order="1"/>
Oct 16 18:35:43 user nova-compute[74247]:     </disk>
Oct 16 18:35:43 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:35:43 user nova-compute[74247]:       <mac address="fa:16:3e:47:07:5d"/>
Oct 16 18:35:43 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:35:43 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:35:43 user nova-compute[74247]:       <target dev="tapb7a0865a-62"/>
Oct 16 18:35:43 user nova-compute[74247]:     </interface>
Oct 16 18:35:43 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:35:43 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/7dcc08e9-7439-436b-8d9f-facaf04e22c1/console.log" append="off"/>
Oct 16 18:35:43 user nova-compute[74247]:     </serial>
Oct 16 18:35:43 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:35:43 user nova-compute[74247]:     <video>
Oct 16 18:35:43 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:35:43 user nova-compute[74247]:     </video>
Oct 16 18:35:43 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:35:43 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:35:43 user nova-compute[74247]:     </rng>
Oct 16 18:35:43 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:35:43 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:35:43 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:35:43 user nova-compute[74247]:     </memballoon>
Oct 16 18:35:43 user nova-compute[74247]:   </devices>
Oct 16 18:35:43 user nova-compute[74247]: </domain>
Oct 16 18:35:43 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:35:43 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Instance destroyed successfully.
Oct 16 18:35:43 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:35:43 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] No VIF found with MAC fa:16:3e:47:07:5d, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:35:44 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:45 user nova-compute[74247]: DEBUG nova.compute.manager [req-36084946-9301-4951-80c0-9ed53ca35519 req-61d88c69-d8fa-45ce-8ff8-78ea5e0aae25 service nova] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Received event network-vif-plugged-b7a0865a-62eb-4517-83ba-eb30ff219e50 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:35:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-36084946-9301-4951-80c0-9ed53ca35519 req-61d88c69-d8fa-45ce-8ff8-78ea5e0aae25 service nova] Acquiring lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:35:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-36084946-9301-4951-80c0-9ed53ca35519 req-61d88c69-d8fa-45ce-8ff8-78ea5e0aae25 service nova] Lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:35:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-36084946-9301-4951-80c0-9ed53ca35519 req-61d88c69-d8fa-45ce-8ff8-78ea5e0aae25 service nova] Lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:35:45 user nova-compute[74247]: DEBUG nova.compute.manager [req-36084946-9301-4951-80c0-9ed53ca35519 req-61d88c69-d8fa-45ce-8ff8-78ea5e0aae25 service nova] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] No waiting events found dispatching network-vif-plugged-b7a0865a-62eb-4517-83ba-eb30ff219e50 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:35:45 user nova-compute[74247]: WARNING nova.compute.manager [req-36084946-9301-4951-80c0-9ed53ca35519 req-61d88c69-d8fa-45ce-8ff8-78ea5e0aae25 service nova] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Received unexpected event network-vif-plugged-b7a0865a-62eb-4517-83ba-eb30ff219e50 for instance with vm_state active and task_state rescuing.
Oct 16 18:35:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:46 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:47 user nova-compute[74247]: DEBUG nova.compute.manager [None req-8f70f92d-0a54-4ed7-b2a5-e8ad49263776 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:35:47 user nova-compute[74247]: DEBUG nova.compute.manager [req-d8ce8a56-bd89-435e-b1a9-50e1314cab9f req-5190137c-aa8d-4653-a318-06ae04a5f4bb service nova] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Received event network-vif-plugged-b7a0865a-62eb-4517-83ba-eb30ff219e50 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:35:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d8ce8a56-bd89-435e-b1a9-50e1314cab9f req-5190137c-aa8d-4653-a318-06ae04a5f4bb service nova] Acquiring lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:35:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d8ce8a56-bd89-435e-b1a9-50e1314cab9f req-5190137c-aa8d-4653-a318-06ae04a5f4bb service nova] Lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:35:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d8ce8a56-bd89-435e-b1a9-50e1314cab9f req-5190137c-aa8d-4653-a318-06ae04a5f4bb service nova] Lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:35:47 user nova-compute[74247]: DEBUG nova.compute.manager [req-d8ce8a56-bd89-435e-b1a9-50e1314cab9f req-5190137c-aa8d-4653-a318-06ae04a5f4bb service nova] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] No waiting events found dispatching network-vif-plugged-b7a0865a-62eb-4517-83ba-eb30ff219e50 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:35:47 user nova-compute[74247]: WARNING nova.compute.manager [req-d8ce8a56-bd89-435e-b1a9-50e1314cab9f req-5190137c-aa8d-4653-a318-06ae04a5f4bb service nova] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Received unexpected event network-vif-plugged-b7a0865a-62eb-4517-83ba-eb30ff219e50 for instance with vm_state active and task_state rescuing.
Oct 16 18:35:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:54 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:35:58 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:35:59 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:35:59 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 18:35:59 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Rebuilding the list of instances to heal {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 18:35:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "refresh_cache-e37fbc27-3404-479a-be08-4d590391cf30" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:35:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquired lock "refresh_cache-e37fbc27-3404-479a-be08-4d590391cf30" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:35:59 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Forcefully refreshing network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 18:35:59 user nova-compute[74247]: DEBUG nova.objects.instance [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lazy-loading 'info_cache' on Instance uuid e37fbc27-3404-479a-be08-4d590391cf30 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:35:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:00 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Updating instance_info_cache with network_info: [{"id": "634511f9-ce96-4fe6-8bfc-51846e4dcb4f", "address": "fa:16:3e:d2:d2:f4", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634511f9-ce", "ovs_interfaceid": "634511f9-ce96-4fe6-8bfc-51846e4dcb4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:36:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Releasing lock "refresh_cache-e37fbc27-3404-479a-be08-4d590391cf30" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:36:00 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Updated the network info_cache for instance {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 18:36:00 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:36:00 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:36:00 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:36:00 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:36:00 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:36:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:01 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:36:02 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:36:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:36:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:36:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:36:02 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 18:36:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6367b6d-1bc2-4472-b0c4-07baec4a28b0/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:36:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6367b6d-1bc2-4472-b0c4-07baec4a28b0/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:36:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6367b6d-1bc2-4472-b0c4-07baec4a28b0/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:36:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6367b6d-1bc2-4472-b0c4-07baec4a28b0/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:36:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:36:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:36:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:36:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:36:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:36:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb56c456-005d-4d2d-b163-7ab281ca11fb/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:36:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb56c456-005d-4d2d-b163-7ab281ca11fb/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:36:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb56c456-005d-4d2d-b163-7ab281ca11fb/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:36:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb56c456-005d-4d2d-b163-7ab281ca11fb/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:36:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:36:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:36:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:36:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:36:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:36:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-2409fccd-f3cc-469c-946b-d2e5ebc35350 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "d6367b6d-1bc2-4472-b0c4-07baec4a28b0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:36:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-2409fccd-f3cc-469c-946b-d2e5ebc35350 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "d6367b6d-1bc2-4472-b0c4-07baec4a28b0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:36:04 user nova-compute[74247]: INFO nova.compute.manager [None req-2409fccd-f3cc-469c-946b-d2e5ebc35350 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Detaching volume e52798fc-3122-48c4-9ba4-d50e4932208e
Oct 16 18:36:04 user nova-compute[74247]: INFO nova.virt.block_device [None req-2409fccd-f3cc-469c-946b-d2e5ebc35350 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Attempting to driver detach volume e52798fc-3122-48c4-9ba4-d50e4932208e from mountpoint /dev/vdb
Oct 16 18:36:04 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-2409fccd-f3cc-469c-946b-d2e5ebc35350 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Attempting to detach device vdb from instance d6367b6d-1bc2-4472-b0c4-07baec4a28b0 from the persistent domain config. {{(pid=74247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 18:36:04 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-2409fccd-f3cc-469c-946b-d2e5ebc35350 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 18:36:04 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:36:04 user nova-compute[74247]:   <source dev="/dev/sdh"/>
Oct 16 18:36:04 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:36:04 user nova-compute[74247]:   <serial>e52798fc-3122-48c4-9ba4-d50e4932208e</serial>
Oct 16 18:36:04 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 18:36:04 user nova-compute[74247]: </disk>
Oct 16 18:36:04 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:36:04 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-2409fccd-f3cc-469c-946b-d2e5ebc35350 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Successfully detached device vdb from instance d6367b6d-1bc2-4472-b0c4-07baec4a28b0 from the persistent domain config.
Oct 16 18:36:04 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-2409fccd-f3cc-469c-946b-d2e5ebc35350 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d6367b6d-1bc2-4472-b0c4-07baec4a28b0 from the live domain config. {{(pid=74247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 18:36:04 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-2409fccd-f3cc-469c-946b-d2e5ebc35350 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 18:36:04 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:36:04 user nova-compute[74247]:   <source dev="/dev/sdh"/>
Oct 16 18:36:04 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:36:04 user nova-compute[74247]:   <serial>e52798fc-3122-48c4-9ba4-d50e4932208e</serial>
Oct 16 18:36:04 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 18:36:04 user nova-compute[74247]: </disk>
Oct 16 18:36:04 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:36:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:36:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:36:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:36:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:36:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dcc08e9-7439-436b-8d9f-facaf04e22c1/disk.rescue --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:36:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dcc08e9-7439-436b-8d9f-facaf04e22c1/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:36:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dcc08e9-7439-436b-8d9f-facaf04e22c1/disk.rescue --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:36:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-2409fccd-f3cc-469c-946b-d2e5ebc35350 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d6367b6d-1bc2-4472-b0c4-07baec4a28b0 {{(pid=74247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 18:36:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dcc08e9-7439-436b-8d9f-facaf04e22c1/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:36:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23e7124-676c-4b64-a77f-e9c7b46f0f18/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:36:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23e7124-676c-4b64-a77f-e9c7b46f0f18/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:36:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23e7124-676c-4b64-a77f-e9c7b46f0f18/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:36:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23e7124-676c-4b64-a77f-e9c7b46f0f18/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:36:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:36:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:36:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:36:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:36:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:36:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:36:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:36:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:36:07 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:36:07 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:36:07 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=7659MB free_disk=25.080989837646484GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 18:36:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:36:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:36:07 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance e37fbc27-3404-479a-be08-4d590391cf30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:36:07 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance cddf4842-1c25-4cc8-914e-af30849e4d6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:36:07 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance d6367b6d-1bc2-4472-b0c4-07baec4a28b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:36:07 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 958af87e-69d0-4da1-8fcf-90e0f275d62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:36:07 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance d775101d-53a1-48c7-af24-91480be6af61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:36:07 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 7dcc08e9-7439-436b-8d9f-facaf04e22c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:36:07 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance eb56c456-005d-4d2d-b163-7ab281ca11fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:36:07 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance e23e7124-676c-4b64-a77f-e9c7b46f0f18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:36:07 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 18:36:07 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 18:36:07 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:36:07 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:36:07 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 18:36:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.461s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:36:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:11 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:36:11 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 18:36:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:25 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-2409fccd-f3cc-469c-946b-d2e5ebc35350 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d6367b6d-1bc2-4472-b0c4-07baec4a28b0 is timed out.
Oct 16 18:36:25 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-2409fccd-f3cc-469c-946b-d2e5ebc35350 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Successfully detached device vdb from instance d6367b6d-1bc2-4472-b0c4-07baec4a28b0 from the live domain config.
Oct 16 18:36:25 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2409fccd-f3cc-469c-946b-d2e5ebc35350 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2409fccd-f3cc-469c-946b-d2e5ebc35350 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DorZEPQU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:36:25 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-2409fccd-f3cc-469c-946b-d2e5ebc35350 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:36:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-2409fccd-f3cc-469c-946b-d2e5ebc35350 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-2409fccd-f3cc-469c-946b-d2e5ebc35350 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c599028-3436-4fa6-823f-c7f2149cac91]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2409fccd-f3cc-469c-946b-d2e5ebc35350 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 18:36:25 user nova-compute[74247]: No targets found.
Oct 16 18:36:25 user nova-compute[74247]: iSNS:
Oct 16 18:36:25 user nova-compute[74247]: No targets found.
Oct 16 18:36:25 user nova-compute[74247]: STATIC:
Oct 16 18:36:25 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e
Oct 16 18:36:25 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:36:25 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:36:25 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc
Oct 16 18:36:25 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:36:25 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:36:25 user nova-compute[74247]: FIRMWARE:
Oct 16 18:36:25 user nova-compute[74247]: No targets found.
Oct 16 18:36:25 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2409fccd-f3cc-469c-946b-d2e5ebc35350 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 18:36:25 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 18:36:25 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2409fccd-f3cc-469c-946b-d2e5ebc35350 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cec9b2f-35b2-48aa-8465-c3f3c973bf48]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9778b1b6-adf5-43c0-b4e2-96109eded0ee]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2409fccd-f3cc-469c-946b-d2e5ebc35350 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e (non-flash)
Oct 16 18:36:25 user nova-compute[74247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:36:25 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2409fccd-f3cc-469c-946b-d2e5ebc35350 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e (non-flash)
Oct 16 18:36:25 user nova-compute[74247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:36:25 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2409fccd-f3cc-469c-946b-d2e5ebc35350 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe0683d8a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e'): ({'sdh'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-2409fccd-f3cc-469c-946b-d2e5ebc35350 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Removing single pathed devices sdh {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50de111-00e2-43b3-922b-0ee89271a2b5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[83897666-ad86-43f6-8415-fe4d22ebe720]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-2409fccd-f3cc-469c-946b-d2e5ebc35350 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Flushing IO for device /dev/sdh {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9202ceaf-a484-4914-9344-c2e9bf48e859]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-2409fccd-f3cc-469c-946b-d2e5ebc35350 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.047s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcd45df-e31a-4aee-a0c4-dd3bce22cd83]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-2409fccd-f3cc-469c-946b-d2e5ebc35350 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-2409fccd-f3cc-469c-946b-d2e5ebc35350 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] SCSI volumes sdh have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2409fccd-f3cc-469c-946b-d2e5ebc35350 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0558ef7-90b4-4b88-bab1-616b636f01e7]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2409fccd-f3cc-469c-946b-d2e5ebc35350 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3570a15f-b779-4253-a3bc-113c67526315]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2409fccd-f3cc-469c-946b-d2e5ebc35350 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e, portal: 172.16.0.220,3260]
Oct 16 18:36:25 user nova-compute[74247]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e, portal: 172.16.0.220,3260] successful.
Oct 16 18:36:25 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52798fc-3122-48c4-9ba4-d50e4932208e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e8d4a0-5ab4-41f1-971e-6de457db1c57]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2409fccd-f3cc-469c-946b-d2e5ebc35350 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-2409fccd-f3cc-469c-946b-d2e5ebc35350 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2409fccd-f3cc-469c-946b-d2e5ebc35350 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] <== disconnect_volume: return (307ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:36:25 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2409fccd-f3cc-469c-946b-d2e5ebc35350 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 18:36:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:26 user nova-compute[74247]: DEBUG nova.objects.instance [None req-2409fccd-f3cc-469c-946b-d2e5ebc35350 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lazy-loading 'flavor' on Instance uuid d6367b6d-1bc2-4472-b0c4-07baec4a28b0 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:36:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-2409fccd-f3cc-469c-946b-d2e5ebc35350 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "d6367b6d-1bc2-4472-b0c4-07baec4a28b0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.813s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:36:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:29 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:29 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:32 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquiring lock "cbdb3c4c-7a6f-4966-bc13-049efe0cded2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:36:32 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "cbdb3c4c-7a6f-4966-bc13-049efe0cded2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:36:32 user nova-compute[74247]: DEBUG nova.compute.manager [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 18:36:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:36:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:36:33 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:36:33 user nova-compute[74247]: INFO nova.compute.claims [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Claim successful on node user
Oct 16 18:36:33 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:36:33 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:36:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.374s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:36:33 user nova-compute[74247]: DEBUG nova.compute.manager [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 18:36:33 user nova-compute[74247]: DEBUG nova.compute.manager [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 18:36:33 user nova-compute[74247]: DEBUG nova.network.neutron [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 18:36:33 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 18:36:33 user nova-compute[74247]: DEBUG nova.compute.manager [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 18:36:33 user nova-compute[74247]: DEBUG nova.policy [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2bda4c43b45347be96b152caba47b07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5204c1aec5764c298a206429645eb268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 18:36:33 user nova-compute[74247]: DEBUG nova.compute.manager [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 18:36:33 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:36:33 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Creating image(s)
Oct 16 18:36:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquiring lock "/opt/stack/data/nova/instances/cbdb3c4c-7a6f-4966-bc13-049efe0cded2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:36:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "/opt/stack/data/nova/instances/cbdb3c4c-7a6f-4966-bc13-049efe0cded2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:36:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "/opt/stack/data/nova/instances/cbdb3c4c-7a6f-4966-bc13-049efe0cded2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:36:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:36:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.183s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:36:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquiring lock "37399febbd18f60b85fd0f833558f6a3539ab231" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:36:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:36:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:36:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.185s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:36:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/cbdb3c4c-7a6f-4966-bc13-049efe0cded2/disk 1073741824 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:36:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/cbdb3c4c-7a6f-4966-bc13-049efe0cded2/disk 1073741824" returned: 0 in 0.048s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:36:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:36:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:36:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.181s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:36:34 user nova-compute[74247]: DEBUG nova.network.neutron [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Successfully created port: 867368eb-89d8-4de5-a8cd-9a1435b624fb {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:36:34 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cbdb3c4c-7a6f-4966-bc13-049efe0cded2/disk. size=1073741824 {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 18:36:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbdb3c4c-7a6f-4966-bc13-049efe0cded2/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:36:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbdb3c4c-7a6f-4966-bc13-049efe0cded2/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:36:34 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Cannot resize image /opt/stack/data/nova/instances/cbdb3c4c-7a6f-4966-bc13-049efe0cded2/disk to a smaller size. {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 18:36:34 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 18:36:34 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Ensure instance console log exists: /opt/stack/data/nova/instances/cbdb3c4c-7a6f-4966-bc13-049efe0cded2/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:36:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:36:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:36:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:36:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:34 user nova-compute[74247]: DEBUG nova.network.neutron [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Successfully updated port: 867368eb-89d8-4de5-a8cd-9a1435b624fb {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:36:34 user nova-compute[74247]: DEBUG nova.compute.manager [req-99345c30-f761-46d8-a5d4-557ce5b9ab01 req-e67af531-199c-44e9-9067-02a0dc6598ac service nova] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Received event network-changed-867368eb-89d8-4de5-a8cd-9a1435b624fb {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:36:34 user nova-compute[74247]: DEBUG nova.compute.manager [req-99345c30-f761-46d8-a5d4-557ce5b9ab01 req-e67af531-199c-44e9-9067-02a0dc6598ac service nova] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Refreshing instance network info cache due to event network-changed-867368eb-89d8-4de5-a8cd-9a1435b624fb. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:36:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-99345c30-f761-46d8-a5d4-557ce5b9ab01 req-e67af531-199c-44e9-9067-02a0dc6598ac service nova] Acquiring lock "refresh_cache-cbdb3c4c-7a6f-4966-bc13-049efe0cded2" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:36:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-99345c30-f761-46d8-a5d4-557ce5b9ab01 req-e67af531-199c-44e9-9067-02a0dc6598ac service nova] Acquired lock "refresh_cache-cbdb3c4c-7a6f-4966-bc13-049efe0cded2" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:36:34 user nova-compute[74247]: DEBUG nova.network.neutron [req-99345c30-f761-46d8-a5d4-557ce5b9ab01 req-e67af531-199c-44e9-9067-02a0dc6598ac service nova] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Refreshing network info cache for port 867368eb-89d8-4de5-a8cd-9a1435b624fb {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:36:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquiring lock "refresh_cache-cbdb3c4c-7a6f-4966-bc13-049efe0cded2" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG nova.network.neutron [req-99345c30-f761-46d8-a5d4-557ce5b9ab01 req-e67af531-199c-44e9-9067-02a0dc6598ac service nova] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG nova.network.neutron [req-99345c30-f761-46d8-a5d4-557ce5b9ab01 req-e67af531-199c-44e9-9067-02a0dc6598ac service nova] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-99345c30-f761-46d8-a5d4-557ce5b9ab01 req-e67af531-199c-44e9-9067-02a0dc6598ac service nova] Releasing lock "refresh_cache-cbdb3c4c-7a6f-4966-bc13-049efe0cded2" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquired lock "refresh_cache-cbdb3c4c-7a6f-4966-bc13-049efe0cded2" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG nova.network.neutron [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG nova.network.neutron [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG nova.network.neutron [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Updating instance_info_cache with network_info: [{"id": "867368eb-89d8-4de5-a8cd-9a1435b624fb", "address": "fa:16:3e:61:36:9f", "network": {"id": "88a1b265-5360-4362-90bc-3506f805688f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-620663417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5204c1aec5764c298a206429645eb268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867368eb-89", "ovs_interfaceid": "867368eb-89d8-4de5-a8cd-9a1435b624fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Releasing lock "refresh_cache-cbdb3c4c-7a6f-4966-bc13-049efe0cded2" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG nova.compute.manager [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Instance network_info: |[{"id": "867368eb-89d8-4de5-a8cd-9a1435b624fb", "address": "fa:16:3e:61:36:9f", "network": {"id": "88a1b265-5360-4362-90bc-3506f805688f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-620663417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5204c1aec5764c298a206429645eb268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867368eb-89", "ovs_interfaceid": "867368eb-89d8-4de5-a8cd-9a1435b624fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Start _get_guest_xml network_info=[{"id": "867368eb-89d8-4de5-a8cd-9a1435b624fb", "address": "fa:16:3e:61:36:9f", "network": {"id": "88a1b265-5360-4362-90bc-3506f805688f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-620663417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5204c1aec5764c298a206429645eb268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867368eb-89", "ovs_interfaceid": "867368eb-89d8-4de5-a8cd-9a1435b624fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': '83126bb1-29f5-42fe-8620-72ab0797f776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:36:35 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:36:35 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:36:35 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:36:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-803649508',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-803649508',id=25,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPt8RnxxjMin5ow9n0gYco5PnH7fBvzjVT+zJBAuIfIL73SFyQOt4/yFyMr89xqJ/fI+kazkxk5AA5YPdknlG4FiNoYepFgnFcnJNQU4P+bwfVCqmJXmT/tM+RcLA45aFQ==',key_name='tempest-keypair-1823297427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5204c1aec5764c298a206429645eb268',ramdisk_id='',reservation_id='r-cnkbq1wz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-537076068',owner_user_name='tempest-AttachVolumeShelveTestJSON-537076068-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:36:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bda4c43b45347be96b152caba47b07d',uuid=cbdb3c4c-7a6f-4966-bc13-049efe0cded2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "867368eb-89d8-4de5-a8cd-9a1435b624fb", "address": "fa:16:3e:61:36:9f", "network": {"id": "88a1b265-5360-4362-90bc-3506f805688f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-620663417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5204c1aec5764c298a206429645eb268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867368eb-89", "ovs_interfaceid": "867368eb-89d8-4de5-a8cd-9a1435b624fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Converting VIF {"id": "867368eb-89d8-4de5-a8cd-9a1435b624fb", "address": "fa:16:3e:61:36:9f", "network": {"id": "88a1b265-5360-4362-90bc-3506f805688f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-620663417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5204c1aec5764c298a206429645eb268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867368eb-89", "ovs_interfaceid": "867368eb-89d8-4de5-a8cd-9a1435b624fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:36:9f,bridge_name='br-int',has_traffic_filtering=True,id=867368eb-89d8-4de5-a8cd-9a1435b624fb,network=Network(88a1b265-5360-4362-90bc-3506f805688f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867368eb-89') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG nova.objects.instance [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lazy-loading 'pci_devices' on Instance uuid cbdb3c4c-7a6f-4966-bc13-049efe0cded2 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:36:35 user nova-compute[74247]:   <uuid>cbdb3c4c-7a6f-4966-bc13-049efe0cded2</uuid>
Oct 16 18:36:35 user nova-compute[74247]:   <name>instance-00000019</name>
Oct 16 18:36:35 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:36:35 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:36:35 user nova-compute[74247]:   <metadata>
Oct 16 18:36:35 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:36:35 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:36:35 user nova-compute[74247]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-803649508</nova:name>
Oct 16 18:36:35 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:36:35</nova:creationTime>
Oct 16 18:36:35 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:36:35 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:36:35 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:36:35 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:36:35 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:36:35 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:36:35 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:36:35 user nova-compute[74247]:       <nova:owner>
Oct 16 18:36:35 user nova-compute[74247]:         <nova:user uuid="2bda4c43b45347be96b152caba47b07d">tempest-AttachVolumeShelveTestJSON-537076068-project-member</nova:user>
Oct 16 18:36:35 user nova-compute[74247]:         <nova:project uuid="5204c1aec5764c298a206429645eb268">tempest-AttachVolumeShelveTestJSON-537076068</nova:project>
Oct 16 18:36:35 user nova-compute[74247]:       </nova:owner>
Oct 16 18:36:35 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:36:35 user nova-compute[74247]:       <nova:ports>
Oct 16 18:36:35 user nova-compute[74247]:         <nova:port uuid="867368eb-89d8-4de5-a8cd-9a1435b624fb">
Oct 16 18:36:35 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 16 18:36:35 user nova-compute[74247]:         </nova:port>
Oct 16 18:36:35 user nova-compute[74247]:       </nova:ports>
Oct 16 18:36:35 user nova-compute[74247]:     </nova:instance>
Oct 16 18:36:35 user nova-compute[74247]:   </metadata>
Oct 16 18:36:35 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:36:35 user nova-compute[74247]:     <system>
Oct 16 18:36:35 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:36:35 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:36:35 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:36:35 user nova-compute[74247]:       <entry name="serial">cbdb3c4c-7a6f-4966-bc13-049efe0cded2</entry>
Oct 16 18:36:35 user nova-compute[74247]:       <entry name="uuid">cbdb3c4c-7a6f-4966-bc13-049efe0cded2</entry>
Oct 16 18:36:35 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:36:35 user nova-compute[74247]:     </system>
Oct 16 18:36:35 user nova-compute[74247]:   </sysinfo>
Oct 16 18:36:35 user nova-compute[74247]:   <os>
Oct 16 18:36:35 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:36:35 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:36:35 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:36:35 user nova-compute[74247]:   </os>
Oct 16 18:36:35 user nova-compute[74247]:   <features>
Oct 16 18:36:35 user nova-compute[74247]:     <acpi/>
Oct 16 18:36:35 user nova-compute[74247]:     <apic/>
Oct 16 18:36:35 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:36:35 user nova-compute[74247]:   </features>
Oct 16 18:36:35 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:36:35 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:36:35 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:36:35 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:36:35 user nova-compute[74247]:   </clock>
Oct 16 18:36:35 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:36:35 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:36:35 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:36:35 user nova-compute[74247]:   </cpu>
Oct 16 18:36:35 user nova-compute[74247]:   <devices>
Oct 16 18:36:35 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:36:35 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:36:35 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/cbdb3c4c-7a6f-4966-bc13-049efe0cded2/disk"/>
Oct 16 18:36:35 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:36:35 user nova-compute[74247]:     </disk>
Oct 16 18:36:35 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:36:35 user nova-compute[74247]:       <mac address="fa:16:3e:61:36:9f"/>
Oct 16 18:36:35 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:36:35 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:36:35 user nova-compute[74247]:       <target dev="tap867368eb-89"/>
Oct 16 18:36:35 user nova-compute[74247]:     </interface>
Oct 16 18:36:35 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:36:35 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/cbdb3c4c-7a6f-4966-bc13-049efe0cded2/console.log" append="off"/>
Oct 16 18:36:35 user nova-compute[74247]:     </serial>
Oct 16 18:36:35 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:36:35 user nova-compute[74247]:     <video>
Oct 16 18:36:35 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:36:35 user nova-compute[74247]:     </video>
Oct 16 18:36:35 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:36:35 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:36:35 user nova-compute[74247]:     </rng>
Oct 16 18:36:35 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:36:35 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:36:35 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:36:35 user nova-compute[74247]:     </memballoon>
Oct 16 18:36:35 user nova-compute[74247]:   </devices>
Oct 16 18:36:35 user nova-compute[74247]: </domain>
Oct 16 18:36:35 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:36:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-803649508',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-803649508',id=25,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPt8RnxxjMin5ow9n0gYco5PnH7fBvzjVT+zJBAuIfIL73SFyQOt4/yFyMr89xqJ/fI+kazkxk5AA5YPdknlG4FiNoYepFgnFcnJNQU4P+bwfVCqmJXmT/tM+RcLA45aFQ==',key_name='tempest-keypair-1823297427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5204c1aec5764c298a206429645eb268',ramdisk_id='',reservation_id='r-cnkbq1wz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-537076068',owner_user_name='tempest-AttachVolumeShelveTestJSON-537076068-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:36:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bda4c43b45347be96b152caba47b07d',uuid=cbdb3c4c-7a6f-4966-bc13-049efe0cded2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "867368eb-89d8-4de5-a8cd-9a1435b624fb", "address": "fa:16:3e:61:36:9f", "network": {"id": "88a1b265-5360-4362-90bc-3506f805688f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-620663417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5204c1aec5764c298a206429645eb268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867368eb-89", "ovs_interfaceid": "867368eb-89d8-4de5-a8cd-9a1435b624fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Converting VIF {"id": "867368eb-89d8-4de5-a8cd-9a1435b624fb", "address": "fa:16:3e:61:36:9f", "network": {"id": "88a1b265-5360-4362-90bc-3506f805688f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-620663417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5204c1aec5764c298a206429645eb268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867368eb-89", "ovs_interfaceid": "867368eb-89d8-4de5-a8cd-9a1435b624fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:36:9f,bridge_name='br-int',has_traffic_filtering=True,id=867368eb-89d8-4de5-a8cd-9a1435b624fb,network=Network(88a1b265-5360-4362-90bc-3506f805688f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867368eb-89') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG os_vif [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:36:9f,bridge_name='br-int',has_traffic_filtering=True,id=867368eb-89d8-4de5-a8cd-9a1435b624fb,network=Network(88a1b265-5360-4362-90bc-3506f805688f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867368eb-89') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6e2a5c44-a606-51e5-aa97-7447108fe7dd', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap867368eb-89, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap867368eb-89, col_values=(('qos', UUID('d0b79a48-75e9-4bfe-86a1-e1b1ae988bd5')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap867368eb-89, col_values=(('external_ids', {'iface-id': '867368eb-89d8-4de5-a8cd-9a1435b624fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:36:9f', 'vm-uuid': 'cbdb3c4c-7a6f-4966-bc13-049efe0cded2'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:35 user nova-compute[74247]: INFO os_vif [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:36:9f,bridge_name='br-int',has_traffic_filtering=True,id=867368eb-89d8-4de5-a8cd-9a1435b624fb,network=Network(88a1b265-5360-4362-90bc-3506f805688f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867368eb-89')
Oct 16 18:36:35 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:36:35 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] No VIF found with MAC fa:16:3e:61:36:9f, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:36:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:37 user nova-compute[74247]: DEBUG nova.compute.manager [req-5f34b14e-a256-4eef-a9e5-7483765a9c32 req-1219c131-6126-494c-91dc-763cc33cf3be service nova] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Received event network-vif-plugged-867368eb-89d8-4de5-a8cd-9a1435b624fb {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:36:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-5f34b14e-a256-4eef-a9e5-7483765a9c32 req-1219c131-6126-494c-91dc-763cc33cf3be service nova] Acquiring lock "cbdb3c4c-7a6f-4966-bc13-049efe0cded2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:36:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-5f34b14e-a256-4eef-a9e5-7483765a9c32 req-1219c131-6126-494c-91dc-763cc33cf3be service nova] Lock "cbdb3c4c-7a6f-4966-bc13-049efe0cded2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:36:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-5f34b14e-a256-4eef-a9e5-7483765a9c32 req-1219c131-6126-494c-91dc-763cc33cf3be service nova] Lock "cbdb3c4c-7a6f-4966-bc13-049efe0cded2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:36:37 user nova-compute[74247]: DEBUG nova.compute.manager [req-5f34b14e-a256-4eef-a9e5-7483765a9c32 req-1219c131-6126-494c-91dc-763cc33cf3be service nova] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] No waiting events found dispatching network-vif-plugged-867368eb-89d8-4de5-a8cd-9a1435b624fb {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:36:37 user nova-compute[74247]: WARNING nova.compute.manager [req-5f34b14e-a256-4eef-a9e5-7483765a9c32 req-1219c131-6126-494c-91dc-763cc33cf3be service nova] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Received unexpected event network-vif-plugged-867368eb-89d8-4de5-a8cd-9a1435b624fb for instance with vm_state building and task_state spawning.
Oct 16 18:36:37 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:37 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:37 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:39 user nova-compute[74247]: DEBUG nova.compute.manager [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:36:39 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:36:39 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Instance spawned successfully.
Oct 16 18:36:39 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 18:36:39 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:36:39 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:36:39 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:36:39 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:36:39 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:36:39 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:36:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:39 user nova-compute[74247]: DEBUG nova.compute.manager [req-4b232054-52e1-439c-a0cc-adb3a8a5c8a2 req-3ffc35d9-64f6-4ace-8910-632c238e8a12 service nova] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Received event network-vif-plugged-867368eb-89d8-4de5-a8cd-9a1435b624fb {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:36:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4b232054-52e1-439c-a0cc-adb3a8a5c8a2 req-3ffc35d9-64f6-4ace-8910-632c238e8a12 service nova] Acquiring lock "cbdb3c4c-7a6f-4966-bc13-049efe0cded2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:36:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4b232054-52e1-439c-a0cc-adb3a8a5c8a2 req-3ffc35d9-64f6-4ace-8910-632c238e8a12 service nova] Lock "cbdb3c4c-7a6f-4966-bc13-049efe0cded2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:36:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4b232054-52e1-439c-a0cc-adb3a8a5c8a2 req-3ffc35d9-64f6-4ace-8910-632c238e8a12 service nova] Lock "cbdb3c4c-7a6f-4966-bc13-049efe0cded2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:36:39 user nova-compute[74247]: DEBUG nova.compute.manager [req-4b232054-52e1-439c-a0cc-adb3a8a5c8a2 req-3ffc35d9-64f6-4ace-8910-632c238e8a12 service nova] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] No waiting events found dispatching network-vif-plugged-867368eb-89d8-4de5-a8cd-9a1435b624fb {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:36:39 user nova-compute[74247]: WARNING nova.compute.manager [req-4b232054-52e1-439c-a0cc-adb3a8a5c8a2 req-3ffc35d9-64f6-4ace-8910-632c238e8a12 service nova] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Received unexpected event network-vif-plugged-867368eb-89d8-4de5-a8cd-9a1435b624fb for instance with vm_state building and task_state spawning.
Oct 16 18:36:39 user nova-compute[74247]: INFO nova.compute.manager [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Took 5.63 seconds to spawn the instance on the hypervisor.
Oct 16 18:36:39 user nova-compute[74247]: DEBUG nova.compute.manager [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:36:39 user nova-compute[74247]: INFO nova.compute.manager [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Took 6.33 seconds to build instance.
Oct 16 18:36:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c1ef8648-0a53-409e-aa8e-322f26c8cc32 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "cbdb3c4c-7a6f-4966-bc13-049efe0cded2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.437s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:36:40 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:40 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:46 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Acquiring lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:36:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:36:51 user nova-compute[74247]: DEBUG nova.compute.manager [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 18:36:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:36:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:36:52 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:36:52 user nova-compute[74247]: INFO nova.compute.claims [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Claim successful on node user
Oct 16 18:36:52 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:36:52 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:36:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.710s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:36:52 user nova-compute[74247]: DEBUG nova.compute.manager [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 18:36:52 user nova-compute[74247]: DEBUG nova.compute.manager [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 18:36:52 user nova-compute[74247]: DEBUG nova.network.neutron [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 18:36:52 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 18:36:52 user nova-compute[74247]: DEBUG nova.compute.manager [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 18:36:53 user nova-compute[74247]: DEBUG nova.compute.manager [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 18:36:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:36:53 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Creating image(s)
Oct 16 18:36:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Acquiring lock "/opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:36:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "/opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:36:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "/opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:36:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:36:53 user nova-compute[74247]: DEBUG nova.policy [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aeea855e8c84444cbc34ccc923e302cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2f559ca43548d7ab27cdf82968c3c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 18:36:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.185s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:36:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Acquiring lock "37399febbd18f60b85fd0f833558f6a3539ab231" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:36:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:36:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:36:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.170s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:36:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk 1073741824 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:36:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk 1073741824" returned: 0 in 0.052s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:36:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:36:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:36:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.179s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:36:53 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk. size=1073741824 {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 18:36:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:36:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:36:53 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Cannot resize image /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk to a smaller size. {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 18:36:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 18:36:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Ensure instance console log exists: /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:36:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:36:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:36:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:36:54 user nova-compute[74247]: DEBUG nova.network.neutron [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Successfully created port: 15e062f0-b415-4b0d-abe3-eb3f3fb38761 {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:36:54 user nova-compute[74247]: DEBUG nova.network.neutron [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Successfully updated port: 15e062f0-b415-4b0d-abe3-eb3f3fb38761 {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:36:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Acquiring lock "refresh_cache-2589b875-41d7-4d8e-9b35-8840dd5d3ac2" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:36:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Acquired lock "refresh_cache-2589b875-41d7-4d8e-9b35-8840dd5d3ac2" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:36:54 user nova-compute[74247]: DEBUG nova.network.neutron [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:36:54 user nova-compute[74247]: DEBUG nova.compute.manager [req-3f7608c1-7411-4650-b8df-5ae8ec27c367 req-56d4e24c-6cdd-4802-b1a5-35037f13c019 service nova] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Received event network-changed-15e062f0-b415-4b0d-abe3-eb3f3fb38761 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:36:54 user nova-compute[74247]: DEBUG nova.compute.manager [req-3f7608c1-7411-4650-b8df-5ae8ec27c367 req-56d4e24c-6cdd-4802-b1a5-35037f13c019 service nova] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Refreshing instance network info cache due to event network-changed-15e062f0-b415-4b0d-abe3-eb3f3fb38761. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:36:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3f7608c1-7411-4650-b8df-5ae8ec27c367 req-56d4e24c-6cdd-4802-b1a5-35037f13c019 service nova] Acquiring lock "refresh_cache-2589b875-41d7-4d8e-9b35-8840dd5d3ac2" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:36:54 user nova-compute[74247]: DEBUG nova.network.neutron [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1680ebe8-c737-4dcb-974e-83c89c05ae3e tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "d6367b6d-1bc2-4472-b0c4-07baec4a28b0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1680ebe8-c737-4dcb-974e-83c89c05ae3e tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "d6367b6d-1bc2-4472-b0c4-07baec4a28b0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1680ebe8-c737-4dcb-974e-83c89c05ae3e tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "d6367b6d-1bc2-4472-b0c4-07baec4a28b0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1680ebe8-c737-4dcb-974e-83c89c05ae3e tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "d6367b6d-1bc2-4472-b0c4-07baec4a28b0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1680ebe8-c737-4dcb-974e-83c89c05ae3e tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "d6367b6d-1bc2-4472-b0c4-07baec4a28b0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:36:55 user nova-compute[74247]: INFO nova.compute.manager [None req-1680ebe8-c737-4dcb-974e-83c89c05ae3e tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Terminating instance
Oct 16 18:36:55 user nova-compute[74247]: DEBUG nova.compute.manager [None req-1680ebe8-c737-4dcb-974e-83c89c05ae3e tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG nova.network.neutron [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Updating instance_info_cache with network_info: [{"id": "15e062f0-b415-4b0d-abe3-eb3f3fb38761", "address": "fa:16:3e:d7:26:52", "network": {"id": "c2bd79d9-3793-4e55-b351-f6c16468a347", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2030561886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2f559ca43548d7ab27cdf82968c3c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e062f0-b4", "ovs_interfaceid": "15e062f0-b415-4b0d-abe3-eb3f3fb38761", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Releasing lock "refresh_cache-2589b875-41d7-4d8e-9b35-8840dd5d3ac2" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG nova.compute.manager [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Instance network_info: |[{"id": "15e062f0-b415-4b0d-abe3-eb3f3fb38761", "address": "fa:16:3e:d7:26:52", "network": {"id": "c2bd79d9-3793-4e55-b351-f6c16468a347", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2030561886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2f559ca43548d7ab27cdf82968c3c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e062f0-b4", "ovs_interfaceid": "15e062f0-b415-4b0d-abe3-eb3f3fb38761", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3f7608c1-7411-4650-b8df-5ae8ec27c367 req-56d4e24c-6cdd-4802-b1a5-35037f13c019 service nova] Acquired lock "refresh_cache-2589b875-41d7-4d8e-9b35-8840dd5d3ac2" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG nova.network.neutron [req-3f7608c1-7411-4650-b8df-5ae8ec27c367 req-56d4e24c-6cdd-4802-b1a5-35037f13c019 service nova] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Refreshing network info cache for port 15e062f0-b415-4b0d-abe3-eb3f3fb38761 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Start _get_guest_xml network_info=[{"id": "15e062f0-b415-4b0d-abe3-eb3f3fb38761", "address": "fa:16:3e:d7:26:52", "network": {"id": "c2bd79d9-3793-4e55-b351-f6c16468a347", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2030561886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2f559ca43548d7ab27cdf82968c3c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e062f0-b4", "ovs_interfaceid": "15e062f0-b415-4b0d-abe3-eb3f3fb38761", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': '83126bb1-29f5-42fe-8620-72ab0797f776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:55 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:36:55 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:36:55 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:36:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-732861081',display_name='tempest-SnapshotDataIntegrityTests-server-732861081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-732861081',id=26,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMa0J6Xvc30sq6v+q+USS4nkXLAdQPG3ZqpJz7++E93jwv74NIw1TYdlR8Ic0KHDEEaJpE6tCZskyKJhqU78bh30XGc4aDayCmYEWDZKG78BkK+EPQEzxnCUo2dhRNMmwA==',key_name='tempest-keypair-441281210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd2f559ca43548d7ab27cdf82968c3c9',ramdisk_id='',reservation_id='r-0xqse43y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-731547854',owner_user_name='tempest-SnapshotDataIntegrityTests-731547854-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:36:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeea855e8c84444cbc34ccc923e302cf',uuid=2589b875-41d7-4d8e-9b35-8840dd5d3ac2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15e062f0-b415-4b0d-abe3-eb3f3fb38761", "address": "fa:16:3e:d7:26:52", "network": {"id": "c2bd79d9-3793-4e55-b351-f6c16468a347", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2030561886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2f559ca43548d7ab27cdf82968c3c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e062f0-b4", "ovs_interfaceid": "15e062f0-b415-4b0d-abe3-eb3f3fb38761", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Converting VIF {"id": "15e062f0-b415-4b0d-abe3-eb3f3fb38761", "address": "fa:16:3e:d7:26:52", "network": {"id": "c2bd79d9-3793-4e55-b351-f6c16468a347", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2030561886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2f559ca43548d7ab27cdf82968c3c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e062f0-b4", "ovs_interfaceid": "15e062f0-b415-4b0d-abe3-eb3f3fb38761", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:26:52,bridge_name='br-int',has_traffic_filtering=True,id=15e062f0-b415-4b0d-abe3-eb3f3fb38761,network=Network(c2bd79d9-3793-4e55-b351-f6c16468a347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e062f0-b4') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG nova.objects.instance [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lazy-loading 'pci_devices' on Instance uuid 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:36:55 user nova-compute[74247]:   <uuid>2589b875-41d7-4d8e-9b35-8840dd5d3ac2</uuid>
Oct 16 18:36:55 user nova-compute[74247]:   <name>instance-0000001a</name>
Oct 16 18:36:55 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:36:55 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:36:55 user nova-compute[74247]:   <metadata>
Oct 16 18:36:55 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:36:55 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:36:55 user nova-compute[74247]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-732861081</nova:name>
Oct 16 18:36:55 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:36:55</nova:creationTime>
Oct 16 18:36:55 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:36:55 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:36:55 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:36:55 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:36:55 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:36:55 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:36:55 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:36:55 user nova-compute[74247]:       <nova:owner>
Oct 16 18:36:55 user nova-compute[74247]:         <nova:user uuid="aeea855e8c84444cbc34ccc923e302cf">tempest-SnapshotDataIntegrityTests-731547854-project-member</nova:user>
Oct 16 18:36:55 user nova-compute[74247]:         <nova:project uuid="fd2f559ca43548d7ab27cdf82968c3c9">tempest-SnapshotDataIntegrityTests-731547854</nova:project>
Oct 16 18:36:55 user nova-compute[74247]:       </nova:owner>
Oct 16 18:36:55 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:36:55 user nova-compute[74247]:       <nova:ports>
Oct 16 18:36:55 user nova-compute[74247]:         <nova:port uuid="15e062f0-b415-4b0d-abe3-eb3f3fb38761">
Oct 16 18:36:55 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 16 18:36:55 user nova-compute[74247]:         </nova:port>
Oct 16 18:36:55 user nova-compute[74247]:       </nova:ports>
Oct 16 18:36:55 user nova-compute[74247]:     </nova:instance>
Oct 16 18:36:55 user nova-compute[74247]:   </metadata>
Oct 16 18:36:55 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:36:55 user nova-compute[74247]:     <system>
Oct 16 18:36:55 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:36:55 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:36:55 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:36:55 user nova-compute[74247]:       <entry name="serial">2589b875-41d7-4d8e-9b35-8840dd5d3ac2</entry>
Oct 16 18:36:55 user nova-compute[74247]:       <entry name="uuid">2589b875-41d7-4d8e-9b35-8840dd5d3ac2</entry>
Oct 16 18:36:55 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:36:55 user nova-compute[74247]:     </system>
Oct 16 18:36:55 user nova-compute[74247]:   </sysinfo>
Oct 16 18:36:55 user nova-compute[74247]:   <os>
Oct 16 18:36:55 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:36:55 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:36:55 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:36:55 user nova-compute[74247]:   </os>
Oct 16 18:36:55 user nova-compute[74247]:   <features>
Oct 16 18:36:55 user nova-compute[74247]:     <acpi/>
Oct 16 18:36:55 user nova-compute[74247]:     <apic/>
Oct 16 18:36:55 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:36:55 user nova-compute[74247]:   </features>
Oct 16 18:36:55 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:36:55 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:36:55 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:36:55 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:36:55 user nova-compute[74247]:   </clock>
Oct 16 18:36:55 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:36:55 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:36:55 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:36:55 user nova-compute[74247]:   </cpu>
Oct 16 18:36:55 user nova-compute[74247]:   <devices>
Oct 16 18:36:55 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:36:55 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:36:55 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk"/>
Oct 16 18:36:55 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:36:55 user nova-compute[74247]:     </disk>
Oct 16 18:36:55 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:36:55 user nova-compute[74247]:       <mac address="fa:16:3e:d7:26:52"/>
Oct 16 18:36:55 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:36:55 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:36:55 user nova-compute[74247]:       <target dev="tap15e062f0-b4"/>
Oct 16 18:36:55 user nova-compute[74247]:     </interface>
Oct 16 18:36:55 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:36:55 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/console.log" append="off"/>
Oct 16 18:36:55 user nova-compute[74247]:     </serial>
Oct 16 18:36:55 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:36:55 user nova-compute[74247]:     <video>
Oct 16 18:36:55 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:36:55 user nova-compute[74247]:     </video>
Oct 16 18:36:55 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:36:55 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:36:55 user nova-compute[74247]:     </rng>
Oct 16 18:36:55 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:36:55 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:36:55 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:36:55 user nova-compute[74247]:     </memballoon>
Oct 16 18:36:55 user nova-compute[74247]:   </devices>
Oct 16 18:36:55 user nova-compute[74247]: </domain>
Oct 16 18:36:55 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:36:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-732861081',display_name='tempest-SnapshotDataIntegrityTests-server-732861081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-732861081',id=26,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMa0J6Xvc30sq6v+q+USS4nkXLAdQPG3ZqpJz7++E93jwv74NIw1TYdlR8Ic0KHDEEaJpE6tCZskyKJhqU78bh30XGc4aDayCmYEWDZKG78BkK+EPQEzxnCUo2dhRNMmwA==',key_name='tempest-keypair-441281210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd2f559ca43548d7ab27cdf82968c3c9',ramdisk_id='',reservation_id='r-0xqse43y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-731547854',owner_user_name='tempest-SnapshotDataIntegrityTests-731547854-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:36:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeea855e8c84444cbc34ccc923e302cf',uuid=2589b875-41d7-4d8e-9b35-8840dd5d3ac2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15e062f0-b415-4b0d-abe3-eb3f3fb38761", "address": "fa:16:3e:d7:26:52", "network": {"id": "c2bd79d9-3793-4e55-b351-f6c16468a347", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2030561886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2f559ca43548d7ab27cdf82968c3c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e062f0-b4", "ovs_interfaceid": "15e062f0-b415-4b0d-abe3-eb3f3fb38761", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Converting VIF {"id": "15e062f0-b415-4b0d-abe3-eb3f3fb38761", "address": "fa:16:3e:d7:26:52", "network": {"id": "c2bd79d9-3793-4e55-b351-f6c16468a347", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2030561886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2f559ca43548d7ab27cdf82968c3c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e062f0-b4", "ovs_interfaceid": "15e062f0-b415-4b0d-abe3-eb3f3fb38761", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:26:52,bridge_name='br-int',has_traffic_filtering=True,id=15e062f0-b415-4b0d-abe3-eb3f3fb38761,network=Network(c2bd79d9-3793-4e55-b351-f6c16468a347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e062f0-b4') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG os_vif [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:26:52,bridge_name='br-int',has_traffic_filtering=True,id=15e062f0-b415-4b0d-abe3-eb3f3fb38761,network=Network(c2bd79d9-3793-4e55-b351-f6c16468a347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e062f0-b4') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd5aefe78-656a-56b7-b488-a7226cee5c52', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15e062f0-b4, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap15e062f0-b4, col_values=(('qos', UUID('e326377f-552b-428c-ba58-0af616d2367a')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap15e062f0-b4, col_values=(('external_ids', {'iface-id': '15e062f0-b415-4b0d-abe3-eb3f3fb38761', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:26:52', 'vm-uuid': '2589b875-41d7-4d8e-9b35-8840dd5d3ac2'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:55 user nova-compute[74247]: INFO os_vif [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:26:52,bridge_name='br-int',has_traffic_filtering=True,id=15e062f0-b415-4b0d-abe3-eb3f3fb38761,network=Network(c2bd79d9-3793-4e55-b351-f6c16468a347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e062f0-b4')
Oct 16 18:36:55 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] No VIF found with MAC fa:16:3e:d7:26:52, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG nova.network.neutron [req-3f7608c1-7411-4650-b8df-5ae8ec27c367 req-56d4e24c-6cdd-4802-b1a5-35037f13c019 service nova] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Updated VIF entry in instance network info cache for port 15e062f0-b415-4b0d-abe3-eb3f3fb38761. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG nova.network.neutron [req-3f7608c1-7411-4650-b8df-5ae8ec27c367 req-56d4e24c-6cdd-4802-b1a5-35037f13c019 service nova] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Updating instance_info_cache with network_info: [{"id": "15e062f0-b415-4b0d-abe3-eb3f3fb38761", "address": "fa:16:3e:d7:26:52", "network": {"id": "c2bd79d9-3793-4e55-b351-f6c16468a347", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2030561886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2f559ca43548d7ab27cdf82968c3c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e062f0-b4", "ovs_interfaceid": "15e062f0-b415-4b0d-abe3-eb3f3fb38761", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:36:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3f7608c1-7411-4650-b8df-5ae8ec27c367 req-56d4e24c-6cdd-4802-b1a5-35037f13c019 service nova] Releasing lock "refresh_cache-2589b875-41d7-4d8e-9b35-8840dd5d3ac2" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:36:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:56 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Instance destroyed successfully.
Oct 16 18:36:56 user nova-compute[74247]: DEBUG nova.objects.instance [None req-1680ebe8-c737-4dcb-974e-83c89c05ae3e tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lazy-loading 'resources' on Instance uuid d6367b6d-1bc2-4472-b0c4-07baec4a28b0 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:36:56 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-1680ebe8-c737-4dcb-974e-83c89c05ae3e tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:31:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-780524516',display_name='tempest-AttachVolumeNegativeTest-server-780524516',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-780524516',id=18,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcJzJ4m4jJd+lqljax9w+rFGLRh6QlObdC1juC+X3B+S0d5hXVOIROpvDPn+wvwKnx30ZVTJB9AbEHI+k71bTneJQ2yLIrDDYQVw8nRXIfSWVAgHdridjdyx2XdcCh34Q==',key_name='tempest-keypair-1204285490',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:31:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c96ced9d4c0c474fbc7edeed6f73324a',ramdisk_id='',reservation_id='r-h13wezrn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1731725928',owner_user_name='tempest-AttachVolumeNegativeTest-1731725928-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:31:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bd70613da1f489f86227655ff364795',uuid=d6367b6d-1bc2-4472-b0c4-07baec4a28b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c53d6d53-a35d-4efe-bdf2-021991dd4187", "address": "fa:16:3e:8d:4e:52", "network": {"id": "fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1988491128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96ced9d4c0c474fbc7edeed6f73324a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53d6d53-a3", "ovs_interfaceid": "c53d6d53-a35d-4efe-bdf2-021991dd4187", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:36:56 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-1680ebe8-c737-4dcb-974e-83c89c05ae3e tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Converting VIF {"id": "c53d6d53-a35d-4efe-bdf2-021991dd4187", "address": "fa:16:3e:8d:4e:52", "network": {"id": "fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1988491128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96ced9d4c0c474fbc7edeed6f73324a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53d6d53-a3", "ovs_interfaceid": "c53d6d53-a35d-4efe-bdf2-021991dd4187", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:36:56 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-1680ebe8-c737-4dcb-974e-83c89c05ae3e tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:4e:52,bridge_name='br-int',has_traffic_filtering=True,id=c53d6d53-a35d-4efe-bdf2-021991dd4187,network=Network(fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc53d6d53-a3') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:36:56 user nova-compute[74247]: DEBUG os_vif [None req-1680ebe8-c737-4dcb-974e-83c89c05ae3e tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:4e:52,bridge_name='br-int',has_traffic_filtering=True,id=c53d6d53-a35d-4efe-bdf2-021991dd4187,network=Network(fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc53d6d53-a3') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:36:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc53d6d53-a3, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:36:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:36:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=743c928f-8663-47b2-a354-201c829f3b8b) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:36:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:36:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:56 user nova-compute[74247]: INFO os_vif [None req-1680ebe8-c737-4dcb-974e-83c89c05ae3e tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:4e:52,bridge_name='br-int',has_traffic_filtering=True,id=c53d6d53-a35d-4efe-bdf2-021991dd4187,network=Network(fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc53d6d53-a3')
Oct 16 18:36:56 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-1680ebe8-c737-4dcb-974e-83c89c05ae3e tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Deleting instance files /opt/stack/data/nova/instances/d6367b6d-1bc2-4472-b0c4-07baec4a28b0_del
Oct 16 18:36:56 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-1680ebe8-c737-4dcb-974e-83c89c05ae3e tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Deletion of /opt/stack/data/nova/instances/d6367b6d-1bc2-4472-b0c4-07baec4a28b0_del complete
Oct 16 18:36:56 user nova-compute[74247]: INFO nova.compute.manager [None req-1680ebe8-c737-4dcb-974e-83c89c05ae3e tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Took 1.44 seconds to destroy the instance on the hypervisor.
Oct 16 18:36:56 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-1680ebe8-c737-4dcb-974e-83c89c05ae3e tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 18:36:56 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 18:36:56 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 18:36:56 user nova-compute[74247]: DEBUG nova.compute.manager [req-770a5fd7-d87b-435f-aee2-65ba2d551256 req-e875ecc6-45da-4879-bc18-69936f2b9b25 service nova] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Received event network-vif-unplugged-c53d6d53-a35d-4efe-bdf2-021991dd4187 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:36:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-770a5fd7-d87b-435f-aee2-65ba2d551256 req-e875ecc6-45da-4879-bc18-69936f2b9b25 service nova] Acquiring lock "d6367b6d-1bc2-4472-b0c4-07baec4a28b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:36:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-770a5fd7-d87b-435f-aee2-65ba2d551256 req-e875ecc6-45da-4879-bc18-69936f2b9b25 service nova] Lock "d6367b6d-1bc2-4472-b0c4-07baec4a28b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:36:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-770a5fd7-d87b-435f-aee2-65ba2d551256 req-e875ecc6-45da-4879-bc18-69936f2b9b25 service nova] Lock "d6367b6d-1bc2-4472-b0c4-07baec4a28b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:36:56 user nova-compute[74247]: DEBUG nova.compute.manager [req-770a5fd7-d87b-435f-aee2-65ba2d551256 req-e875ecc6-45da-4879-bc18-69936f2b9b25 service nova] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] No waiting events found dispatching network-vif-unplugged-c53d6d53-a35d-4efe-bdf2-021991dd4187 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:36:56 user nova-compute[74247]: DEBUG nova.compute.manager [req-770a5fd7-d87b-435f-aee2-65ba2d551256 req-e875ecc6-45da-4879-bc18-69936f2b9b25 service nova] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Received event network-vif-unplugged-c53d6d53-a35d-4efe-bdf2-021991dd4187 for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:36:56 user nova-compute[74247]: DEBUG nova.compute.manager [req-770a5fd7-d87b-435f-aee2-65ba2d551256 req-e875ecc6-45da-4879-bc18-69936f2b9b25 service nova] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Received event network-vif-plugged-c53d6d53-a35d-4efe-bdf2-021991dd4187 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:36:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-770a5fd7-d87b-435f-aee2-65ba2d551256 req-e875ecc6-45da-4879-bc18-69936f2b9b25 service nova] Acquiring lock "d6367b6d-1bc2-4472-b0c4-07baec4a28b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:36:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-770a5fd7-d87b-435f-aee2-65ba2d551256 req-e875ecc6-45da-4879-bc18-69936f2b9b25 service nova] Lock "d6367b6d-1bc2-4472-b0c4-07baec4a28b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:36:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-770a5fd7-d87b-435f-aee2-65ba2d551256 req-e875ecc6-45da-4879-bc18-69936f2b9b25 service nova] Lock "d6367b6d-1bc2-4472-b0c4-07baec4a28b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:36:56 user nova-compute[74247]: DEBUG nova.compute.manager [req-770a5fd7-d87b-435f-aee2-65ba2d551256 req-e875ecc6-45da-4879-bc18-69936f2b9b25 service nova] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] No waiting events found dispatching network-vif-plugged-c53d6d53-a35d-4efe-bdf2-021991dd4187 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:36:56 user nova-compute[74247]: WARNING nova.compute.manager [req-770a5fd7-d87b-435f-aee2-65ba2d551256 req-e875ecc6-45da-4879-bc18-69936f2b9b25 service nova] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Received unexpected event network-vif-plugged-c53d6d53-a35d-4efe-bdf2-021991dd4187 for instance with vm_state active and task_state deleting.
Oct 16 18:36:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:57 user nova-compute[74247]: DEBUG nova.compute.manager [req-253477b4-162d-4079-ac71-c1ede637bfd8 req-7da9dd81-a01e-4e39-a932-b9bcdbe4e62d service nova] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Received event network-vif-plugged-15e062f0-b415-4b0d-abe3-eb3f3fb38761 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:36:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-253477b4-162d-4079-ac71-c1ede637bfd8 req-7da9dd81-a01e-4e39-a932-b9bcdbe4e62d service nova] Acquiring lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:36:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-253477b4-162d-4079-ac71-c1ede637bfd8 req-7da9dd81-a01e-4e39-a932-b9bcdbe4e62d service nova] Lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:36:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-253477b4-162d-4079-ac71-c1ede637bfd8 req-7da9dd81-a01e-4e39-a932-b9bcdbe4e62d service nova] Lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:36:57 user nova-compute[74247]: DEBUG nova.compute.manager [req-253477b4-162d-4079-ac71-c1ede637bfd8 req-7da9dd81-a01e-4e39-a932-b9bcdbe4e62d service nova] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] No waiting events found dispatching network-vif-plugged-15e062f0-b415-4b0d-abe3-eb3f3fb38761 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:36:57 user nova-compute[74247]: WARNING nova.compute.manager [req-253477b4-162d-4079-ac71-c1ede637bfd8 req-7da9dd81-a01e-4e39-a932-b9bcdbe4e62d service nova] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Received unexpected event network-vif-plugged-15e062f0-b415-4b0d-abe3-eb3f3fb38761 for instance with vm_state building and task_state spawning.
Oct 16 18:36:57 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:36:57 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Took 0.96 seconds to deallocate network for instance.
Oct 16 18:36:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1680ebe8-c737-4dcb-974e-83c89c05ae3e tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:36:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1680ebe8-c737-4dcb-974e-83c89c05ae3e tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:36:57 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-1680ebe8-c737-4dcb-974e-83c89c05ae3e tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:36:57 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-1680ebe8-c737-4dcb-974e-83c89c05ae3e tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:36:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1680ebe8-c737-4dcb-974e-83c89c05ae3e tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.398s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:36:57 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-1680ebe8-c737-4dcb-974e-83c89c05ae3e tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Deleted allocations for instance d6367b6d-1bc2-4472-b0c4-07baec4a28b0
Oct 16 18:36:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:36:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1680ebe8-c737-4dcb-974e-83c89c05ae3e tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "d6367b6d-1bc2-4472-b0c4-07baec4a28b0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.103s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:36:58 user nova-compute[74247]: DEBUG nova.compute.manager [req-5cfabf55-3b28-476e-9e81-55b5ff4f5915 req-4ad31aff-fd10-46ec-a6a6-d4da757ee6ba service nova] [instance: d6367b6d-1bc2-4472-b0c4-07baec4a28b0] Received event network-vif-deleted-c53d6d53-a35d-4efe-bdf2-021991dd4187 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:36:59 user nova-compute[74247]: DEBUG nova.compute.manager [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:36:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:36:59 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Instance spawned successfully.
Oct 16 18:36:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 18:36:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:36:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:36:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:36:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:36:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:36:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:36:59 user nova-compute[74247]: INFO nova.compute.manager [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Took 6.32 seconds to spawn the instance on the hypervisor.
Oct 16 18:36:59 user nova-compute[74247]: DEBUG nova.compute.manager [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:36:59 user nova-compute[74247]: DEBUG nova.compute.manager [req-aeec8142-f73c-4564-b7e6-3aa5f3d5bdb8 req-65fcd680-7379-4573-a9ca-fc9fbaf6f77d service nova] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Received event network-vif-plugged-15e062f0-b415-4b0d-abe3-eb3f3fb38761 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:36:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-aeec8142-f73c-4564-b7e6-3aa5f3d5bdb8 req-65fcd680-7379-4573-a9ca-fc9fbaf6f77d service nova] Acquiring lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:36:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-aeec8142-f73c-4564-b7e6-3aa5f3d5bdb8 req-65fcd680-7379-4573-a9ca-fc9fbaf6f77d service nova] Lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:36:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-aeec8142-f73c-4564-b7e6-3aa5f3d5bdb8 req-65fcd680-7379-4573-a9ca-fc9fbaf6f77d service nova] Lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:36:59 user nova-compute[74247]: DEBUG nova.compute.manager [req-aeec8142-f73c-4564-b7e6-3aa5f3d5bdb8 req-65fcd680-7379-4573-a9ca-fc9fbaf6f77d service nova] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] No waiting events found dispatching network-vif-plugged-15e062f0-b415-4b0d-abe3-eb3f3fb38761 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:36:59 user nova-compute[74247]: WARNING nova.compute.manager [req-aeec8142-f73c-4564-b7e6-3aa5f3d5bdb8 req-65fcd680-7379-4573-a9ca-fc9fbaf6f77d service nova] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Received unexpected event network-vif-plugged-15e062f0-b415-4b0d-abe3-eb3f3fb38761 for instance with vm_state building and task_state spawning.
Oct 16 18:36:59 user nova-compute[74247]: INFO nova.compute.manager [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Took 7.47 seconds to build instance.
Oct 16 18:36:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a34c45a1-7caa-4409-a44f-9cb52262773d tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.578s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:36:59 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:37:00 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:37:00 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:37:00 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:37:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "88ea9961-7a1d-4193-b72f-63e398752141" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:37:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "88ea9961-7a1d-4193-b72f-63e398752141" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:37:00 user nova-compute[74247]: DEBUG nova.compute.manager [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 18:37:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:37:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:37:01 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:37:01 user nova-compute[74247]: INFO nova.compute.claims [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Claim successful on node user
Oct 16 18:37:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:01 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:37:01 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:37:01 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 18:37:01 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:37:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.520s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:37:01 user nova-compute[74247]: DEBUG nova.compute.manager [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 18:37:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "refresh_cache-cddf4842-1c25-4cc8-914e-af30849e4d6c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:37:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquired lock "refresh_cache-cddf4842-1c25-4cc8-914e-af30849e4d6c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:37:01 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Forcefully refreshing network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 18:37:01 user nova-compute[74247]: DEBUG nova.compute.manager [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 18:37:01 user nova-compute[74247]: DEBUG nova.network.neutron [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 18:37:01 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 18:37:01 user nova-compute[74247]: DEBUG nova.compute.manager [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 18:37:01 user nova-compute[74247]: DEBUG nova.policy [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3635a30f06234f0d9a8e0604c25f1208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd3eb752f04fd48dfe0623fdf2fe9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 18:37:01 user nova-compute[74247]: INFO nova.virt.block_device [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Booting with volume 6fe688e0-e202-4c50-9a51-1fe480c399fa at /dev/vda
Oct 16 18:37:01 user nova-compute[74247]: DEBUG os_brick.utils [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:37:01 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:37:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:37:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3876da-d989-4639-8142-47ff78dcaf12]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:37:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:37:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:37:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5883612c-c0d7-4e1e-890a-59c667153901]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:37:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:37:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:37:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e35f60-09e3-4bce-b571-79275771b15c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:37:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ddbcca-e1c9-43ab-9dd4-6c222ed523b4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:37:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:37:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:37:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 18:37:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:37:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:37:02 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 18:37:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[babf7136-e29e-43bb-8758-afb1eebcc8f7]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:37:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 18:37:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 18:37:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 18:37:02 user nova-compute[74247]: DEBUG os_brick.utils [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] <== get_connector_properties: return (178ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:37:02 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Updating existing volume attachment record: 237af8f4-8074-42f3-8d76-3217d3b35582 {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 18:37:02 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Updating instance_info_cache with network_info: [{"id": "badc9f06-cef7-46bf-8b74-5d53401021f5", "address": "fa:16:3e:c8:ea:de", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbadc9f06-ce", "ovs_interfaceid": "badc9f06-cef7-46bf-8b74-5d53401021f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:37:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Releasing lock "refresh_cache-cddf4842-1c25-4cc8-914e-af30849e4d6c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:37:02 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Updated the network info_cache for instance {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 18:37:02 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:37:02 user nova-compute[74247]: DEBUG nova.network.neutron [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Successfully created port: f5845781-33be-4018-bc2c-72bb980ad8c8 {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:37:03 user nova-compute[74247]: DEBUG nova.network.neutron [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Successfully updated port: f5845781-33be-4018-bc2c-72bb980ad8c8 {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:37:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "refresh_cache-88ea9961-7a1d-4193-b72f-63e398752141" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:37:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquired lock "refresh_cache-88ea9961-7a1d-4193-b72f-63e398752141" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:37:03 user nova-compute[74247]: DEBUG nova.network.neutron [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:37:03 user nova-compute[74247]: DEBUG nova.compute.manager [req-75ec549b-4793-41e3-8bbb-6b136f9af55e req-636f95dc-9299-4a34-9798-38ca50b9d607 service nova] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Received event network-changed-f5845781-33be-4018-bc2c-72bb980ad8c8 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:37:03 user nova-compute[74247]: DEBUG nova.compute.manager [req-75ec549b-4793-41e3-8bbb-6b136f9af55e req-636f95dc-9299-4a34-9798-38ca50b9d607 service nova] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Refreshing instance network info cache due to event network-changed-f5845781-33be-4018-bc2c-72bb980ad8c8. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:37:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-75ec549b-4793-41e3-8bbb-6b136f9af55e req-636f95dc-9299-4a34-9798-38ca50b9d607 service nova] Acquiring lock "refresh_cache-88ea9961-7a1d-4193-b72f-63e398752141" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:37:03 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:37:03 user nova-compute[74247]: DEBUG nova.network.neutron [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:37:04 user nova-compute[74247]: DEBUG nova.network.neutron [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Updating instance_info_cache with network_info: [{"id": "f5845781-33be-4018-bc2c-72bb980ad8c8", "address": "fa:16:3e:92:70:e9", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5845781-33", "ovs_interfaceid": "f5845781-33be-4018-bc2c-72bb980ad8c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:37:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Releasing lock "refresh_cache-88ea9961-7a1d-4193-b72f-63e398752141" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:37:04 user nova-compute[74247]: DEBUG nova.compute.manager [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Instance network_info: |[{"id": "f5845781-33be-4018-bc2c-72bb980ad8c8", "address": "fa:16:3e:92:70:e9", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5845781-33", "ovs_interfaceid": "f5845781-33be-4018-bc2c-72bb980ad8c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 18:37:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-75ec549b-4793-41e3-8bbb-6b136f9af55e req-636f95dc-9299-4a34-9798-38ca50b9d607 service nova] Acquired lock "refresh_cache-88ea9961-7a1d-4193-b72f-63e398752141" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:37:04 user nova-compute[74247]: DEBUG nova.network.neutron [req-75ec549b-4793-41e3-8bbb-6b136f9af55e req-636f95dc-9299-4a34-9798-38ca50b9d607 service nova] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Refreshing network info cache for port f5845781-33be-4018-bc2c-72bb980ad8c8 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:37:04 user nova-compute[74247]: DEBUG nova.network.neutron [req-75ec549b-4793-41e3-8bbb-6b136f9af55e req-636f95dc-9299-4a34-9798-38ca50b9d607 service nova] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Updated VIF entry in instance network info cache for port f5845781-33be-4018-bc2c-72bb980ad8c8. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:37:04 user nova-compute[74247]: DEBUG nova.network.neutron [req-75ec549b-4793-41e3-8bbb-6b136f9af55e req-636f95dc-9299-4a34-9798-38ca50b9d607 service nova] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Updating instance_info_cache with network_info: [{"id": "f5845781-33be-4018-bc2c-72bb980ad8c8", "address": "fa:16:3e:92:70:e9", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5845781-33", "ovs_interfaceid": "f5845781-33be-4018-bc2c-72bb980ad8c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:37:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-75ec549b-4793-41e3-8bbb-6b136f9af55e req-636f95dc-9299-4a34-9798-38ca50b9d607 service nova] Releasing lock "refresh_cache-88ea9961-7a1d-4193-b72f-63e398752141" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:37:04 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:37:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:37:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:37:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:37:04 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 18:37:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:37:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:37:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:37:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:37:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb56c456-005d-4d2d-b163-7ab281ca11fb/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:37:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb56c456-005d-4d2d-b163-7ab281ca11fb/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:37:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb56c456-005d-4d2d-b163-7ab281ca11fb/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:37:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb56c456-005d-4d2d-b163-7ab281ca11fb/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:37:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:37:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json" returned: 0 in 0.227s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:37:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:37:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:37:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:37:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:37:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:37:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:37:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:37:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dcc08e9-7439-436b-8d9f-facaf04e22c1/disk.rescue --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:37:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dcc08e9-7439-436b-8d9f-facaf04e22c1/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:37:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dcc08e9-7439-436b-8d9f-facaf04e22c1/disk.rescue --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:37:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dcc08e9-7439-436b-8d9f-facaf04e22c1/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:37:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23e7124-676c-4b64-a77f-e9c7b46f0f18/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:37:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23e7124-676c-4b64-a77f-e9c7b46f0f18/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:37:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23e7124-676c-4b64-a77f-e9c7b46f0f18/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:37:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23e7124-676c-4b64-a77f-e9c7b46f0f18/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:37:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbdb3c4c-7a6f-4966-bc13-049efe0cded2/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:37:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbdb3c4c-7a6f-4966-bc13-049efe0cded2/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:37:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbdb3c4c-7a6f-4966-bc13-049efe0cded2/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:37:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbdb3c4c-7a6f-4966-bc13-049efe0cded2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:37:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:37:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:37:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:37:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:37:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:37:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:37:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:37:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:37:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:37:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:37:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:37:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:37:09 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:37:09 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:37:09 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=7671MB free_disk=25.064640045166016GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 18:37:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:37:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:37:09 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance e37fbc27-3404-479a-be08-4d590391cf30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:37:09 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance cddf4842-1c25-4cc8-914e-af30849e4d6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:37:09 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 958af87e-69d0-4da1-8fcf-90e0f275d62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:37:09 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance d775101d-53a1-48c7-af24-91480be6af61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:37:09 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 7dcc08e9-7439-436b-8d9f-facaf04e22c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:37:09 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance eb56c456-005d-4d2d-b163-7ab281ca11fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:37:09 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance e23e7124-676c-4b64-a77f-e9c7b46f0f18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:37:09 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance cbdb3c4c-7a6f-4966-bc13-049efe0cded2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:37:09 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:37:09 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 88ea9961-7a1d-4193-b72f-63e398752141 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:37:09 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 18:37:09 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 18:37:09 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:37:09 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:37:09 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 18:37:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.511s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:37:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:12 user nova-compute[74247]: INFO nova.compute.manager [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Rescuing
Oct 16 18:37:12 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquiring lock "refresh_cache-958af87e-69d0-4da1-8fcf-90e0f275d62e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:37:12 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquired lock "refresh_cache-958af87e-69d0-4da1-8fcf-90e0f275d62e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:37:12 user nova-compute[74247]: DEBUG nova.network.neutron [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:37:12 user nova-compute[74247]: DEBUG nova.network.neutron [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Updating instance_info_cache with network_info: [{"id": "4457ec1e-80ee-4038-9838-3af879097230", "address": "fa:16:3e:fb:7d:a8", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4457ec1e-80", "ovs_interfaceid": "4457ec1e-80ee-4038-9838-3af879097230", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:37:12 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Releasing lock "refresh_cache-958af87e-69d0-4da1-8fcf-90e0f275d62e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:37:12 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:12 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:12 user nova-compute[74247]: DEBUG nova.compute.manager [req-062e4768-9b42-4942-8cbc-618dc3410a1b req-e0d65451-4d3f-420b-8cb0-8a8550084f85 service nova] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Received event network-vif-unplugged-4457ec1e-80ee-4038-9838-3af879097230 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:37:12 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-062e4768-9b42-4942-8cbc-618dc3410a1b req-e0d65451-4d3f-420b-8cb0-8a8550084f85 service nova] Acquiring lock "958af87e-69d0-4da1-8fcf-90e0f275d62e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:37:12 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-062e4768-9b42-4942-8cbc-618dc3410a1b req-e0d65451-4d3f-420b-8cb0-8a8550084f85 service nova] Lock "958af87e-69d0-4da1-8fcf-90e0f275d62e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:37:12 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-062e4768-9b42-4942-8cbc-618dc3410a1b req-e0d65451-4d3f-420b-8cb0-8a8550084f85 service nova] Lock "958af87e-69d0-4da1-8fcf-90e0f275d62e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:37:12 user nova-compute[74247]: DEBUG nova.compute.manager [req-062e4768-9b42-4942-8cbc-618dc3410a1b req-e0d65451-4d3f-420b-8cb0-8a8550084f85 service nova] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] No waiting events found dispatching network-vif-unplugged-4457ec1e-80ee-4038-9838-3af879097230 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:37:12 user nova-compute[74247]: WARNING nova.compute.manager [req-062e4768-9b42-4942-8cbc-618dc3410a1b req-e0d65451-4d3f-420b-8cb0-8a8550084f85 service nova] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Received unexpected event network-vif-unplugged-4457ec1e-80ee-4038-9838-3af879097230 for instance with vm_state active and task_state rescuing.
Oct 16 18:37:12 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:13 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Instance destroyed successfully.
Oct 16 18:37:13 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Attempting rescue
Oct 16 18:37:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74247) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Instance directory exists: not creating {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 16 18:37:13 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Creating image(s)
Oct 16 18:37:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquiring lock "/opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "/opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "/opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG nova.objects.instance [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lazy-loading 'trusted_certs' on Instance uuid 958af87e-69d0-4da1-8fcf-90e0f275d62e {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquiring lock "37399febbd18f60b85fd0f833558f6a3539ab231" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.220s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk.rescue {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk.rescue" returned: 0 in 0.059s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG nova.objects.instance [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lazy-loading 'migration_context' on Instance uuid 958af87e-69d0-4da1-8fcf-90e0f275d62e {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG nova.objects.base [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Object Instance<958af87e-69d0-4da1-8fcf-90e0f275d62e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Start _get_guest_xml network_info=[{"id": "4457ec1e-80ee-4038-9838-3af879097230", "address": "fa:16:3e:fb:7d:a8", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "vif_mac": "fa:16:3e:fb:7d:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4457ec1e-80", "ovs_interfaceid": "4457ec1e-80ee-4038-9838-3af879097230", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '83126bb1-29f5-42fe-8620-72ab0797f776', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG nova.objects.instance [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lazy-loading 'resources' on Instance uuid 958af87e-69d0-4da1-8fcf-90e0f275d62e {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG nova.objects.base [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Object Instance<958af87e-69d0-4da1-8fcf-90e0f275d62e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG nova.objects.instance [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lazy-loading 'numa_topology' on Instance uuid 958af87e-69d0-4da1-8fcf-90e0f275d62e {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG nova.objects.base [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Object Instance<958af87e-69d0-4da1-8fcf-90e0f275d62e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:37:13 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:37:13 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:37:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG nova.objects.instance [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lazy-loading 'vcpu_model' on Instance uuid 958af87e-69d0-4da1-8fcf-90e0f275d62e {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG nova.objects.base [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Object Instance<958af87e-69d0-4da1-8fcf-90e0f275d62e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:32:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1308192945',display_name='tempest-ServerRescueNegativeTestJSON-server-1308192945',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1308192945',id=19,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:32:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16160dad45544c6e8d9758e883089822',ramdisk_id='',reservation_id='r-6ds0qsic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2007731322',owner_user_name='tempest-ServerRescueNegativeTestJSON-2007731322-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:32:32Z,user_data=None,user_id='51026968ba1f49eaa8e0cc27a81855db',uuid=958af87e-69d0-4da1-8fcf-90e0f275d62e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4457ec1e-80ee-4038-9838-3af879097230", "address": "fa:16:3e:fb:7d:a8", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "vif_mac": "fa:16:3e:fb:7d:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4457ec1e-80", "ovs_interfaceid": "4457ec1e-80ee-4038-9838-3af879097230", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Converting VIF {"id": "4457ec1e-80ee-4038-9838-3af879097230", "address": "fa:16:3e:fb:7d:a8", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "vif_mac": "fa:16:3e:fb:7d:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4457ec1e-80", "ovs_interfaceid": "4457ec1e-80ee-4038-9838-3af879097230", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:7d:a8,bridge_name='br-int',has_traffic_filtering=True,id=4457ec1e-80ee-4038-9838-3af879097230,network=Network(57ee1ccc-d7df-4a86-9234-c3c5f447e051),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4457ec1e-80') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG nova.objects.instance [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lazy-loading 'pci_devices' on Instance uuid 958af87e-69d0-4da1-8fcf-90e0f275d62e {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG nova.objects.base [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Object Instance<958af87e-69d0-4da1-8fcf-90e0f275d62e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:37:13 user nova-compute[74247]:   <uuid>958af87e-69d0-4da1-8fcf-90e0f275d62e</uuid>
Oct 16 18:37:13 user nova-compute[74247]:   <name>instance-00000013</name>
Oct 16 18:37:13 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:37:13 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:37:13 user nova-compute[74247]:   <metadata>
Oct 16 18:37:13 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:37:13 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:37:13 user nova-compute[74247]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1308192945</nova:name>
Oct 16 18:37:13 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:37:13</nova:creationTime>
Oct 16 18:37:13 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:37:13 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:37:13 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:37:13 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:37:13 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:37:13 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:37:13 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:37:13 user nova-compute[74247]:       <nova:owner>
Oct 16 18:37:13 user nova-compute[74247]:         <nova:user uuid="51026968ba1f49eaa8e0cc27a81855db">tempest-ServerRescueNegativeTestJSON-2007731322-project-member</nova:user>
Oct 16 18:37:13 user nova-compute[74247]:         <nova:project uuid="16160dad45544c6e8d9758e883089822">tempest-ServerRescueNegativeTestJSON-2007731322</nova:project>
Oct 16 18:37:13 user nova-compute[74247]:       </nova:owner>
Oct 16 18:37:13 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:37:13 user nova-compute[74247]:       <nova:ports>
Oct 16 18:37:13 user nova-compute[74247]:         <nova:port uuid="4457ec1e-80ee-4038-9838-3af879097230">
Oct 16 18:37:13 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 16 18:37:13 user nova-compute[74247]:         </nova:port>
Oct 16 18:37:13 user nova-compute[74247]:       </nova:ports>
Oct 16 18:37:13 user nova-compute[74247]:     </nova:instance>
Oct 16 18:37:13 user nova-compute[74247]:   </metadata>
Oct 16 18:37:13 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:37:13 user nova-compute[74247]:     <system>
Oct 16 18:37:13 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:37:13 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:37:13 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:37:13 user nova-compute[74247]:       <entry name="serial">958af87e-69d0-4da1-8fcf-90e0f275d62e</entry>
Oct 16 18:37:13 user nova-compute[74247]:       <entry name="uuid">958af87e-69d0-4da1-8fcf-90e0f275d62e</entry>
Oct 16 18:37:13 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:37:13 user nova-compute[74247]:     </system>
Oct 16 18:37:13 user nova-compute[74247]:   </sysinfo>
Oct 16 18:37:13 user nova-compute[74247]:   <os>
Oct 16 18:37:13 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:37:13 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:37:13 user nova-compute[74247]:   </os>
Oct 16 18:37:13 user nova-compute[74247]:   <features>
Oct 16 18:37:13 user nova-compute[74247]:     <acpi/>
Oct 16 18:37:13 user nova-compute[74247]:     <apic/>
Oct 16 18:37:13 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:37:13 user nova-compute[74247]:   </features>
Oct 16 18:37:13 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:37:13 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:37:13 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:37:13 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:37:13 user nova-compute[74247]:   </clock>
Oct 16 18:37:13 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:37:13 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:37:13 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:37:13 user nova-compute[74247]:   </cpu>
Oct 16 18:37:13 user nova-compute[74247]:   <devices>
Oct 16 18:37:13 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:37:13 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:37:13 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk.rescue"/>
Oct 16 18:37:13 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:37:13 user nova-compute[74247]:     </disk>
Oct 16 18:37:13 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:37:13 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:37:13 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk"/>
Oct 16 18:37:13 user nova-compute[74247]:       <target dev="vdb" bus="virtio"/>
Oct 16 18:37:13 user nova-compute[74247]:     </disk>
Oct 16 18:37:13 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:37:13 user nova-compute[74247]:       <mac address="fa:16:3e:fb:7d:a8"/>
Oct 16 18:37:13 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:37:13 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:37:13 user nova-compute[74247]:       <target dev="tap4457ec1e-80"/>
Oct 16 18:37:13 user nova-compute[74247]:     </interface>
Oct 16 18:37:13 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:37:13 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/console.log" append="off"/>
Oct 16 18:37:13 user nova-compute[74247]:     </serial>
Oct 16 18:37:13 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:37:13 user nova-compute[74247]:     <video>
Oct 16 18:37:13 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:37:13 user nova-compute[74247]:     </video>
Oct 16 18:37:13 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:37:13 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:37:13 user nova-compute[74247]:     </rng>
Oct 16 18:37:13 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:37:13 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:37:13 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:37:13 user nova-compute[74247]:     </memballoon>
Oct 16 18:37:13 user nova-compute[74247]:   </devices>
Oct 16 18:37:13 user nova-compute[74247]: </domain>
Oct 16 18:37:13 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:37:13 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Instance destroyed successfully.
Oct 16 18:37:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] No VIF found with MAC fa:16:3e:fb:7d:a8, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:37:13 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 18:37:15 user nova-compute[74247]: DEBUG nova.compute.manager [req-37fe12c1-c408-4484-b239-fd96d943c715 req-fd35115e-4260-47c0-be87-2cefdba49ee1 service nova] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Received event network-vif-plugged-4457ec1e-80ee-4038-9838-3af879097230 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:37:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-37fe12c1-c408-4484-b239-fd96d943c715 req-fd35115e-4260-47c0-be87-2cefdba49ee1 service nova] Acquiring lock "958af87e-69d0-4da1-8fcf-90e0f275d62e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:37:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-37fe12c1-c408-4484-b239-fd96d943c715 req-fd35115e-4260-47c0-be87-2cefdba49ee1 service nova] Lock "958af87e-69d0-4da1-8fcf-90e0f275d62e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:37:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-37fe12c1-c408-4484-b239-fd96d943c715 req-fd35115e-4260-47c0-be87-2cefdba49ee1 service nova] Lock "958af87e-69d0-4da1-8fcf-90e0f275d62e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:37:15 user nova-compute[74247]: DEBUG nova.compute.manager [req-37fe12c1-c408-4484-b239-fd96d943c715 req-fd35115e-4260-47c0-be87-2cefdba49ee1 service nova] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] No waiting events found dispatching network-vif-plugged-4457ec1e-80ee-4038-9838-3af879097230 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:37:15 user nova-compute[74247]: WARNING nova.compute.manager [req-37fe12c1-c408-4484-b239-fd96d943c715 req-fd35115e-4260-47c0-be87-2cefdba49ee1 service nova] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Received unexpected event network-vif-plugged-4457ec1e-80ee-4038-9838-3af879097230 for instance with vm_state active and task_state rescuing.
Oct 16 18:37:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:17 user nova-compute[74247]: DEBUG nova.compute.manager [req-abd0799f-7ea5-4b63-922d-2e87e929b4de req-a0c4fba1-4c16-46b9-8b43-6383e72368eb service nova] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Received event network-vif-plugged-4457ec1e-80ee-4038-9838-3af879097230 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:37:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-abd0799f-7ea5-4b63-922d-2e87e929b4de req-a0c4fba1-4c16-46b9-8b43-6383e72368eb service nova] Acquiring lock "958af87e-69d0-4da1-8fcf-90e0f275d62e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:37:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-abd0799f-7ea5-4b63-922d-2e87e929b4de req-a0c4fba1-4c16-46b9-8b43-6383e72368eb service nova] Lock "958af87e-69d0-4da1-8fcf-90e0f275d62e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:37:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-abd0799f-7ea5-4b63-922d-2e87e929b4de req-a0c4fba1-4c16-46b9-8b43-6383e72368eb service nova] Lock "958af87e-69d0-4da1-8fcf-90e0f275d62e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:37:17 user nova-compute[74247]: DEBUG nova.compute.manager [req-abd0799f-7ea5-4b63-922d-2e87e929b4de req-a0c4fba1-4c16-46b9-8b43-6383e72368eb service nova] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] No waiting events found dispatching network-vif-plugged-4457ec1e-80ee-4038-9838-3af879097230 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:37:17 user nova-compute[74247]: WARNING nova.compute.manager [req-abd0799f-7ea5-4b63-922d-2e87e929b4de req-a0c4fba1-4c16-46b9-8b43-6383e72368eb service nova] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Received unexpected event network-vif-plugged-4457ec1e-80ee-4038-9838-3af879097230 for instance with vm_state active and task_state rescuing.
Oct 16 18:37:17 user nova-compute[74247]: DEBUG nova.compute.manager [req-abd0799f-7ea5-4b63-922d-2e87e929b4de req-a0c4fba1-4c16-46b9-8b43-6383e72368eb service nova] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Received event network-vif-plugged-4457ec1e-80ee-4038-9838-3af879097230 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:37:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-abd0799f-7ea5-4b63-922d-2e87e929b4de req-a0c4fba1-4c16-46b9-8b43-6383e72368eb service nova] Acquiring lock "958af87e-69d0-4da1-8fcf-90e0f275d62e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:37:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-abd0799f-7ea5-4b63-922d-2e87e929b4de req-a0c4fba1-4c16-46b9-8b43-6383e72368eb service nova] Lock "958af87e-69d0-4da1-8fcf-90e0f275d62e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:37:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-abd0799f-7ea5-4b63-922d-2e87e929b4de req-a0c4fba1-4c16-46b9-8b43-6383e72368eb service nova] Lock "958af87e-69d0-4da1-8fcf-90e0f275d62e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:37:17 user nova-compute[74247]: DEBUG nova.compute.manager [req-abd0799f-7ea5-4b63-922d-2e87e929b4de req-a0c4fba1-4c16-46b9-8b43-6383e72368eb service nova] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] No waiting events found dispatching network-vif-plugged-4457ec1e-80ee-4038-9838-3af879097230 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:37:17 user nova-compute[74247]: WARNING nova.compute.manager [req-abd0799f-7ea5-4b63-922d-2e87e929b4de req-a0c4fba1-4c16-46b9-8b43-6383e72368eb service nova] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Received unexpected event network-vif-plugged-4457ec1e-80ee-4038-9838-3af879097230 for instance with vm_state active and task_state rescuing.
Oct 16 18:37:17 user nova-compute[74247]: DEBUG nova.compute.manager [None req-7865864d-485c-4da2-b9bb-26ff8c27983b tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:37:20 user nova-compute[74247]: DEBUG nova.compute.manager [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 18:37:20 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:37:20 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Creating image(s)
Oct 16 18:37:20 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Did not create local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 18:37:20 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Ensure instance console log exists: /opt/stack/data/nova/instances/88ea9961-7a1d-4193-b72f-63e398752141/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:37:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:37:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:37:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:37:20 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Start _get_guest_xml network_info=[{"id": "f5845781-33be-4018-bc2c-72bb980ad8c8", "address": "fa:16:3e:92:70:e9", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5845781-33", "ovs_interfaceid": "f5845781-33be-4018-bc2c-72bb980ad8c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wXPfgxSi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '88ea9961-7a1d-4193-b72f-63e398752141', 'attached_at': '', 'detached_at': '', 'volume_id': '6fe688e0-e202-4c50-9a51-1fe480c399fa', 'serial': '6fe688e0-e202-4c50-9a51-1fe480c399fa'}, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '237af8f4-8074-42f3-8d76-3217d3b35582', 'guest_format': None, 'volume_type': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:37:20 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:37:20 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:37:20 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:37:20 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:37:20 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:37:20 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:37:20 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:37:20 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:37:20 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:37:20 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:37:20 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:37:20 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:37:20 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:37:20 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:37:20 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:37:20 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:37:20 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:37:20 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:37:20 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:37:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wXPfgxSi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:37:20 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:37:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:37:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:37:20 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:37:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:37:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:37:20 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:37:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4e1b9c-5cc5-4114-965d-4f3e7c7446ca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 18:37:21 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55aa7f3-3e78-4e14-8751-67628e013235]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa] added
Oct 16 18:37:21 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93ccdca-366e-49b2-8803-dae43c7fad6b]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab4d52d-79ed-4742-bad1-b9b610528aa4]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wXPfgxSi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wXPfgxSi" returned: 0 in 0.025s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[718ac80c-64ce-43e0-9d8d-356c394faf05]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wXPfgxSi'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca449097-58c9-420b-8a46-2e3bd7dea657]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c544772-9f1b-4215-8ec4-7d21bcef1b22]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:37:21 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:37:21 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c70698-ae84-4292-9edc-ce24c4751d90]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa, portal: 172.16.0.220,3260]
Oct 16 18:37:21 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa, portal: 172.16.0.220,3260] successful.
Oct 16 18:37:21 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fdae90-45f1-4a72-ab0e-d5e23c87cf40]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e7e752-a8da-46b0-911e-6d06669fc7e7]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:37:21 user nova-compute[74247]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)
Oct 16 18:37:21 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:37:21 user nova-compute[74247]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)
Oct 16 18:37:21 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f98df7-259f-47d2-8876-d0d0f3300e9b]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wXPfgxSi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c7fb5297-7c1d-448c-b508-6033973fa239 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Acquiring lock "e23e7124-676c-4b64-a77f-e9c7b46f0f18" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c7fb5297-7c1d-448c-b508-6033973fa239 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Lock "e23e7124-676c-4b64-a77f-e9c7b46f0f18" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c7fb5297-7c1d-448c-b508-6033973fa239 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Acquiring lock "e23e7124-676c-4b64-a77f-e9c7b46f0f18-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c7fb5297-7c1d-448c-b508-6033973fa239 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Lock "e23e7124-676c-4b64-a77f-e9c7b46f0f18-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c7fb5297-7c1d-448c-b508-6033973fa239 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Lock "e23e7124-676c-4b64-a77f-e9c7b46f0f18-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:37:21 user nova-compute[74247]: INFO nova.compute.manager [None req-c7fb5297-7c1d-448c-b508-6033973fa239 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Terminating instance
Oct 16 18:37:21 user nova-compute[74247]: DEBUG nova.compute.manager [None req-c7fb5297-7c1d-448c-b508-6033973fa239 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 18:37:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:22 user nova-compute[74247]: DEBUG nova.compute.manager [req-680a6700-31cb-457f-9696-3ce302cca76a req-f29aa9c3-623a-4a29-a5a5-db8bce0b2a99 service nova] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Received event network-vif-unplugged-af4e0bec-8cec-4373-b21f-9d65fb7e0eff {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:37:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-680a6700-31cb-457f-9696-3ce302cca76a req-f29aa9c3-623a-4a29-a5a5-db8bce0b2a99 service nova] Acquiring lock "e23e7124-676c-4b64-a77f-e9c7b46f0f18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:37:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-680a6700-31cb-457f-9696-3ce302cca76a req-f29aa9c3-623a-4a29-a5a5-db8bce0b2a99 service nova] Lock "e23e7124-676c-4b64-a77f-e9c7b46f0f18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:37:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-680a6700-31cb-457f-9696-3ce302cca76a req-f29aa9c3-623a-4a29-a5a5-db8bce0b2a99 service nova] Lock "e23e7124-676c-4b64-a77f-e9c7b46f0f18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:37:22 user nova-compute[74247]: DEBUG nova.compute.manager [req-680a6700-31cb-457f-9696-3ce302cca76a req-f29aa9c3-623a-4a29-a5a5-db8bce0b2a99 service nova] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] No waiting events found dispatching network-vif-unplugged-af4e0bec-8cec-4373-b21f-9d65fb7e0eff {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:37:22 user nova-compute[74247]: DEBUG nova.compute.manager [req-680a6700-31cb-457f-9696-3ce302cca76a req-f29aa9c3-623a-4a29-a5a5-db8bce0b2a99 service nova] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Received event network-vif-unplugged-af4e0bec-8cec-4373-b21f-9d65fb7e0eff for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:37:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:37:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '23266323563653463', 'path': '/dev/sdb'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:37:22 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266323563653463', 'path': '/dev/sdb'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:37:22 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1833793690',display_name='tempest-ServerActionsTestOtherA-server-1833793690',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1833793690',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/sQ/2CMkopvPZot1Iryii0p1Iq3sQgAbR+a1zff3LwsTrC97Bkir58aQPXckuRP2Pk52sgcmyihyOLiY8s4svRhqknfDOoanrdDaAunocHU/6uHElK38rY7fNKG4cJVA==',key_name='tempest-keypair-869426560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42bd3eb752f04fd48dfe0623fdf2fe9f',ramdisk_id='',reservation_id='r-b3ywbhfa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-291765974',owner_user_name='tempest-ServerActionsTestOtherA-291765974-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:37:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3635a30f06234f0d9a8e0604c25f1208',uuid=88ea9961-7a1d-4193-b72f-63e398752141,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5845781-33be-4018-bc2c-72bb980ad8c8", "address": "fa:16:3e:92:70:e9", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5845781-33", "ovs_interfaceid": "f5845781-33be-4018-bc2c-72bb980ad8c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:37:22 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Converting VIF {"id": "f5845781-33be-4018-bc2c-72bb980ad8c8", "address": "fa:16:3e:92:70:e9", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5845781-33", "ovs_interfaceid": "f5845781-33be-4018-bc2c-72bb980ad8c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:37:22 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:70:e9,bridge_name='br-int',has_traffic_filtering=True,id=f5845781-33be-4018-bc2c-72bb980ad8c8,network=Network(0a61bae1-2607-4e42-b573-e74ac3edf09a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5845781-33') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:37:22 user nova-compute[74247]: DEBUG nova.objects.instance [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lazy-loading 'pci_devices' on Instance uuid 88ea9961-7a1d-4193-b72f-63e398752141 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:37:22 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:37:22 user nova-compute[74247]:   <uuid>88ea9961-7a1d-4193-b72f-63e398752141</uuid>
Oct 16 18:37:22 user nova-compute[74247]:   <name>instance-0000001b</name>
Oct 16 18:37:22 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:37:22 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:37:22 user nova-compute[74247]:   <metadata>
Oct 16 18:37:22 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:37:22 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:37:22 user nova-compute[74247]:       <nova:name>tempest-ServerActionsTestOtherA-server-1833793690</nova:name>
Oct 16 18:37:22 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:37:20</nova:creationTime>
Oct 16 18:37:22 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:37:22 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:37:22 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:37:22 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:37:22 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:37:22 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:37:22 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:37:22 user nova-compute[74247]:       <nova:owner>
Oct 16 18:37:22 user nova-compute[74247]:         <nova:user uuid="3635a30f06234f0d9a8e0604c25f1208">tempest-ServerActionsTestOtherA-291765974-project-member</nova:user>
Oct 16 18:37:22 user nova-compute[74247]:         <nova:project uuid="42bd3eb752f04fd48dfe0623fdf2fe9f">tempest-ServerActionsTestOtherA-291765974</nova:project>
Oct 16 18:37:22 user nova-compute[74247]:       </nova:owner>
Oct 16 18:37:22 user nova-compute[74247]:       <nova:ports>
Oct 16 18:37:22 user nova-compute[74247]:         <nova:port uuid="f5845781-33be-4018-bc2c-72bb980ad8c8">
Oct 16 18:37:22 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 16 18:37:22 user nova-compute[74247]:         </nova:port>
Oct 16 18:37:22 user nova-compute[74247]:       </nova:ports>
Oct 16 18:37:22 user nova-compute[74247]:     </nova:instance>
Oct 16 18:37:22 user nova-compute[74247]:   </metadata>
Oct 16 18:37:22 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:37:22 user nova-compute[74247]:     <system>
Oct 16 18:37:22 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:37:22 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:37:22 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:37:22 user nova-compute[74247]:       <entry name="serial">88ea9961-7a1d-4193-b72f-63e398752141</entry>
Oct 16 18:37:22 user nova-compute[74247]:       <entry name="uuid">88ea9961-7a1d-4193-b72f-63e398752141</entry>
Oct 16 18:37:22 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:37:22 user nova-compute[74247]:     </system>
Oct 16 18:37:22 user nova-compute[74247]:   </sysinfo>
Oct 16 18:37:22 user nova-compute[74247]:   <os>
Oct 16 18:37:22 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:37:22 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:37:22 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:37:22 user nova-compute[74247]:   </os>
Oct 16 18:37:22 user nova-compute[74247]:   <features>
Oct 16 18:37:22 user nova-compute[74247]:     <acpi/>
Oct 16 18:37:22 user nova-compute[74247]:     <apic/>
Oct 16 18:37:22 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:37:22 user nova-compute[74247]:   </features>
Oct 16 18:37:22 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:37:22 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:37:22 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:37:22 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:37:22 user nova-compute[74247]:   </clock>
Oct 16 18:37:22 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:37:22 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:37:22 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:37:22 user nova-compute[74247]:   </cpu>
Oct 16 18:37:22 user nova-compute[74247]:   <devices>
Oct 16 18:37:22 user nova-compute[74247]:     <disk type="block" device="disk">
Oct 16 18:37:22 user nova-compute[74247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:37:22 user nova-compute[74247]:       <source dev="/dev/sdb"/>
Oct 16 18:37:22 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:37:22 user nova-compute[74247]:       <serial>6fe688e0-e202-4c50-9a51-1fe480c399fa</serial>
Oct 16 18:37:22 user nova-compute[74247]:     </disk>
Oct 16 18:37:22 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:37:22 user nova-compute[74247]:       <mac address="fa:16:3e:92:70:e9"/>
Oct 16 18:37:22 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:37:22 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:37:22 user nova-compute[74247]:       <target dev="tapf5845781-33"/>
Oct 16 18:37:22 user nova-compute[74247]:     </interface>
Oct 16 18:37:22 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:37:22 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/88ea9961-7a1d-4193-b72f-63e398752141/console.log" append="off"/>
Oct 16 18:37:22 user nova-compute[74247]:     </serial>
Oct 16 18:37:22 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:37:22 user nova-compute[74247]:     <video>
Oct 16 18:37:22 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:37:22 user nova-compute[74247]:     </video>
Oct 16 18:37:22 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:37:22 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:37:22 user nova-compute[74247]:     </rng>
Oct 16 18:37:22 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:37:22 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:37:22 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:37:22 user nova-compute[74247]:     </memballoon>
Oct 16 18:37:22 user nova-compute[74247]:   </devices>
Oct 16 18:37:22 user nova-compute[74247]: </domain>
Oct 16 18:37:22 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:37:22 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1833793690',display_name='tempest-ServerActionsTestOtherA-server-1833793690',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1833793690',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/sQ/2CMkopvPZot1Iryii0p1Iq3sQgAbR+a1zff3LwsTrC97Bkir58aQPXckuRP2Pk52sgcmyihyOLiY8s4svRhqknfDOoanrdDaAunocHU/6uHElK38rY7fNKG4cJVA==',key_name='tempest-keypair-869426560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42bd3eb752f04fd48dfe0623fdf2fe9f',ramdisk_id='',reservation_id='r-b3ywbhfa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-291765974',owner_user_name='tempest-ServerActionsTestOtherA-291765974-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:37:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3635a30f06234f0d9a8e0604c25f1208',uuid=88ea9961-7a1d-4193-b72f-63e398752141,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5845781-33be-4018-bc2c-72bb980ad8c8", "address": "fa:16:3e:92:70:e9", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5845781-33", "ovs_interfaceid": "f5845781-33be-4018-bc2c-72bb980ad8c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:37:22 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Converting VIF {"id": "f5845781-33be-4018-bc2c-72bb980ad8c8", "address": "fa:16:3e:92:70:e9", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5845781-33", "ovs_interfaceid": "f5845781-33be-4018-bc2c-72bb980ad8c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:37:22 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:70:e9,bridge_name='br-int',has_traffic_filtering=True,id=f5845781-33be-4018-bc2c-72bb980ad8c8,network=Network(0a61bae1-2607-4e42-b573-e74ac3edf09a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5845781-33') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:37:22 user nova-compute[74247]: DEBUG os_vif [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:70:e9,bridge_name='br-int',has_traffic_filtering=True,id=f5845781-33be-4018-bc2c-72bb980ad8c8,network=Network(0a61bae1-2607-4e42-b573-e74ac3edf09a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5845781-33') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:37:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:37:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:37:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '63f6a782-2463-5bac-9503-ff8060045d96', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:37:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:37:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5845781-33, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:37:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf5845781-33, col_values=(('qos', UUID('9ff5e9a1-df33-425d-bc5d-a571228e54e1')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:37:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf5845781-33, col_values=(('external_ids', {'iface-id': 'f5845781-33be-4018-bc2c-72bb980ad8c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:70:e9', 'vm-uuid': '88ea9961-7a1d-4193-b72f-63e398752141'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:37:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:37:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:22 user nova-compute[74247]: INFO os_vif [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:70:e9,bridge_name='br-int',has_traffic_filtering=True,id=f5845781-33be-4018-bc2c-72bb980ad8c8,network=Network(0a61bae1-2607-4e42-b573-e74ac3edf09a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5845781-33')
Oct 16 18:37:22 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:37:22 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] No VIF found with MAC fa:16:3e:92:70:e9, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:37:23 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Instance destroyed successfully.
Oct 16 18:37:23 user nova-compute[74247]: DEBUG nova.objects.instance [None req-c7fb5297-7c1d-448c-b508-6033973fa239 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Lazy-loading 'resources' on Instance uuid e23e7124-676c-4b64-a77f-e9c7b46f0f18 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:37:23 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-c7fb5297-7c1d-448c-b508-6033973fa239 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:35:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-977611080',display_name='tempest-VolumesNegativeTest-instance-977611080',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-977611080',id=24,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:35:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6657cd3ef50342c78db1bc9551de094b',ramdisk_id='',reservation_id='r-4aqgxb6m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1617705614',owner_user_name='tempest-VolumesNegativeTest-1617705614-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:35:39Z,user_data=None,user_id='beca1b1c120c420e979c21a591143b49',uuid=e23e7124-676c-4b64-a77f-e9c7b46f0f18,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af4e0bec-8cec-4373-b21f-9d65fb7e0eff", "address": "fa:16:3e:62:f4:30", "network": {"id": "b6946b9d-ee0d-466d-abd8-24ecf8486b3d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "12ee40b874d34e56adcfd74c16123017", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4e0bec-8c", "ovs_interfaceid": "af4e0bec-8cec-4373-b21f-9d65fb7e0eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:37:23 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-c7fb5297-7c1d-448c-b508-6033973fa239 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Converting VIF {"id": "af4e0bec-8cec-4373-b21f-9d65fb7e0eff", "address": "fa:16:3e:62:f4:30", "network": {"id": "b6946b9d-ee0d-466d-abd8-24ecf8486b3d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "12ee40b874d34e56adcfd74c16123017", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4e0bec-8c", "ovs_interfaceid": "af4e0bec-8cec-4373-b21f-9d65fb7e0eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:37:23 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-c7fb5297-7c1d-448c-b508-6033973fa239 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:f4:30,bridge_name='br-int',has_traffic_filtering=True,id=af4e0bec-8cec-4373-b21f-9d65fb7e0eff,network=Network(b6946b9d-ee0d-466d-abd8-24ecf8486b3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf4e0bec-8c') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:37:23 user nova-compute[74247]: DEBUG os_vif [None req-c7fb5297-7c1d-448c-b508-6033973fa239 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:f4:30,bridge_name='br-int',has_traffic_filtering=True,id=af4e0bec-8cec-4373-b21f-9d65fb7e0eff,network=Network(b6946b9d-ee0d-466d-abd8-24ecf8486b3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf4e0bec-8c') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:37:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf4e0bec-8c, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:37:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:37:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b54ca7cd-76f3-41fc-8483-58a862aaa719) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:37:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:37:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:23 user nova-compute[74247]: INFO os_vif [None req-c7fb5297-7c1d-448c-b508-6033973fa239 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:f4:30,bridge_name='br-int',has_traffic_filtering=True,id=af4e0bec-8cec-4373-b21f-9d65fb7e0eff,network=Network(b6946b9d-ee0d-466d-abd8-24ecf8486b3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf4e0bec-8c')
Oct 16 18:37:23 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-c7fb5297-7c1d-448c-b508-6033973fa239 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Deleting instance files /opt/stack/data/nova/instances/e23e7124-676c-4b64-a77f-e9c7b46f0f18_del
Oct 16 18:37:23 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-c7fb5297-7c1d-448c-b508-6033973fa239 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Deletion of /opt/stack/data/nova/instances/e23e7124-676c-4b64-a77f-e9c7b46f0f18_del complete
Oct 16 18:37:23 user nova-compute[74247]: INFO nova.compute.manager [None req-c7fb5297-7c1d-448c-b508-6033973fa239 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Took 1.29 seconds to destroy the instance on the hypervisor.
Oct 16 18:37:23 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-c7fb5297-7c1d-448c-b508-6033973fa239 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 18:37:23 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 18:37:23 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 18:37:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:23 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:37:23 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Took 0.66 seconds to deallocate network for instance.
Oct 16 18:37:23 user nova-compute[74247]: DEBUG nova.compute.manager [req-9f7c6e55-23ff-4f83-9b77-0d219efb525b req-c86adadf-ada3-4cef-b71d-e740f01786fd service nova] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Received event network-vif-deleted-af4e0bec-8cec-4373-b21f-9d65fb7e0eff {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:37:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c7fb5297-7c1d-448c-b508-6033973fa239 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:37:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c7fb5297-7c1d-448c-b508-6033973fa239 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:37:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:24 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-c7fb5297-7c1d-448c-b508-6033973fa239 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:37:24 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-c7fb5297-7c1d-448c-b508-6033973fa239 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:37:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c7fb5297-7c1d-448c-b508-6033973fa239 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.376s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:37:24 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-c7fb5297-7c1d-448c-b508-6033973fa239 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Deleted allocations for instance e23e7124-676c-4b64-a77f-e9c7b46f0f18
Oct 16 18:37:24 user nova-compute[74247]: DEBUG nova.compute.manager [req-0ccca93d-d2f9-4aac-a268-3363fee3018f req-6e21cd35-d745-4285-b9e0-8b6c275251f2 service nova] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Received event network-vif-plugged-af4e0bec-8cec-4373-b21f-9d65fb7e0eff {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:37:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0ccca93d-d2f9-4aac-a268-3363fee3018f req-6e21cd35-d745-4285-b9e0-8b6c275251f2 service nova] Acquiring lock "e23e7124-676c-4b64-a77f-e9c7b46f0f18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:37:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0ccca93d-d2f9-4aac-a268-3363fee3018f req-6e21cd35-d745-4285-b9e0-8b6c275251f2 service nova] Lock "e23e7124-676c-4b64-a77f-e9c7b46f0f18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:37:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0ccca93d-d2f9-4aac-a268-3363fee3018f req-6e21cd35-d745-4285-b9e0-8b6c275251f2 service nova] Lock "e23e7124-676c-4b64-a77f-e9c7b46f0f18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:37:24 user nova-compute[74247]: DEBUG nova.compute.manager [req-0ccca93d-d2f9-4aac-a268-3363fee3018f req-6e21cd35-d745-4285-b9e0-8b6c275251f2 service nova] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] No waiting events found dispatching network-vif-plugged-af4e0bec-8cec-4373-b21f-9d65fb7e0eff {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:37:24 user nova-compute[74247]: WARNING nova.compute.manager [req-0ccca93d-d2f9-4aac-a268-3363fee3018f req-6e21cd35-d745-4285-b9e0-8b6c275251f2 service nova] [instance: e23e7124-676c-4b64-a77f-e9c7b46f0f18] Received unexpected event network-vif-plugged-af4e0bec-8cec-4373-b21f-9d65fb7e0eff for instance with vm_state deleted and task_state None.
Oct 16 18:37:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c7fb5297-7c1d-448c-b508-6033973fa239 tempest-VolumesNegativeTest-1617705614 tempest-VolumesNegativeTest-1617705614-project-member] Lock "e23e7124-676c-4b64-a77f-e9c7b46f0f18" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.539s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:37:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:26 user nova-compute[74247]: DEBUG nova.compute.manager [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:37:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:37:26 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Instance spawned successfully.
Oct 16 18:37:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 18:37:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:37:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:37:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:37:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:37:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:37:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:37:26 user nova-compute[74247]: DEBUG nova.compute.manager [req-34695861-7a11-441f-b311-6002b357c646 req-953a437e-b453-4dd8-9ba4-83ccb36c8efd service nova] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Received event network-vif-plugged-f5845781-33be-4018-bc2c-72bb980ad8c8 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:37:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-34695861-7a11-441f-b311-6002b357c646 req-953a437e-b453-4dd8-9ba4-83ccb36c8efd service nova] Acquiring lock "88ea9961-7a1d-4193-b72f-63e398752141-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:37:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-34695861-7a11-441f-b311-6002b357c646 req-953a437e-b453-4dd8-9ba4-83ccb36c8efd service nova] Lock "88ea9961-7a1d-4193-b72f-63e398752141-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:37:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-34695861-7a11-441f-b311-6002b357c646 req-953a437e-b453-4dd8-9ba4-83ccb36c8efd service nova] Lock "88ea9961-7a1d-4193-b72f-63e398752141-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:37:26 user nova-compute[74247]: DEBUG nova.compute.manager [req-34695861-7a11-441f-b311-6002b357c646 req-953a437e-b453-4dd8-9ba4-83ccb36c8efd service nova] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] No waiting events found dispatching network-vif-plugged-f5845781-33be-4018-bc2c-72bb980ad8c8 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:37:26 user nova-compute[74247]: WARNING nova.compute.manager [req-34695861-7a11-441f-b311-6002b357c646 req-953a437e-b453-4dd8-9ba4-83ccb36c8efd service nova] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Received unexpected event network-vif-plugged-f5845781-33be-4018-bc2c-72bb980ad8c8 for instance with vm_state building and task_state spawning.
Oct 16 18:37:26 user nova-compute[74247]: DEBUG nova.compute.manager [req-34695861-7a11-441f-b311-6002b357c646 req-953a437e-b453-4dd8-9ba4-83ccb36c8efd service nova] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Received event network-vif-plugged-f5845781-33be-4018-bc2c-72bb980ad8c8 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:37:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-34695861-7a11-441f-b311-6002b357c646 req-953a437e-b453-4dd8-9ba4-83ccb36c8efd service nova] Acquiring lock "88ea9961-7a1d-4193-b72f-63e398752141-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:37:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-34695861-7a11-441f-b311-6002b357c646 req-953a437e-b453-4dd8-9ba4-83ccb36c8efd service nova] Lock "88ea9961-7a1d-4193-b72f-63e398752141-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:37:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-34695861-7a11-441f-b311-6002b357c646 req-953a437e-b453-4dd8-9ba4-83ccb36c8efd service nova] Lock "88ea9961-7a1d-4193-b72f-63e398752141-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:37:26 user nova-compute[74247]: DEBUG nova.compute.manager [req-34695861-7a11-441f-b311-6002b357c646 req-953a437e-b453-4dd8-9ba4-83ccb36c8efd service nova] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] No waiting events found dispatching network-vif-plugged-f5845781-33be-4018-bc2c-72bb980ad8c8 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:37:26 user nova-compute[74247]: WARNING nova.compute.manager [req-34695861-7a11-441f-b311-6002b357c646 req-953a437e-b453-4dd8-9ba4-83ccb36c8efd service nova] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Received unexpected event network-vif-plugged-f5845781-33be-4018-bc2c-72bb980ad8c8 for instance with vm_state building and task_state spawning.
Oct 16 18:37:26 user nova-compute[74247]: INFO nova.compute.manager [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Took 5.56 seconds to spawn the instance on the hypervisor.
Oct 16 18:37:26 user nova-compute[74247]: DEBUG nova.compute.manager [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:37:26 user nova-compute[74247]: INFO nova.compute.manager [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Took 25.44 seconds to build instance.
Oct 16 18:37:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-83acbd18-b750-4992-80f8-a02aed80c804 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "88ea9961-7a1d-4193-b72f-63e398752141" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.790s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:37:27 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-23ba0ad0-f7e9-4e39-ab19-e74e8fc4f174 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Acquiring lock "eb56c456-005d-4d2d-b163-7ab281ca11fb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:37:27 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-23ba0ad0-f7e9-4e39-ab19-e74e8fc4f174 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Lock "eb56c456-005d-4d2d-b163-7ab281ca11fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:37:27 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-23ba0ad0-f7e9-4e39-ab19-e74e8fc4f174 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Acquiring lock "eb56c456-005d-4d2d-b163-7ab281ca11fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:37:27 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-23ba0ad0-f7e9-4e39-ab19-e74e8fc4f174 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Lock "eb56c456-005d-4d2d-b163-7ab281ca11fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:37:27 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-23ba0ad0-f7e9-4e39-ab19-e74e8fc4f174 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Lock "eb56c456-005d-4d2d-b163-7ab281ca11fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:37:27 user nova-compute[74247]: INFO nova.compute.manager [None req-23ba0ad0-f7e9-4e39-ab19-e74e8fc4f174 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Terminating instance
Oct 16 18:37:27 user nova-compute[74247]: DEBUG nova.compute.manager [None req-23ba0ad0-f7e9-4e39-ab19-e74e8fc4f174 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 18:37:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:28 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:28 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:28 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Instance destroyed successfully.
Oct 16 18:37:28 user nova-compute[74247]: DEBUG nova.objects.instance [None req-23ba0ad0-f7e9-4e39-ab19-e74e8fc4f174 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Lazy-loading 'resources' on Instance uuid eb56c456-005d-4d2d-b163-7ab281ca11fb {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:37:28 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-23ba0ad0-f7e9-4e39-ab19-e74e8fc4f174 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:35:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-373110214',display_name='tempest-VolumesActionsTest-instance-373110214',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-373110214',id=23,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:35:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dcc4afc6abf94662a5f2ab6b14308276',ramdisk_id='',reservation_id='r-990lqw4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-919370460',owner_user_name='tempest-VolumesActionsTest-919370460-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:35:27Z,user_data=None,user_id='3dc6b6ae77ff442189499323b61a2dbb',uuid=eb56c456-005d-4d2d-b163-7ab281ca11fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4c9d956-6c6e-49d2-b683-13cf32c4340e", "address": "fa:16:3e:5f:1f:fd", "network": {"id": "7d7d83a4-4978-4615-bdc2-96d8d1479470", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1489624033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc4afc6abf94662a5f2ab6b14308276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c9d956-6c", "ovs_interfaceid": "a4c9d956-6c6e-49d2-b683-13cf32c4340e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:37:28 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-23ba0ad0-f7e9-4e39-ab19-e74e8fc4f174 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Converting VIF {"id": "a4c9d956-6c6e-49d2-b683-13cf32c4340e", "address": "fa:16:3e:5f:1f:fd", "network": {"id": "7d7d83a4-4978-4615-bdc2-96d8d1479470", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1489624033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc4afc6abf94662a5f2ab6b14308276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c9d956-6c", "ovs_interfaceid": "a4c9d956-6c6e-49d2-b683-13cf32c4340e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:37:28 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-23ba0ad0-f7e9-4e39-ab19-e74e8fc4f174 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:1f:fd,bridge_name='br-int',has_traffic_filtering=True,id=a4c9d956-6c6e-49d2-b683-13cf32c4340e,network=Network(7d7d83a4-4978-4615-bdc2-96d8d1479470),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4c9d956-6c') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:37:28 user nova-compute[74247]: DEBUG os_vif [None req-23ba0ad0-f7e9-4e39-ab19-e74e8fc4f174 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:1f:fd,bridge_name='br-int',has_traffic_filtering=True,id=a4c9d956-6c6e-49d2-b683-13cf32c4340e,network=Network(7d7d83a4-4978-4615-bdc2-96d8d1479470),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4c9d956-6c') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:37:28 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:28 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4c9d956-6c, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:37:28 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:28 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:28 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:28 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0497e584-fabb-41a7-810d-b018cbb2337c) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:37:28 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:28 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:28 user nova-compute[74247]: INFO os_vif [None req-23ba0ad0-f7e9-4e39-ab19-e74e8fc4f174 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:1f:fd,bridge_name='br-int',has_traffic_filtering=True,id=a4c9d956-6c6e-49d2-b683-13cf32c4340e,network=Network(7d7d83a4-4978-4615-bdc2-96d8d1479470),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4c9d956-6c')
Oct 16 18:37:28 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-23ba0ad0-f7e9-4e39-ab19-e74e8fc4f174 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Deleting instance files /opt/stack/data/nova/instances/eb56c456-005d-4d2d-b163-7ab281ca11fb_del
Oct 16 18:37:28 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-23ba0ad0-f7e9-4e39-ab19-e74e8fc4f174 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Deletion of /opt/stack/data/nova/instances/eb56c456-005d-4d2d-b163-7ab281ca11fb_del complete
Oct 16 18:37:28 user nova-compute[74247]: DEBUG nova.compute.manager [req-a77546fb-aeb0-4945-9ab5-91c7f49c1035 req-104523ab-323c-474f-93b7-ff878d020d43 service nova] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Received event network-vif-unplugged-a4c9d956-6c6e-49d2-b683-13cf32c4340e {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:37:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a77546fb-aeb0-4945-9ab5-91c7f49c1035 req-104523ab-323c-474f-93b7-ff878d020d43 service nova] Acquiring lock "eb56c456-005d-4d2d-b163-7ab281ca11fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:37:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a77546fb-aeb0-4945-9ab5-91c7f49c1035 req-104523ab-323c-474f-93b7-ff878d020d43 service nova] Lock "eb56c456-005d-4d2d-b163-7ab281ca11fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:37:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a77546fb-aeb0-4945-9ab5-91c7f49c1035 req-104523ab-323c-474f-93b7-ff878d020d43 service nova] Lock "eb56c456-005d-4d2d-b163-7ab281ca11fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:37:28 user nova-compute[74247]: DEBUG nova.compute.manager [req-a77546fb-aeb0-4945-9ab5-91c7f49c1035 req-104523ab-323c-474f-93b7-ff878d020d43 service nova] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] No waiting events found dispatching network-vif-unplugged-a4c9d956-6c6e-49d2-b683-13cf32c4340e {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:37:28 user nova-compute[74247]: DEBUG nova.compute.manager [req-a77546fb-aeb0-4945-9ab5-91c7f49c1035 req-104523ab-323c-474f-93b7-ff878d020d43 service nova] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Received event network-vif-unplugged-a4c9d956-6c6e-49d2-b683-13cf32c4340e for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:37:28 user nova-compute[74247]: DEBUG nova.compute.manager [req-a77546fb-aeb0-4945-9ab5-91c7f49c1035 req-104523ab-323c-474f-93b7-ff878d020d43 service nova] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Received event network-vif-plugged-a4c9d956-6c6e-49d2-b683-13cf32c4340e {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:37:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a77546fb-aeb0-4945-9ab5-91c7f49c1035 req-104523ab-323c-474f-93b7-ff878d020d43 service nova] Acquiring lock "eb56c456-005d-4d2d-b163-7ab281ca11fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:37:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a77546fb-aeb0-4945-9ab5-91c7f49c1035 req-104523ab-323c-474f-93b7-ff878d020d43 service nova] Lock "eb56c456-005d-4d2d-b163-7ab281ca11fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:37:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a77546fb-aeb0-4945-9ab5-91c7f49c1035 req-104523ab-323c-474f-93b7-ff878d020d43 service nova] Lock "eb56c456-005d-4d2d-b163-7ab281ca11fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:37:28 user nova-compute[74247]: DEBUG nova.compute.manager [req-a77546fb-aeb0-4945-9ab5-91c7f49c1035 req-104523ab-323c-474f-93b7-ff878d020d43 service nova] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] No waiting events found dispatching network-vif-plugged-a4c9d956-6c6e-49d2-b683-13cf32c4340e {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:37:28 user nova-compute[74247]: WARNING nova.compute.manager [req-a77546fb-aeb0-4945-9ab5-91c7f49c1035 req-104523ab-323c-474f-93b7-ff878d020d43 service nova] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Received unexpected event network-vif-plugged-a4c9d956-6c6e-49d2-b683-13cf32c4340e for instance with vm_state active and task_state deleting.
Oct 16 18:37:28 user nova-compute[74247]: INFO nova.compute.manager [None req-23ba0ad0-f7e9-4e39-ab19-e74e8fc4f174 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Took 0.81 seconds to destroy the instance on the hypervisor.
Oct 16 18:37:28 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-23ba0ad0-f7e9-4e39-ab19-e74e8fc4f174 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 18:37:28 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 18:37:28 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 18:37:29 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:37:29 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Took 0.47 seconds to deallocate network for instance.
Oct 16 18:37:29 user nova-compute[74247]: DEBUG nova.compute.manager [req-0eac4b26-0b1c-4a1f-9167-be50adf57950 req-d02d3477-2aaf-4ffb-93c1-07eb36489568 service nova] [instance: eb56c456-005d-4d2d-b163-7ab281ca11fb] Received event network-vif-deleted-a4c9d956-6c6e-49d2-b683-13cf32c4340e {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:37:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-23ba0ad0-f7e9-4e39-ab19-e74e8fc4f174 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:37:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-23ba0ad0-f7e9-4e39-ab19-e74e8fc4f174 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:37:29 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-23ba0ad0-f7e9-4e39-ab19-e74e8fc4f174 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:37:29 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-23ba0ad0-f7e9-4e39-ab19-e74e8fc4f174 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:37:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-23ba0ad0-f7e9-4e39-ab19-e74e8fc4f174 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.390s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:37:29 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-23ba0ad0-f7e9-4e39-ab19-e74e8fc4f174 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Deleted allocations for instance eb56c456-005d-4d2d-b163-7ab281ca11fb
Oct 16 18:37:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-23ba0ad0-f7e9-4e39-ab19-e74e8fc4f174 tempest-VolumesActionsTest-919370460 tempest-VolumesActionsTest-919370460-project-member] Lock "eb56c456-005d-4d2d-b163-7ab281ca11fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.912s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:37:30 user nova-compute[74247]: INFO nova.compute.manager [None req-09f198d5-7cb5-46fe-8e91-aca40dde96d7 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Unrescuing
Oct 16 18:37:30 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-09f198d5-7cb5-46fe-8e91-aca40dde96d7 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "refresh_cache-7dcc08e9-7439-436b-8d9f-facaf04e22c1" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:37:30 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-09f198d5-7cb5-46fe-8e91-aca40dde96d7 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquired lock "refresh_cache-7dcc08e9-7439-436b-8d9f-facaf04e22c1" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:37:30 user nova-compute[74247]: DEBUG nova.network.neutron [None req-09f198d5-7cb5-46fe-8e91-aca40dde96d7 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:37:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:31 user nova-compute[74247]: DEBUG nova.network.neutron [None req-09f198d5-7cb5-46fe-8e91-aca40dde96d7 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Updating instance_info_cache with network_info: [{"id": "b7a0865a-62eb-4517-83ba-eb30ff219e50", "address": "fa:16:3e:47:07:5d", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a0865a-62", "ovs_interfaceid": "b7a0865a-62eb-4517-83ba-eb30ff219e50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:37:31 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-09f198d5-7cb5-46fe-8e91-aca40dde96d7 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Releasing lock "refresh_cache-7dcc08e9-7439-436b-8d9f-facaf04e22c1" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:37:31 user nova-compute[74247]: DEBUG nova.objects.instance [None req-09f198d5-7cb5-46fe-8e91-aca40dde96d7 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lazy-loading 'flavor' on Instance uuid 7dcc08e9-7439-436b-8d9f-facaf04e22c1 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:37:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:31 user nova-compute[74247]: DEBUG nova.compute.manager [req-3e610b7b-3f15-48bd-97ce-20a6e5d62773 req-2aa1c831-7c42-414c-8087-3075319eab79 service nova] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Received event network-vif-unplugged-b7a0865a-62eb-4517-83ba-eb30ff219e50 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:37:31 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3e610b7b-3f15-48bd-97ce-20a6e5d62773 req-2aa1c831-7c42-414c-8087-3075319eab79 service nova] Acquiring lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:37:31 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3e610b7b-3f15-48bd-97ce-20a6e5d62773 req-2aa1c831-7c42-414c-8087-3075319eab79 service nova] Lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:37:31 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3e610b7b-3f15-48bd-97ce-20a6e5d62773 req-2aa1c831-7c42-414c-8087-3075319eab79 service nova] Lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:37:31 user nova-compute[74247]: DEBUG nova.compute.manager [req-3e610b7b-3f15-48bd-97ce-20a6e5d62773 req-2aa1c831-7c42-414c-8087-3075319eab79 service nova] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] No waiting events found dispatching network-vif-unplugged-b7a0865a-62eb-4517-83ba-eb30ff219e50 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:37:31 user nova-compute[74247]: WARNING nova.compute.manager [req-3e610b7b-3f15-48bd-97ce-20a6e5d62773 req-2aa1c831-7c42-414c-8087-3075319eab79 service nova] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Received unexpected event network-vif-unplugged-b7a0865a-62eb-4517-83ba-eb30ff219e50 for instance with vm_state rescued and task_state unrescuing.
Oct 16 18:37:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:32 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Instance destroyed successfully.
Oct 16 18:37:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:33 user nova-compute[74247]: DEBUG nova.compute.manager [req-bd04ef5b-7b2c-4b7e-8573-86b87e4860e7 req-5c870d4c-905b-4502-ba11-6aa33d9e2347 service nova] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Received event network-vif-plugged-b7a0865a-62eb-4517-83ba-eb30ff219e50 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:37:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-bd04ef5b-7b2c-4b7e-8573-86b87e4860e7 req-5c870d4c-905b-4502-ba11-6aa33d9e2347 service nova] Acquiring lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:37:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-bd04ef5b-7b2c-4b7e-8573-86b87e4860e7 req-5c870d4c-905b-4502-ba11-6aa33d9e2347 service nova] Lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:37:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-bd04ef5b-7b2c-4b7e-8573-86b87e4860e7 req-5c870d4c-905b-4502-ba11-6aa33d9e2347 service nova] Lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:37:33 user nova-compute[74247]: DEBUG nova.compute.manager [req-bd04ef5b-7b2c-4b7e-8573-86b87e4860e7 req-5c870d4c-905b-4502-ba11-6aa33d9e2347 service nova] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] No waiting events found dispatching network-vif-plugged-b7a0865a-62eb-4517-83ba-eb30ff219e50 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:37:33 user nova-compute[74247]: WARNING nova.compute.manager [req-bd04ef5b-7b2c-4b7e-8573-86b87e4860e7 req-5c870d4c-905b-4502-ba11-6aa33d9e2347 service nova] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Received unexpected event network-vif-plugged-b7a0865a-62eb-4517-83ba-eb30ff219e50 for instance with vm_state rescued and task_state unrescuing.
Oct 16 18:37:33 user nova-compute[74247]: DEBUG nova.compute.manager [req-bd04ef5b-7b2c-4b7e-8573-86b87e4860e7 req-5c870d4c-905b-4502-ba11-6aa33d9e2347 service nova] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Received event network-vif-plugged-b7a0865a-62eb-4517-83ba-eb30ff219e50 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:37:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-bd04ef5b-7b2c-4b7e-8573-86b87e4860e7 req-5c870d4c-905b-4502-ba11-6aa33d9e2347 service nova] Acquiring lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:37:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-bd04ef5b-7b2c-4b7e-8573-86b87e4860e7 req-5c870d4c-905b-4502-ba11-6aa33d9e2347 service nova] Lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:37:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-bd04ef5b-7b2c-4b7e-8573-86b87e4860e7 req-5c870d4c-905b-4502-ba11-6aa33d9e2347 service nova] Lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:37:33 user nova-compute[74247]: DEBUG nova.compute.manager [req-bd04ef5b-7b2c-4b7e-8573-86b87e4860e7 req-5c870d4c-905b-4502-ba11-6aa33d9e2347 service nova] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] No waiting events found dispatching network-vif-plugged-b7a0865a-62eb-4517-83ba-eb30ff219e50 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:37:33 user nova-compute[74247]: WARNING nova.compute.manager [req-bd04ef5b-7b2c-4b7e-8573-86b87e4860e7 req-5c870d4c-905b-4502-ba11-6aa33d9e2347 service nova] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Received unexpected event network-vif-plugged-b7a0865a-62eb-4517-83ba-eb30ff219e50 for instance with vm_state rescued and task_state unrescuing.
Oct 16 18:37:35 user nova-compute[74247]: DEBUG nova.compute.manager [None req-09f198d5-7cb5-46fe-8e91-aca40dde96d7 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:37:35 user nova-compute[74247]: DEBUG nova.compute.manager [req-3c5f569e-edfc-4601-92a3-1386834f0235 req-56afca2e-3869-4659-9c94-6caa374a2f78 service nova] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Received event network-vif-plugged-b7a0865a-62eb-4517-83ba-eb30ff219e50 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:37:35 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3c5f569e-edfc-4601-92a3-1386834f0235 req-56afca2e-3869-4659-9c94-6caa374a2f78 service nova] Acquiring lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:37:35 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3c5f569e-edfc-4601-92a3-1386834f0235 req-56afca2e-3869-4659-9c94-6caa374a2f78 service nova] Lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:37:35 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3c5f569e-edfc-4601-92a3-1386834f0235 req-56afca2e-3869-4659-9c94-6caa374a2f78 service nova] Lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:37:35 user nova-compute[74247]: DEBUG nova.compute.manager [req-3c5f569e-edfc-4601-92a3-1386834f0235 req-56afca2e-3869-4659-9c94-6caa374a2f78 service nova] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] No waiting events found dispatching network-vif-plugged-b7a0865a-62eb-4517-83ba-eb30ff219e50 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:37:35 user nova-compute[74247]: WARNING nova.compute.manager [req-3c5f569e-edfc-4601-92a3-1386834f0235 req-56afca2e-3869-4659-9c94-6caa374a2f78 service nova] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Received unexpected event network-vif-plugged-b7a0865a-62eb-4517-83ba-eb30ff219e50 for instance with vm_state rescued and task_state unrescuing.
Oct 16 18:37:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:43 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:46 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "d4a3995f-cd3e-41be-8901-876eefbe2bf3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:37:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "d4a3995f-cd3e-41be-8901-876eefbe2bf3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:37:48 user nova-compute[74247]: DEBUG nova.compute.manager [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 18:37:48 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:37:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:37:48 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:37:48 user nova-compute[74247]: INFO nova.compute.claims [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Claim successful on node user
Oct 16 18:37:48 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:37:48 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:37:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.382s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:37:48 user nova-compute[74247]: DEBUG nova.compute.manager [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 18:37:49 user nova-compute[74247]: DEBUG nova.compute.manager [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 18:37:49 user nova-compute[74247]: DEBUG nova.network.neutron [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 18:37:49 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 18:37:49 user nova-compute[74247]: DEBUG nova.compute.manager [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 18:37:49 user nova-compute[74247]: DEBUG nova.policy [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5bd70613da1f489f86227655ff364795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96ced9d4c0c474fbc7edeed6f73324a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 18:37:49 user nova-compute[74247]: DEBUG nova.compute.manager [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 18:37:49 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:37:49 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Creating image(s)
Oct 16 18:37:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "/opt/stack/data/nova/instances/d4a3995f-cd3e-41be-8901-876eefbe2bf3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:37:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "/opt/stack/data/nova/instances/d4a3995f-cd3e-41be-8901-876eefbe2bf3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:37:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "/opt/stack/data/nova/instances/d4a3995f-cd3e-41be-8901-876eefbe2bf3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:37:49 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:37:49 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.187s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:37:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "37399febbd18f60b85fd0f833558f6a3539ab231" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:37:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:37:49 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:37:49 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.171s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:37:49 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/d4a3995f-cd3e-41be-8901-876eefbe2bf3/disk 1073741824 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:37:49 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/d4a3995f-cd3e-41be-8901-876eefbe2bf3/disk 1073741824" returned: 0 in 0.059s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:37:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:37:49 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:37:49 user nova-compute[74247]: DEBUG nova.network.neutron [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Successfully created port: 68286914-fc60-4ccc-a7c9-28c15f8fbaf4 {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:37:49 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.187s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:37:49 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d4a3995f-cd3e-41be-8901-876eefbe2bf3/disk. size=1073741824 {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 18:37:49 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4a3995f-cd3e-41be-8901-876eefbe2bf3/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:37:50 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4a3995f-cd3e-41be-8901-876eefbe2bf3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:37:50 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Cannot resize image /opt/stack/data/nova/instances/d4a3995f-cd3e-41be-8901-876eefbe2bf3/disk to a smaller size. {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 18:37:50 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 18:37:50 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Ensure instance console log exists: /opt/stack/data/nova/instances/d4a3995f-cd3e-41be-8901-876eefbe2bf3/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:37:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:37:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:37:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:37:50 user nova-compute[74247]: DEBUG nova.network.neutron [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Successfully updated port: 68286914-fc60-4ccc-a7c9-28c15f8fbaf4 {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:37:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "refresh_cache-d4a3995f-cd3e-41be-8901-876eefbe2bf3" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:37:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquired lock "refresh_cache-d4a3995f-cd3e-41be-8901-876eefbe2bf3" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:37:50 user nova-compute[74247]: DEBUG nova.network.neutron [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:37:50 user nova-compute[74247]: DEBUG nova.compute.manager [req-02e085cd-5cc1-4a3d-b56e-37eb1eb99fe5 req-39721c8a-c7d5-45dd-a8f6-46697d9fd4f8 service nova] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Received event network-changed-68286914-fc60-4ccc-a7c9-28c15f8fbaf4 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:37:50 user nova-compute[74247]: DEBUG nova.compute.manager [req-02e085cd-5cc1-4a3d-b56e-37eb1eb99fe5 req-39721c8a-c7d5-45dd-a8f6-46697d9fd4f8 service nova] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Refreshing instance network info cache due to event network-changed-68286914-fc60-4ccc-a7c9-28c15f8fbaf4. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:37:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-02e085cd-5cc1-4a3d-b56e-37eb1eb99fe5 req-39721c8a-c7d5-45dd-a8f6-46697d9fd4f8 service nova] Acquiring lock "refresh_cache-d4a3995f-cd3e-41be-8901-876eefbe2bf3" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:37:50 user nova-compute[74247]: DEBUG nova.network.neutron [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG nova.network.neutron [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Updating instance_info_cache with network_info: [{"id": "68286914-fc60-4ccc-a7c9-28c15f8fbaf4", "address": "fa:16:3e:77:59:59", "network": {"id": "fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1988491128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96ced9d4c0c474fbc7edeed6f73324a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68286914-fc", "ovs_interfaceid": "68286914-fc60-4ccc-a7c9-28c15f8fbaf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Releasing lock "refresh_cache-d4a3995f-cd3e-41be-8901-876eefbe2bf3" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG nova.compute.manager [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Instance network_info: |[{"id": "68286914-fc60-4ccc-a7c9-28c15f8fbaf4", "address": "fa:16:3e:77:59:59", "network": {"id": "fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1988491128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96ced9d4c0c474fbc7edeed6f73324a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68286914-fc", "ovs_interfaceid": "68286914-fc60-4ccc-a7c9-28c15f8fbaf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-02e085cd-5cc1-4a3d-b56e-37eb1eb99fe5 req-39721c8a-c7d5-45dd-a8f6-46697d9fd4f8 service nova] Acquired lock "refresh_cache-d4a3995f-cd3e-41be-8901-876eefbe2bf3" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG nova.network.neutron [req-02e085cd-5cc1-4a3d-b56e-37eb1eb99fe5 req-39721c8a-c7d5-45dd-a8f6-46697d9fd4f8 service nova] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Refreshing network info cache for port 68286914-fc60-4ccc-a7c9-28c15f8fbaf4 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Start _get_guest_xml network_info=[{"id": "68286914-fc60-4ccc-a7c9-28c15f8fbaf4", "address": "fa:16:3e:77:59:59", "network": {"id": "fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1988491128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96ced9d4c0c474fbc7edeed6f73324a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68286914-fc", "ovs_interfaceid": "68286914-fc60-4ccc-a7c9-28c15f8fbaf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': '83126bb1-29f5-42fe-8620-72ab0797f776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:37:51 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:37:51 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:37:51 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:37:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1641719442',display_name='tempest-AttachVolumeNegativeTest-server-1641719442',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1641719442',id=28,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0opAjv/rnWQNgTWt1EWKYD3cHYUa4w2NcYl8C+PJ2CqgwCzHHyQUqb06qj65YJlCsjDCTEZJZ5aFEVG1MfIJ4I8f1zqnVAu8snshO6RRlGRKUwQ75iSRcABbbj51UHtA==',key_name='tempest-keypair-1748542013',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c96ced9d4c0c474fbc7edeed6f73324a',ramdisk_id='',reservation_id='r-lu7tl6o7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1731725928',owner_user_name='tempest-AttachVolumeNegativeTest-1731725928-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:37:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bd70613da1f489f86227655ff364795',uuid=d4a3995f-cd3e-41be-8901-876eefbe2bf3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68286914-fc60-4ccc-a7c9-28c15f8fbaf4", "address": "fa:16:3e:77:59:59", "network": {"id": "fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1988491128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96ced9d4c0c474fbc7edeed6f73324a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68286914-fc", "ovs_interfaceid": "68286914-fc60-4ccc-a7c9-28c15f8fbaf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Converting VIF {"id": "68286914-fc60-4ccc-a7c9-28c15f8fbaf4", "address": "fa:16:3e:77:59:59", "network": {"id": "fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1988491128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96ced9d4c0c474fbc7edeed6f73324a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68286914-fc", "ovs_interfaceid": "68286914-fc60-4ccc-a7c9-28c15f8fbaf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:59:59,bridge_name='br-int',has_traffic_filtering=True,id=68286914-fc60-4ccc-a7c9-28c15f8fbaf4,network=Network(fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68286914-fc') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG nova.objects.instance [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lazy-loading 'pci_devices' on Instance uuid d4a3995f-cd3e-41be-8901-876eefbe2bf3 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:37:51 user nova-compute[74247]:   <uuid>d4a3995f-cd3e-41be-8901-876eefbe2bf3</uuid>
Oct 16 18:37:51 user nova-compute[74247]:   <name>instance-0000001c</name>
Oct 16 18:37:51 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:37:51 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:37:51 user nova-compute[74247]:   <metadata>
Oct 16 18:37:51 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:37:51 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:37:51 user nova-compute[74247]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1641719442</nova:name>
Oct 16 18:37:51 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:37:51</nova:creationTime>
Oct 16 18:37:51 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:37:51 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:37:51 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:37:51 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:37:51 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:37:51 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:37:51 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:37:51 user nova-compute[74247]:       <nova:owner>
Oct 16 18:37:51 user nova-compute[74247]:         <nova:user uuid="5bd70613da1f489f86227655ff364795">tempest-AttachVolumeNegativeTest-1731725928-project-member</nova:user>
Oct 16 18:37:51 user nova-compute[74247]:         <nova:project uuid="c96ced9d4c0c474fbc7edeed6f73324a">tempest-AttachVolumeNegativeTest-1731725928</nova:project>
Oct 16 18:37:51 user nova-compute[74247]:       </nova:owner>
Oct 16 18:37:51 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:37:51 user nova-compute[74247]:       <nova:ports>
Oct 16 18:37:51 user nova-compute[74247]:         <nova:port uuid="68286914-fc60-4ccc-a7c9-28c15f8fbaf4">
Oct 16 18:37:51 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 16 18:37:51 user nova-compute[74247]:         </nova:port>
Oct 16 18:37:51 user nova-compute[74247]:       </nova:ports>
Oct 16 18:37:51 user nova-compute[74247]:     </nova:instance>
Oct 16 18:37:51 user nova-compute[74247]:   </metadata>
Oct 16 18:37:51 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:37:51 user nova-compute[74247]:     <system>
Oct 16 18:37:51 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:37:51 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:37:51 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:37:51 user nova-compute[74247]:       <entry name="serial">d4a3995f-cd3e-41be-8901-876eefbe2bf3</entry>
Oct 16 18:37:51 user nova-compute[74247]:       <entry name="uuid">d4a3995f-cd3e-41be-8901-876eefbe2bf3</entry>
Oct 16 18:37:51 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:37:51 user nova-compute[74247]:     </system>
Oct 16 18:37:51 user nova-compute[74247]:   </sysinfo>
Oct 16 18:37:51 user nova-compute[74247]:   <os>
Oct 16 18:37:51 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:37:51 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:37:51 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:37:51 user nova-compute[74247]:   </os>
Oct 16 18:37:51 user nova-compute[74247]:   <features>
Oct 16 18:37:51 user nova-compute[74247]:     <acpi/>
Oct 16 18:37:51 user nova-compute[74247]:     <apic/>
Oct 16 18:37:51 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:37:51 user nova-compute[74247]:   </features>
Oct 16 18:37:51 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:37:51 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:37:51 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:37:51 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:37:51 user nova-compute[74247]:   </clock>
Oct 16 18:37:51 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:37:51 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:37:51 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:37:51 user nova-compute[74247]:   </cpu>
Oct 16 18:37:51 user nova-compute[74247]:   <devices>
Oct 16 18:37:51 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:37:51 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:37:51 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/d4a3995f-cd3e-41be-8901-876eefbe2bf3/disk"/>
Oct 16 18:37:51 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:37:51 user nova-compute[74247]:     </disk>
Oct 16 18:37:51 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:37:51 user nova-compute[74247]:       <mac address="fa:16:3e:77:59:59"/>
Oct 16 18:37:51 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:37:51 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:37:51 user nova-compute[74247]:       <target dev="tap68286914-fc"/>
Oct 16 18:37:51 user nova-compute[74247]:     </interface>
Oct 16 18:37:51 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:37:51 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/d4a3995f-cd3e-41be-8901-876eefbe2bf3/console.log" append="off"/>
Oct 16 18:37:51 user nova-compute[74247]:     </serial>
Oct 16 18:37:51 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:37:51 user nova-compute[74247]:     <video>
Oct 16 18:37:51 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:37:51 user nova-compute[74247]:     </video>
Oct 16 18:37:51 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:37:51 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:37:51 user nova-compute[74247]:     </rng>
Oct 16 18:37:51 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:37:51 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:37:51 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:37:51 user nova-compute[74247]:     </memballoon>
Oct 16 18:37:51 user nova-compute[74247]:   </devices>
Oct 16 18:37:51 user nova-compute[74247]: </domain>
Oct 16 18:37:51 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:37:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1641719442',display_name='tempest-AttachVolumeNegativeTest-server-1641719442',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1641719442',id=28,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0opAjv/rnWQNgTWt1EWKYD3cHYUa4w2NcYl8C+PJ2CqgwCzHHyQUqb06qj65YJlCsjDCTEZJZ5aFEVG1MfIJ4I8f1zqnVAu8snshO6RRlGRKUwQ75iSRcABbbj51UHtA==',key_name='tempest-keypair-1748542013',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c96ced9d4c0c474fbc7edeed6f73324a',ramdisk_id='',reservation_id='r-lu7tl6o7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1731725928',owner_user_name='tempest-AttachVolumeNegativeTest-1731725928-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:37:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bd70613da1f489f86227655ff364795',uuid=d4a3995f-cd3e-41be-8901-876eefbe2bf3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68286914-fc60-4ccc-a7c9-28c15f8fbaf4", "address": "fa:16:3e:77:59:59", "network": {"id": "fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1988491128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96ced9d4c0c474fbc7edeed6f73324a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68286914-fc", "ovs_interfaceid": "68286914-fc60-4ccc-a7c9-28c15f8fbaf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Converting VIF {"id": "68286914-fc60-4ccc-a7c9-28c15f8fbaf4", "address": "fa:16:3e:77:59:59", "network": {"id": "fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1988491128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96ced9d4c0c474fbc7edeed6f73324a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68286914-fc", "ovs_interfaceid": "68286914-fc60-4ccc-a7c9-28c15f8fbaf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:59:59,bridge_name='br-int',has_traffic_filtering=True,id=68286914-fc60-4ccc-a7c9-28c15f8fbaf4,network=Network(fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68286914-fc') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG os_vif [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:59:59,bridge_name='br-int',has_traffic_filtering=True,id=68286914-fc60-4ccc-a7c9-28c15f8fbaf4,network=Network(fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68286914-fc') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9ea08321-f7e4-5c7e-854e-1ea057044db9', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68286914-fc, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap68286914-fc, col_values=(('qos', UUID('68985845-0d18-4da4-8f3e-e739ed96bb56')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap68286914-fc, col_values=(('external_ids', {'iface-id': '68286914-fc60-4ccc-a7c9-28c15f8fbaf4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:59:59', 'vm-uuid': 'd4a3995f-cd3e-41be-8901-876eefbe2bf3'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:51 user nova-compute[74247]: INFO os_vif [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:59:59,bridge_name='br-int',has_traffic_filtering=True,id=68286914-fc60-4ccc-a7c9-28c15f8fbaf4,network=Network(fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68286914-fc')
Oct 16 18:37:51 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] No VIF found with MAC fa:16:3e:77:59:59, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG nova.network.neutron [req-02e085cd-5cc1-4a3d-b56e-37eb1eb99fe5 req-39721c8a-c7d5-45dd-a8f6-46697d9fd4f8 service nova] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Updated VIF entry in instance network info cache for port 68286914-fc60-4ccc-a7c9-28c15f8fbaf4. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG nova.network.neutron [req-02e085cd-5cc1-4a3d-b56e-37eb1eb99fe5 req-39721c8a-c7d5-45dd-a8f6-46697d9fd4f8 service nova] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Updating instance_info_cache with network_info: [{"id": "68286914-fc60-4ccc-a7c9-28c15f8fbaf4", "address": "fa:16:3e:77:59:59", "network": {"id": "fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1988491128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96ced9d4c0c474fbc7edeed6f73324a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68286914-fc", "ovs_interfaceid": "68286914-fc60-4ccc-a7c9-28c15f8fbaf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:37:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-02e085cd-5cc1-4a3d-b56e-37eb1eb99fe5 req-39721c8a-c7d5-45dd-a8f6-46697d9fd4f8 service nova] Releasing lock "refresh_cache-d4a3995f-cd3e-41be-8901-876eefbe2bf3" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:37:52 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:52 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:53 user nova-compute[74247]: DEBUG nova.compute.manager [req-0ab3b0ac-fb58-4ec8-b2fd-561ef0c4f31d req-84f4c619-574e-4bb0-8b06-0f99a4c32df6 service nova] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Received event network-vif-plugged-68286914-fc60-4ccc-a7c9-28c15f8fbaf4 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:37:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0ab3b0ac-fb58-4ec8-b2fd-561ef0c4f31d req-84f4c619-574e-4bb0-8b06-0f99a4c32df6 service nova] Acquiring lock "d4a3995f-cd3e-41be-8901-876eefbe2bf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:37:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0ab3b0ac-fb58-4ec8-b2fd-561ef0c4f31d req-84f4c619-574e-4bb0-8b06-0f99a4c32df6 service nova] Lock "d4a3995f-cd3e-41be-8901-876eefbe2bf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:37:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0ab3b0ac-fb58-4ec8-b2fd-561ef0c4f31d req-84f4c619-574e-4bb0-8b06-0f99a4c32df6 service nova] Lock "d4a3995f-cd3e-41be-8901-876eefbe2bf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:37:53 user nova-compute[74247]: DEBUG nova.compute.manager [req-0ab3b0ac-fb58-4ec8-b2fd-561ef0c4f31d req-84f4c619-574e-4bb0-8b06-0f99a4c32df6 service nova] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] No waiting events found dispatching network-vif-plugged-68286914-fc60-4ccc-a7c9-28c15f8fbaf4 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:37:53 user nova-compute[74247]: WARNING nova.compute.manager [req-0ab3b0ac-fb58-4ec8-b2fd-561ef0c4f31d req-84f4c619-574e-4bb0-8b06-0f99a4c32df6 service nova] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Received unexpected event network-vif-plugged-68286914-fc60-4ccc-a7c9-28c15f8fbaf4 for instance with vm_state building and task_state spawning.
Oct 16 18:37:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:55 user nova-compute[74247]: DEBUG nova.compute.manager [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:37:55 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:37:55 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Instance spawned successfully.
Oct 16 18:37:55 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 18:37:55 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:37:55 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:37:55 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:37:55 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:37:55 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:37:55 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:37:55 user nova-compute[74247]: INFO nova.compute.manager [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Took 6.03 seconds to spawn the instance on the hypervisor.
Oct 16 18:37:55 user nova-compute[74247]: DEBUG nova.compute.manager [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:37:55 user nova-compute[74247]: DEBUG nova.compute.manager [req-f8426ff1-f3bd-4b75-a651-a89f97fa584f req-912844e4-acd4-49e5-8141-75b915a22cd0 service nova] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Received event network-vif-plugged-68286914-fc60-4ccc-a7c9-28c15f8fbaf4 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:37:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f8426ff1-f3bd-4b75-a651-a89f97fa584f req-912844e4-acd4-49e5-8141-75b915a22cd0 service nova] Acquiring lock "d4a3995f-cd3e-41be-8901-876eefbe2bf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:37:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f8426ff1-f3bd-4b75-a651-a89f97fa584f req-912844e4-acd4-49e5-8141-75b915a22cd0 service nova] Lock "d4a3995f-cd3e-41be-8901-876eefbe2bf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:37:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f8426ff1-f3bd-4b75-a651-a89f97fa584f req-912844e4-acd4-49e5-8141-75b915a22cd0 service nova] Lock "d4a3995f-cd3e-41be-8901-876eefbe2bf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:37:55 user nova-compute[74247]: DEBUG nova.compute.manager [req-f8426ff1-f3bd-4b75-a651-a89f97fa584f req-912844e4-acd4-49e5-8141-75b915a22cd0 service nova] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] No waiting events found dispatching network-vif-plugged-68286914-fc60-4ccc-a7c9-28c15f8fbaf4 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:37:55 user nova-compute[74247]: WARNING nova.compute.manager [req-f8426ff1-f3bd-4b75-a651-a89f97fa584f req-912844e4-acd4-49e5-8141-75b915a22cd0 service nova] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Received unexpected event network-vif-plugged-68286914-fc60-4ccc-a7c9-28c15f8fbaf4 for instance with vm_state building and task_state spawning.
Oct 16 18:37:55 user nova-compute[74247]: INFO nova.compute.manager [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Took 6.77 seconds to build instance.
Oct 16 18:37:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f058a7ec-e57c-4190-8e3b-9e10bf153ac4 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "d4a3995f-cd3e-41be-8901-876eefbe2bf3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.862s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:37:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:37:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:00 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:38:00 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:38:00 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:38:00 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:38:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:38:02 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:38:02 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 18:38:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "refresh_cache-958af87e-69d0-4da1-8fcf-90e0f275d62e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:38:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquired lock "refresh_cache-958af87e-69d0-4da1-8fcf-90e0f275d62e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:38:02 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Forcefully refreshing network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 18:38:03 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Updating instance_info_cache with network_info: [{"id": "4457ec1e-80ee-4038-9838-3af879097230", "address": "fa:16:3e:fb:7d:a8", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4457ec1e-80", "ovs_interfaceid": "4457ec1e-80ee-4038-9838-3af879097230", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:38:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Releasing lock "refresh_cache-958af87e-69d0-4da1-8fcf-90e0f275d62e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:38:03 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Updated the network info_cache for instance {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 18:38:03 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:38:03 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:38:04 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:38:04 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:38:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:38:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:38:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:38:04 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 18:38:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:38:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:38:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:38:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:38:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:38:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:38:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:38:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:38:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:38:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:38:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:38:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:38:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:38:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:38:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbdb3c4c-7a6f-4966-bc13-049efe0cded2/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:38:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbdb3c4c-7a6f-4966-bc13-049efe0cded2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:38:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbdb3c4c-7a6f-4966-bc13-049efe0cded2/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:38:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbdb3c4c-7a6f-4966-bc13-049efe0cded2/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:38:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk.rescue --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:38:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:38:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk.rescue --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:38:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:38:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:38:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:38:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:38:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:38:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:38:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:38:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:38:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:38:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4a3995f-cd3e-41be-8901-876eefbe2bf3/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:38:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4a3995f-cd3e-41be-8901-876eefbe2bf3/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:38:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4a3995f-cd3e-41be-8901-876eefbe2bf3/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:38:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4a3995f-cd3e-41be-8901-876eefbe2bf3/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:38:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:38:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:38:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:38:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:38:08 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:38:08 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:38:08 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=7789MB free_disk=25.088146209716797GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 18:38:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:38:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:38:08 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance e37fbc27-3404-479a-be08-4d590391cf30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:38:08 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance cddf4842-1c25-4cc8-914e-af30849e4d6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:38:08 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 958af87e-69d0-4da1-8fcf-90e0f275d62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:38:08 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance d775101d-53a1-48c7-af24-91480be6af61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:38:08 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 7dcc08e9-7439-436b-8d9f-facaf04e22c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:38:08 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance cbdb3c4c-7a6f-4966-bc13-049efe0cded2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:38:08 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:38:08 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 88ea9961-7a1d-4193-b72f-63e398752141 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:38:08 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance d4a3995f-cd3e-41be-8901-876eefbe2bf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:38:08 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 18:38:08 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 18:38:09 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:38:09 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:38:09 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 18:38:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.384s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:38:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:14 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:38:14 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 18:38:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:23 user nova-compute[74247]: DEBUG nova.compute.manager [req-e651f0c0-1809-48e7-bfd0-caa80026a7b1 req-0c0d87a9-baeb-4137-9e86-997cf80e2051 service nova] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Received event network-changed-867368eb-89d8-4de5-a8cd-9a1435b624fb {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:38:23 user nova-compute[74247]: DEBUG nova.compute.manager [req-e651f0c0-1809-48e7-bfd0-caa80026a7b1 req-0c0d87a9-baeb-4137-9e86-997cf80e2051 service nova] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Refreshing instance network info cache due to event network-changed-867368eb-89d8-4de5-a8cd-9a1435b624fb. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:38:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e651f0c0-1809-48e7-bfd0-caa80026a7b1 req-0c0d87a9-baeb-4137-9e86-997cf80e2051 service nova] Acquiring lock "refresh_cache-cbdb3c4c-7a6f-4966-bc13-049efe0cded2" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:38:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e651f0c0-1809-48e7-bfd0-caa80026a7b1 req-0c0d87a9-baeb-4137-9e86-997cf80e2051 service nova] Acquired lock "refresh_cache-cbdb3c4c-7a6f-4966-bc13-049efe0cded2" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:38:23 user nova-compute[74247]: DEBUG nova.network.neutron [req-e651f0c0-1809-48e7-bfd0-caa80026a7b1 req-0c0d87a9-baeb-4137-9e86-997cf80e2051 service nova] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Refreshing network info cache for port 867368eb-89d8-4de5-a8cd-9a1435b624fb {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:38:24 user nova-compute[74247]: DEBUG nova.network.neutron [req-e651f0c0-1809-48e7-bfd0-caa80026a7b1 req-0c0d87a9-baeb-4137-9e86-997cf80e2051 service nova] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Updated VIF entry in instance network info cache for port 867368eb-89d8-4de5-a8cd-9a1435b624fb. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:38:24 user nova-compute[74247]: DEBUG nova.network.neutron [req-e651f0c0-1809-48e7-bfd0-caa80026a7b1 req-0c0d87a9-baeb-4137-9e86-997cf80e2051 service nova] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Updating instance_info_cache with network_info: [{"id": "867368eb-89d8-4de5-a8cd-9a1435b624fb", "address": "fa:16:3e:61:36:9f", "network": {"id": "88a1b265-5360-4362-90bc-3506f805688f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-620663417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5204c1aec5764c298a206429645eb268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867368eb-89", "ovs_interfaceid": "867368eb-89d8-4de5-a8cd-9a1435b624fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:38:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e651f0c0-1809-48e7-bfd0-caa80026a7b1 req-0c0d87a9-baeb-4137-9e86-997cf80e2051 service nova] Releasing lock "refresh_cache-cbdb3c4c-7a6f-4966-bc13-049efe0cded2" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:38:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:31 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a0680900-98e5-439a-90cf-e662fe50d68e tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquiring lock "cbdb3c4c-7a6f-4966-bc13-049efe0cded2" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:38:31 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a0680900-98e5-439a-90cf-e662fe50d68e tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "cbdb3c4c-7a6f-4966-bc13-049efe0cded2" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:38:31 user nova-compute[74247]: INFO nova.compute.manager [None req-a0680900-98e5-439a-90cf-e662fe50d68e tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Shelving
Oct 16 18:38:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:31 user nova-compute[74247]: DEBUG nova.compute.manager [req-bd77ffbc-f8c1-4f5a-a92c-568f6c011013 req-f2192ca5-3a28-4688-8022-19fa47c224a6 service nova] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Received event network-vif-unplugged-867368eb-89d8-4de5-a8cd-9a1435b624fb {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:38:31 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-bd77ffbc-f8c1-4f5a-a92c-568f6c011013 req-f2192ca5-3a28-4688-8022-19fa47c224a6 service nova] Acquiring lock "cbdb3c4c-7a6f-4966-bc13-049efe0cded2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:38:31 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-bd77ffbc-f8c1-4f5a-a92c-568f6c011013 req-f2192ca5-3a28-4688-8022-19fa47c224a6 service nova] Lock "cbdb3c4c-7a6f-4966-bc13-049efe0cded2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:38:31 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-bd77ffbc-f8c1-4f5a-a92c-568f6c011013 req-f2192ca5-3a28-4688-8022-19fa47c224a6 service nova] Lock "cbdb3c4c-7a6f-4966-bc13-049efe0cded2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:38:31 user nova-compute[74247]: DEBUG nova.compute.manager [req-bd77ffbc-f8c1-4f5a-a92c-568f6c011013 req-f2192ca5-3a28-4688-8022-19fa47c224a6 service nova] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] No waiting events found dispatching network-vif-unplugged-867368eb-89d8-4de5-a8cd-9a1435b624fb {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:38:31 user nova-compute[74247]: WARNING nova.compute.manager [req-bd77ffbc-f8c1-4f5a-a92c-568f6c011013 req-f2192ca5-3a28-4688-8022-19fa47c224a6 service nova] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Received unexpected event network-vif-unplugged-867368eb-89d8-4de5-a8cd-9a1435b624fb for instance with vm_state active and task_state shelving.
Oct 16 18:38:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:32 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Instance destroyed successfully.
Oct 16 18:38:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:32 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-a0680900-98e5-439a-90cf-e662fe50d68e tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Beginning cold snapshot process
Oct 16 18:38:32 user nova-compute[74247]: DEBUG nova.privsep.utils [None req-a0680900-98e5-439a-90cf-e662fe50d68e tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74247) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 18:38:32 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-a0680900-98e5-439a-90cf-e662fe50d68e tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/cbdb3c4c-7a6f-4966-bc13-049efe0cded2/disk /opt/stack/data/nova/instances/snapshots/tmpsf6ytcei/b5df5eb817184fe39e2d052008f4f33a {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:38:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-a0680900-98e5-439a-90cf-e662fe50d68e tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/cbdb3c4c-7a6f-4966-bc13-049efe0cded2/disk /opt/stack/data/nova/instances/snapshots/tmpsf6ytcei/b5df5eb817184fe39e2d052008f4f33a" returned: 0 in 0.837s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:38:33 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-a0680900-98e5-439a-90cf-e662fe50d68e tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Snapshot extracted, beginning image upload
Oct 16 18:38:33 user nova-compute[74247]: DEBUG nova.compute.manager [req-12d1e7f9-e908-4862-941e-ca94d0bb8b92 req-06b15300-0f41-4cc4-b4af-b73c4bd1b939 service nova] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Received event network-vif-plugged-867368eb-89d8-4de5-a8cd-9a1435b624fb {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:38:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-12d1e7f9-e908-4862-941e-ca94d0bb8b92 req-06b15300-0f41-4cc4-b4af-b73c4bd1b939 service nova] Acquiring lock "cbdb3c4c-7a6f-4966-bc13-049efe0cded2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:38:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-12d1e7f9-e908-4862-941e-ca94d0bb8b92 req-06b15300-0f41-4cc4-b4af-b73c4bd1b939 service nova] Lock "cbdb3c4c-7a6f-4966-bc13-049efe0cded2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:38:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-12d1e7f9-e908-4862-941e-ca94d0bb8b92 req-06b15300-0f41-4cc4-b4af-b73c4bd1b939 service nova] Lock "cbdb3c4c-7a6f-4966-bc13-049efe0cded2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:38:33 user nova-compute[74247]: DEBUG nova.compute.manager [req-12d1e7f9-e908-4862-941e-ca94d0bb8b92 req-06b15300-0f41-4cc4-b4af-b73c4bd1b939 service nova] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] No waiting events found dispatching network-vif-plugged-867368eb-89d8-4de5-a8cd-9a1435b624fb {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:38:33 user nova-compute[74247]: WARNING nova.compute.manager [req-12d1e7f9-e908-4862-941e-ca94d0bb8b92 req-06b15300-0f41-4cc4-b4af-b73c4bd1b939 service nova] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Received unexpected event network-vif-plugged-867368eb-89d8-4de5-a8cd-9a1435b624fb for instance with vm_state active and task_state shelving_image_uploading.
Oct 16 18:38:35 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-a0680900-98e5-439a-90cf-e662fe50d68e tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Snapshot image upload complete
Oct 16 18:38:35 user nova-compute[74247]: DEBUG nova.compute.manager [None req-a0680900-98e5-439a-90cf-e662fe50d68e tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:38:35 user nova-compute[74247]: INFO nova.compute.manager [None req-a0680900-98e5-439a-90cf-e662fe50d68e tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Shelve offloading
Oct 16 18:38:35 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Instance destroyed successfully.
Oct 16 18:38:35 user nova-compute[74247]: DEBUG nova.compute.manager [None req-a0680900-98e5-439a-90cf-e662fe50d68e tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:38:35 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a0680900-98e5-439a-90cf-e662fe50d68e tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquiring lock "refresh_cache-cbdb3c4c-7a6f-4966-bc13-049efe0cded2" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:38:35 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a0680900-98e5-439a-90cf-e662fe50d68e tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquired lock "refresh_cache-cbdb3c4c-7a6f-4966-bc13-049efe0cded2" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:38:35 user nova-compute[74247]: DEBUG nova.network.neutron [None req-a0680900-98e5-439a-90cf-e662fe50d68e tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:38:36 user nova-compute[74247]: DEBUG nova.network.neutron [None req-a0680900-98e5-439a-90cf-e662fe50d68e tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Updating instance_info_cache with network_info: [{"id": "867368eb-89d8-4de5-a8cd-9a1435b624fb", "address": "fa:16:3e:61:36:9f", "network": {"id": "88a1b265-5360-4362-90bc-3506f805688f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-620663417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5204c1aec5764c298a206429645eb268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867368eb-89", "ovs_interfaceid": "867368eb-89d8-4de5-a8cd-9a1435b624fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:38:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a0680900-98e5-439a-90cf-e662fe50d68e tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Releasing lock "refresh_cache-cbdb3c4c-7a6f-4966-bc13-049efe0cded2" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:38:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:36 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Instance destroyed successfully.
Oct 16 18:38:36 user nova-compute[74247]: DEBUG nova.objects.instance [None req-a0680900-98e5-439a-90cf-e662fe50d68e tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lazy-loading 'resources' on Instance uuid cbdb3c4c-7a6f-4966-bc13-049efe0cded2 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:38:36 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-a0680900-98e5-439a-90cf-e662fe50d68e tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:36:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-803649508',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-803649508',id=25,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPt8RnxxjMin5ow9n0gYco5PnH7fBvzjVT+zJBAuIfIL73SFyQOt4/yFyMr89xqJ/fI+kazkxk5AA5YPdknlG4FiNoYepFgnFcnJNQU4P+bwfVCqmJXmT/tM+RcLA45aFQ==',key_name='tempest-keypair-1823297427',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:36:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5204c1aec5764c298a206429645eb268',ramdisk_id='',reservation_id='r-cnkbq1wz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-537076068',owner_user_name='tempest-AttachVolumeShelveTestJSON-537076068-project-member',shelved_at='2023-10-16T18:38:35.775297',shelved_host='user',shelved_image_id='1d90996e-c523-4d83-9407-5415a6eea9ad'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:38:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bda4c43b45347be96b152caba47b07d',uuid=cbdb3c4c-7a6f-4966-bc13-049efe0cded2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "867368eb-89d8-4de5-a8cd-9a1435b624fb", "address": "fa:16:3e:61:36:9f", "network": {"id": "88a1b265-5360-4362-90bc-3506f805688f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-620663417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5204c1aec5764c298a206429645eb268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867368eb-89", "ovs_interfaceid": "867368eb-89d8-4de5-a8cd-9a1435b624fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:38:36 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-a0680900-98e5-439a-90cf-e662fe50d68e tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Converting VIF {"id": "867368eb-89d8-4de5-a8cd-9a1435b624fb", "address": "fa:16:3e:61:36:9f", "network": {"id": "88a1b265-5360-4362-90bc-3506f805688f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-620663417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5204c1aec5764c298a206429645eb268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867368eb-89", "ovs_interfaceid": "867368eb-89d8-4de5-a8cd-9a1435b624fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:38:36 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-a0680900-98e5-439a-90cf-e662fe50d68e tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:36:9f,bridge_name='br-int',has_traffic_filtering=True,id=867368eb-89d8-4de5-a8cd-9a1435b624fb,network=Network(88a1b265-5360-4362-90bc-3506f805688f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867368eb-89') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:38:36 user nova-compute[74247]: DEBUG os_vif [None req-a0680900-98e5-439a-90cf-e662fe50d68e tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:36:9f,bridge_name='br-int',has_traffic_filtering=True,id=867368eb-89d8-4de5-a8cd-9a1435b624fb,network=Network(88a1b265-5360-4362-90bc-3506f805688f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867368eb-89') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:38:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap867368eb-89, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:38:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:38:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d0b79a48-75e9-4bfe-86a1-e1b1ae988bd5) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:38:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:38:36 user nova-compute[74247]: DEBUG nova.compute.manager [req-ddb7caa2-d490-4401-8c2a-1a7500f67162 req-1f75452b-f649-4c25-b854-253939fcb807 service nova] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Received event network-changed-867368eb-89d8-4de5-a8cd-9a1435b624fb {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:38:36 user nova-compute[74247]: DEBUG nova.compute.manager [req-ddb7caa2-d490-4401-8c2a-1a7500f67162 req-1f75452b-f649-4c25-b854-253939fcb807 service nova] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Refreshing instance network info cache due to event network-changed-867368eb-89d8-4de5-a8cd-9a1435b624fb. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:38:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-ddb7caa2-d490-4401-8c2a-1a7500f67162 req-1f75452b-f649-4c25-b854-253939fcb807 service nova] Acquiring lock "refresh_cache-cbdb3c4c-7a6f-4966-bc13-049efe0cded2" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:38:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-ddb7caa2-d490-4401-8c2a-1a7500f67162 req-1f75452b-f649-4c25-b854-253939fcb807 service nova] Acquired lock "refresh_cache-cbdb3c4c-7a6f-4966-bc13-049efe0cded2" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:38:36 user nova-compute[74247]: DEBUG nova.network.neutron [req-ddb7caa2-d490-4401-8c2a-1a7500f67162 req-1f75452b-f649-4c25-b854-253939fcb807 service nova] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Refreshing network info cache for port 867368eb-89d8-4de5-a8cd-9a1435b624fb {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:38:36 user nova-compute[74247]: INFO os_vif [None req-a0680900-98e5-439a-90cf-e662fe50d68e tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:36:9f,bridge_name='br-int',has_traffic_filtering=True,id=867368eb-89d8-4de5-a8cd-9a1435b624fb,network=Network(88a1b265-5360-4362-90bc-3506f805688f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867368eb-89')
Oct 16 18:38:36 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-a0680900-98e5-439a-90cf-e662fe50d68e tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Deleting instance files /opt/stack/data/nova/instances/cbdb3c4c-7a6f-4966-bc13-049efe0cded2_del
Oct 16 18:38:37 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-a0680900-98e5-439a-90cf-e662fe50d68e tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Deletion of /opt/stack/data/nova/instances/cbdb3c4c-7a6f-4966-bc13-049efe0cded2_del complete
Oct 16 18:38:37 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-a0680900-98e5-439a-90cf-e662fe50d68e tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Deleted allocations for instance cbdb3c4c-7a6f-4966-bc13-049efe0cded2
Oct 16 18:38:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a0680900-98e5-439a-90cf-e662fe50d68e tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:38:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a0680900-98e5-439a-90cf-e662fe50d68e tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:38:37 user nova-compute[74247]: DEBUG nova.objects.instance [None req-a0680900-98e5-439a-90cf-e662fe50d68e tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lazy-loading 'numa_topology' on Instance uuid cbdb3c4c-7a6f-4966-bc13-049efe0cded2 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:38:37 user nova-compute[74247]: DEBUG nova.objects.base [None req-a0680900-98e5-439a-90cf-e662fe50d68e tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Object Instance<cbdb3c4c-7a6f-4966-bc13-049efe0cded2> lazy-loaded attributes: resources,numa_topology {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:38:37 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-a0680900-98e5-439a-90cf-e662fe50d68e tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:38:37 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-a0680900-98e5-439a-90cf-e662fe50d68e tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:38:37 user nova-compute[74247]: DEBUG nova.network.neutron [req-ddb7caa2-d490-4401-8c2a-1a7500f67162 req-1f75452b-f649-4c25-b854-253939fcb807 service nova] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Updated VIF entry in instance network info cache for port 867368eb-89d8-4de5-a8cd-9a1435b624fb. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:38:37 user nova-compute[74247]: DEBUG nova.network.neutron [req-ddb7caa2-d490-4401-8c2a-1a7500f67162 req-1f75452b-f649-4c25-b854-253939fcb807 service nova] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Updating instance_info_cache with network_info: [{"id": "867368eb-89d8-4de5-a8cd-9a1435b624fb", "address": "fa:16:3e:61:36:9f", "network": {"id": "88a1b265-5360-4362-90bc-3506f805688f", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-620663417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5204c1aec5764c298a206429645eb268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap867368eb-89", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:38:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a0680900-98e5-439a-90cf-e662fe50d68e tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.305s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:38:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-ddb7caa2-d490-4401-8c2a-1a7500f67162 req-1f75452b-f649-4c25-b854-253939fcb807 service nova] Releasing lock "refresh_cache-cbdb3c4c-7a6f-4966-bc13-049efe0cded2" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:38:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a0680900-98e5-439a-90cf-e662fe50d68e tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "cbdb3c4c-7a6f-4966-bc13-049efe0cded2" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.060s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:38:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:42 user nova-compute[74247]: DEBUG nova.compute.manager [req-5b79a3be-6724-43f4-90cd-2dadd5f2b975 req-2256b20d-6797-421b-b195-024eb36fefbf service nova] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Received event network-changed-15e062f0-b415-4b0d-abe3-eb3f3fb38761 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:38:42 user nova-compute[74247]: DEBUG nova.compute.manager [req-5b79a3be-6724-43f4-90cd-2dadd5f2b975 req-2256b20d-6797-421b-b195-024eb36fefbf service nova] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Refreshing instance network info cache due to event network-changed-15e062f0-b415-4b0d-abe3-eb3f3fb38761. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:38:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-5b79a3be-6724-43f4-90cd-2dadd5f2b975 req-2256b20d-6797-421b-b195-024eb36fefbf service nova] Acquiring lock "refresh_cache-2589b875-41d7-4d8e-9b35-8840dd5d3ac2" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:38:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-5b79a3be-6724-43f4-90cd-2dadd5f2b975 req-2256b20d-6797-421b-b195-024eb36fefbf service nova] Acquired lock "refresh_cache-2589b875-41d7-4d8e-9b35-8840dd5d3ac2" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:38:42 user nova-compute[74247]: DEBUG nova.network.neutron [req-5b79a3be-6724-43f4-90cd-2dadd5f2b975 req-2256b20d-6797-421b-b195-024eb36fefbf service nova] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Refreshing network info cache for port 15e062f0-b415-4b0d-abe3-eb3f3fb38761 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:38:43 user nova-compute[74247]: DEBUG nova.network.neutron [req-5b79a3be-6724-43f4-90cd-2dadd5f2b975 req-2256b20d-6797-421b-b195-024eb36fefbf service nova] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Updated VIF entry in instance network info cache for port 15e062f0-b415-4b0d-abe3-eb3f3fb38761. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:38:43 user nova-compute[74247]: DEBUG nova.network.neutron [req-5b79a3be-6724-43f4-90cd-2dadd5f2b975 req-2256b20d-6797-421b-b195-024eb36fefbf service nova] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Updating instance_info_cache with network_info: [{"id": "15e062f0-b415-4b0d-abe3-eb3f3fb38761", "address": "fa:16:3e:d7:26:52", "network": {"id": "c2bd79d9-3793-4e55-b351-f6c16468a347", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2030561886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2f559ca43548d7ab27cdf82968c3c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e062f0-b4", "ovs_interfaceid": "15e062f0-b415-4b0d-abe3-eb3f3fb38761", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:38:43 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-5b79a3be-6724-43f4-90cd-2dadd5f2b975 req-2256b20d-6797-421b-b195-024eb36fefbf service nova] Releasing lock "refresh_cache-2589b875-41d7-4d8e-9b35-8840dd5d3ac2" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:38:46 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:46 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Acquiring lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:38:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:38:48 user nova-compute[74247]: DEBUG nova.objects.instance [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lazy-loading 'flavor' on Instance uuid 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:38:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.343s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:38:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Acquiring lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:38:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:38:49 user nova-compute[74247]: INFO nova.compute.manager [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Attaching volume 5f6ea7d3-1870-4dd4-aed5-f296ce384273 to /dev/vdb
Oct 16 18:38:49 user nova-compute[74247]: DEBUG os_brick.utils [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:38:49 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:38:49 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:38:49 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f404499-2110-483f-92fc-7b9c5f954546]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:38:49 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:38:49 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:38:49 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26b0dd0-d1c8-4332-aba5-e63b2a2bfeac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:38:49 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:38:49 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:38:49 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27ea8d8-11dc-4f6d-ba28-3abe0be882fa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:38:49 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb7b957-fa0f-4c55-85aa-ed2a356e2c25]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:38:49 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:38:49 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:38:49 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 18:38:49 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:38:49 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:38:49 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 18:38:49 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fb48da-d22b-42f1-849c-bed83f679686]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:38:49 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 18:38:49 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 18:38:49 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 18:38:49 user nova-compute[74247]: DEBUG os_brick.utils [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:38:49 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Updating existing volume attachment record: dc2f0d04-4ab5-442f-a390-8d7d484383c3 {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 18:38:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:52 user nova-compute[74247]: DEBUG nova.compute.manager [req-097ea612-ba03-416a-9a04-b7e5d504dd1d req-4be4c072-f664-4028-bf2a-d1b590bed254 service nova] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Received event network-changed-634511f9-ce96-4fe6-8bfc-51846e4dcb4f {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:38:52 user nova-compute[74247]: DEBUG nova.compute.manager [req-097ea612-ba03-416a-9a04-b7e5d504dd1d req-4be4c072-f664-4028-bf2a-d1b590bed254 service nova] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Refreshing instance network info cache due to event network-changed-634511f9-ce96-4fe6-8bfc-51846e4dcb4f. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:38:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-097ea612-ba03-416a-9a04-b7e5d504dd1d req-4be4c072-f664-4028-bf2a-d1b590bed254 service nova] Acquiring lock "refresh_cache-e37fbc27-3404-479a-be08-4d590391cf30" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:38:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-097ea612-ba03-416a-9a04-b7e5d504dd1d req-4be4c072-f664-4028-bf2a-d1b590bed254 service nova] Acquired lock "refresh_cache-e37fbc27-3404-479a-be08-4d590391cf30" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:38:52 user nova-compute[74247]: DEBUG nova.network.neutron [req-097ea612-ba03-416a-9a04-b7e5d504dd1d req-4be4c072-f664-4028-bf2a-d1b590bed254 service nova] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Refreshing network info cache for port 634511f9-ce96-4fe6-8bfc-51846e4dcb4f {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:38:52 user nova-compute[74247]: DEBUG nova.network.neutron [req-097ea612-ba03-416a-9a04-b7e5d504dd1d req-4be4c072-f664-4028-bf2a-d1b590bed254 service nova] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Updated VIF entry in instance network info cache for port 634511f9-ce96-4fe6-8bfc-51846e4dcb4f. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:38:52 user nova-compute[74247]: DEBUG nova.network.neutron [req-097ea612-ba03-416a-9a04-b7e5d504dd1d req-4be4c072-f664-4028-bf2a-d1b590bed254 service nova] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Updating instance_info_cache with network_info: [{"id": "634511f9-ce96-4fe6-8bfc-51846e4dcb4f", "address": "fa:16:3e:d2:d2:f4", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634511f9-ce", "ovs_interfaceid": "634511f9-ce96-4fe6-8bfc-51846e4dcb4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:38:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-097ea612-ba03-416a-9a04-b7e5d504dd1d req-4be4c072-f664-4028-bf2a-d1b590bed254 service nova] Releasing lock "refresh_cache-e37fbc27-3404-479a-be08-4d590391cf30" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:38:53 user nova-compute[74247]: DEBUG nova.compute.manager [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Stashing vm_state: active {{(pid=74247) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 16 18:38:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:38:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:38:54 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:38:54 user nova-compute[74247]: INFO nova.compute.claims [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Claim successful on node user
Oct 16 18:38:54 user nova-compute[74247]: INFO nova.compute.resource_tracker [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Updating resource usage from migration 36967c71-3398-4e6f-9e8b-1cdc93a6ac56
Oct 16 18:38:54 user nova-compute[74247]: DEBUG nova.compute.manager [req-bea2a775-0ff9-49ea-87a1-db3651a75ed9 req-5a38cd79-657b-45e4-8e54-79100cc3704d service nova] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Received event network-changed-f5845781-33be-4018-bc2c-72bb980ad8c8 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:38:54 user nova-compute[74247]: DEBUG nova.compute.manager [req-bea2a775-0ff9-49ea-87a1-db3651a75ed9 req-5a38cd79-657b-45e4-8e54-79100cc3704d service nova] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Refreshing instance network info cache due to event network-changed-f5845781-33be-4018-bc2c-72bb980ad8c8. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:38:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-bea2a775-0ff9-49ea-87a1-db3651a75ed9 req-5a38cd79-657b-45e4-8e54-79100cc3704d service nova] Acquiring lock "refresh_cache-88ea9961-7a1d-4193-b72f-63e398752141" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:38:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-bea2a775-0ff9-49ea-87a1-db3651a75ed9 req-5a38cd79-657b-45e4-8e54-79100cc3704d service nova] Acquired lock "refresh_cache-88ea9961-7a1d-4193-b72f-63e398752141" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:38:54 user nova-compute[74247]: DEBUG nova.network.neutron [req-bea2a775-0ff9-49ea-87a1-db3651a75ed9 req-5a38cd79-657b-45e4-8e54-79100cc3704d service nova] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Refreshing network info cache for port f5845781-33be-4018-bc2c-72bb980ad8c8 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:38:54 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:38:54 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:38:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.413s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:38:54 user nova-compute[74247]: INFO nova.compute.manager [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Migrating
Oct 16 18:38:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "refresh_cache-88ea9961-7a1d-4193-b72f-63e398752141" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:38:54 user nova-compute[74247]: DEBUG nova.network.neutron [req-bea2a775-0ff9-49ea-87a1-db3651a75ed9 req-5a38cd79-657b-45e4-8e54-79100cc3704d service nova] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Updated VIF entry in instance network info cache for port f5845781-33be-4018-bc2c-72bb980ad8c8. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:38:54 user nova-compute[74247]: DEBUG nova.network.neutron [req-bea2a775-0ff9-49ea-87a1-db3651a75ed9 req-5a38cd79-657b-45e4-8e54-79100cc3704d service nova] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Updating instance_info_cache with network_info: [{"id": "f5845781-33be-4018-bc2c-72bb980ad8c8", "address": "fa:16:3e:92:70:e9", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5845781-33", "ovs_interfaceid": "f5845781-33be-4018-bc2c-72bb980ad8c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:38:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-bea2a775-0ff9-49ea-87a1-db3651a75ed9 req-5a38cd79-657b-45e4-8e54-79100cc3704d service nova] Releasing lock "refresh_cache-88ea9961-7a1d-4193-b72f-63e398752141" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:38:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquired lock "refresh_cache-88ea9961-7a1d-4193-b72f-63e398752141" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:38:54 user nova-compute[74247]: DEBUG nova.network.neutron [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:38:55 user nova-compute[74247]: DEBUG nova.network.neutron [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Updating instance_info_cache with network_info: [{"id": "f5845781-33be-4018-bc2c-72bb980ad8c8", "address": "fa:16:3e:92:70:e9", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5845781-33", "ovs_interfaceid": "f5845781-33be-4018-bc2c-72bb980ad8c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:38:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Releasing lock "refresh_cache-88ea9961-7a1d-4193-b72f-63e398752141" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:38:55 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Starting migrate_disk_and_power_off {{(pid=74247) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 16 18:38:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:56 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Instance destroyed successfully.
Oct 16 18:38:56 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1833793690',display_name='tempest-ServerActionsTestOtherA-server-1833793690',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1833793690',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/sQ/2CMkopvPZot1Iryii0p1Iq3sQgAbR+a1zff3LwsTrC97Bkir58aQPXckuRP2Pk52sgcmyihyOLiY8s4svRhqknfDOoanrdDaAunocHU/6uHElK38rY7fNKG4cJVA==',key_name='tempest-keypair-869426560',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:37:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='42bd3eb752f04fd48dfe0623fdf2fe9f',ramdisk_id='',reservation_id='r-b3ywbhfa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-291765974',owner_user_name='tempest-ServerActionsTestOtherA-291765974-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:38:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3635a30f06234f0d9a8e0604c25f1208',uuid=88ea9961-7a1d-4193-b72f-63e398752141,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5845781-33be-4018-bc2c-72bb980ad8c8", "address": "fa:16:3e:92:70:e9", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1201038774-network", "vif_mac": "fa:16:3e:92:70:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5845781-33", "ovs_interfaceid": "f5845781-33be-4018-bc2c-72bb980ad8c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Converting VIF {"id": "f5845781-33be-4018-bc2c-72bb980ad8c8", "address": "fa:16:3e:92:70:e9", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1201038774-network", "vif_mac": "fa:16:3e:92:70:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5845781-33", "ovs_interfaceid": "f5845781-33be-4018-bc2c-72bb980ad8c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:70:e9,bridge_name='br-int',has_traffic_filtering=True,id=f5845781-33be-4018-bc2c-72bb980ad8c8,network=Network(0a61bae1-2607-4e42-b573-e74ac3edf09a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5845781-33') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG os_vif [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:70:e9,bridge_name='br-int',has_traffic_filtering=True,id=f5845781-33be-4018-bc2c-72bb980ad8c8,network=Network(0a61bae1-2607-4e42-b573-e74ac3edf09a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5845781-33') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5845781-33, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9ff5e9a1-df33-425d-bc5d-a571228e54e1) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:56 user nova-compute[74247]: INFO os_vif [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:70:e9,bridge_name='br-int',has_traffic_filtering=True,id=f5845781-33be-4018-bc2c-72bb980ad8c8,network=Network(0a61bae1-2607-4e42-b573-e74ac3edf09a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5845781-33')
Oct 16 18:38:56 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wXPfgxSi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:38:56 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:38:56 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[592fe320-79c2-4c6e-9f46-eff3296e8caf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 18:38:56 user nova-compute[74247]: No targets found.
Oct 16 18:38:56 user nova-compute[74247]: iSNS:
Oct 16 18:38:56 user nova-compute[74247]: No targets found.
Oct 16 18:38:56 user nova-compute[74247]: STATIC:
Oct 16 18:38:56 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa
Oct 16 18:38:56 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:38:56 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:38:56 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc
Oct 16 18:38:56 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:38:56 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:38:56 user nova-compute[74247]: FIRMWARE:
Oct 16 18:38:56 user nova-compute[74247]: No targets found.
Oct 16 18:38:56 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 18:38:56 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 18:38:56 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7554e654-5e32-4b06-97d7-73ce5255cc77]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[41604984-35db-4495-97ab-f9ea1ca8387d]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:38:56 user nova-compute[74247]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)
Oct 16 18:38:56 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:38:56 user nova-compute[74247]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)
Oct 16 18:38:56 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe048471f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa'): ({'sdb'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Removing single pathed devices sdb {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a15d7bf-c417-4f53-964f-748869bc7bc6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d722e0-c207-42d0-9f30-e1a437f22a03]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Flushing IO for device /dev/sdb {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f74ae0-1ebe-40f5-a517-c45e2557358c]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3df6a18-6e2d-425b-91e8-ca32d81685ee]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] SCSI volumes sdb have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23266323563653463', '/dev/disk/by-id/scsi-1SCST_BIOf0fedbe-2f25ce4c998f53f9', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f0fedbe') {{(pid=85128) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91d4a7f-17cd-4e6e-af99-6da0df5c5c2c]: (4, None) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[41234aa2-ac6f-4350-86ac-7654ebcb2855]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a212cf-7c2f-416e-bed0-f5f82b219eaf]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa, portal: 172.16.0.220,3260]
Oct 16 18:38:56 user nova-compute[74247]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa, portal: 172.16.0.220,3260] successful.
Oct 16 18:38:56 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG nova.compute.manager [req-a8735b39-eb39-469f-be23-80189ba0121e req-ed667528-5e02-4845-b55c-9ef1e89e9891 service nova] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Received event network-vif-unplugged-f5845781-33be-4018-bc2c-72bb980ad8c8 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a8735b39-eb39-469f-be23-80189ba0121e req-ed667528-5e02-4845-b55c-9ef1e89e9891 service nova] Acquiring lock "88ea9961-7a1d-4193-b72f-63e398752141-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a8735b39-eb39-469f-be23-80189ba0121e req-ed667528-5e02-4845-b55c-9ef1e89e9891 service nova] Lock "88ea9961-7a1d-4193-b72f-63e398752141-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a8735b39-eb39-469f-be23-80189ba0121e req-ed667528-5e02-4845-b55c-9ef1e89e9891 service nova] Lock "88ea9961-7a1d-4193-b72f-63e398752141-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG nova.compute.manager [req-a8735b39-eb39-469f-be23-80189ba0121e req-ed667528-5e02-4845-b55c-9ef1e89e9891 service nova] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] No waiting events found dispatching network-vif-unplugged-f5845781-33be-4018-bc2c-72bb980ad8c8 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:38:56 user nova-compute[74247]: WARNING nova.compute.manager [req-a8735b39-eb39-469f-be23-80189ba0121e req-ed667528-5e02-4845-b55c-9ef1e89e9891 service nova] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Received unexpected event network-vif-unplugged-f5845781-33be-4018-bc2c-72bb980ad8c8 for instance with vm_state active and task_state resize_migrating.
Oct 16 18:38:56 user nova-compute[74247]: DEBUG nova.compute.manager [req-a8735b39-eb39-469f-be23-80189ba0121e req-ed667528-5e02-4845-b55c-9ef1e89e9891 service nova] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Received event network-vif-plugged-f5845781-33be-4018-bc2c-72bb980ad8c8 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a8735b39-eb39-469f-be23-80189ba0121e req-ed667528-5e02-4845-b55c-9ef1e89e9891 service nova] Acquiring lock "88ea9961-7a1d-4193-b72f-63e398752141-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a8735b39-eb39-469f-be23-80189ba0121e req-ed667528-5e02-4845-b55c-9ef1e89e9891 service nova] Lock "88ea9961-7a1d-4193-b72f-63e398752141-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a8735b39-eb39-469f-be23-80189ba0121e req-ed667528-5e02-4845-b55c-9ef1e89e9891 service nova] Lock "88ea9961-7a1d-4193-b72f-63e398752141-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG nova.compute.manager [req-a8735b39-eb39-469f-be23-80189ba0121e req-ed667528-5e02-4845-b55c-9ef1e89e9891 service nova] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] No waiting events found dispatching network-vif-plugged-f5845781-33be-4018-bc2c-72bb980ad8c8 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:38:56 user nova-compute[74247]: WARNING nova.compute.manager [req-a8735b39-eb39-469f-be23-80189ba0121e req-ed667528-5e02-4845-b55c-9ef1e89e9891 service nova] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Received unexpected event network-vif-plugged-f5845781-33be-4018-bc2c-72bb980ad8c8 for instance with vm_state active and task_state resize_migrating.
Oct 16 18:38:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5069cfc8-a192-41ec-8711-2f89348de2c6]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] <== disconnect_volume: return (323ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 18:38:56 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:38:57 user nova-compute[74247]: DEBUG nova.network.neutron [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Port f5845781-33be-4018-bc2c-72bb980ad8c8 binding to destination host user is already ACTIVE {{(pid=74247) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Oct 16 18:38:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "88ea9961-7a1d-4193-b72f-63e398752141-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:38:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "88ea9961-7a1d-4193-b72f-63e398752141-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:38:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "88ea9961-7a1d-4193-b72f-63e398752141-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:38:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "refresh_cache-88ea9961-7a1d-4193-b72f-63e398752141" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:38:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquired lock "refresh_cache-88ea9961-7a1d-4193-b72f-63e398752141" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:38:57 user nova-compute[74247]: DEBUG nova.network.neutron [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:38:58 user nova-compute[74247]: DEBUG nova.network.neutron [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Updating instance_info_cache with network_info: [{"id": "f5845781-33be-4018-bc2c-72bb980ad8c8", "address": "fa:16:3e:92:70:e9", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5845781-33", "ovs_interfaceid": "f5845781-33be-4018-bc2c-72bb980ad8c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:38:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Releasing lock "refresh_cache-88ea9961-7a1d-4193-b72f-63e398752141" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:38:58 user nova-compute[74247]: DEBUG os_brick.utils [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:38:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:38:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:38:58 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[27199c36-4166-44d2-ade2-b92ffc6e12ba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:38:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:38:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:38:58 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7700fe6-357f-4aaf-a618-a360449fab4c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:38:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:38:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:38:58 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b62abd-4856-4fe4-b9a8-dad2592ce24c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:38:58 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f145bf5-4827-4535-b6b6-0d1c56565cbf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:38:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:38:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:38:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 18:38:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:38:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:38:58 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 18:38:58 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01645bd-42d1-47df-ad9a-6a293b3bd95c]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:38:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 18:38:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 18:38:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 18:38:58 user nova-compute[74247]: DEBUG os_brick.utils [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:39:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:01 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:39:02 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:39:02 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:39:02 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 18:39:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "refresh_cache-d775101d-53a1-48c7-af24-91480be6af61" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:39:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquired lock "refresh_cache-d775101d-53a1-48c7-af24-91480be6af61" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:39:02 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: d775101d-53a1-48c7-af24-91480be6af61] Forcefully refreshing network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 18:39:03 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: d775101d-53a1-48c7-af24-91480be6af61] Updating instance_info_cache with network_info: [{"id": "646f5b58-acad-402e-bdf5-e5bd423c69e8", "address": "fa:16:3e:45:9e:7d", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap646f5b58-ac", "ovs_interfaceid": "646f5b58-acad-402e-bdf5-e5bd423c69e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:39:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Releasing lock "refresh_cache-d775101d-53a1-48c7-af24-91480be6af61" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:39:03 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: d775101d-53a1-48c7-af24-91480be6af61] Updated the network info_cache for instance {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 18:39:03 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:39:03 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:39:03 user nova-compute[74247]: INFO nova.compute.manager [None req-0a5fd538-01ae-43b8-8645-ab0daee0d3fa tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Unrescuing
Oct 16 18:39:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0a5fd538-01ae-43b8-8645-ab0daee0d3fa tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquiring lock "refresh_cache-958af87e-69d0-4da1-8fcf-90e0f275d62e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:39:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0a5fd538-01ae-43b8-8645-ab0daee0d3fa tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquired lock "refresh_cache-958af87e-69d0-4da1-8fcf-90e0f275d62e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:39:03 user nova-compute[74247]: DEBUG nova.network.neutron [None req-0a5fd538-01ae-43b8-8645-ab0daee0d3fa tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:39:03 user nova-compute[74247]: DEBUG nova.network.neutron [None req-0a5fd538-01ae-43b8-8645-ab0daee0d3fa tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Updating instance_info_cache with network_info: [{"id": "4457ec1e-80ee-4038-9838-3af879097230", "address": "fa:16:3e:fb:7d:a8", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4457ec1e-80", "ovs_interfaceid": "4457ec1e-80ee-4038-9838-3af879097230", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:39:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0a5fd538-01ae-43b8-8645-ab0daee0d3fa tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Releasing lock "refresh_cache-958af87e-69d0-4da1-8fcf-90e0f275d62e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:39:04 user nova-compute[74247]: DEBUG nova.objects.instance [None req-0a5fd538-01ae-43b8-8645-ab0daee0d3fa tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lazy-loading 'flavor' on Instance uuid 958af87e-69d0-4da1-8fcf-90e0f275d62e {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:39:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:04 user nova-compute[74247]: DEBUG nova.compute.manager [req-cf61a4ee-c4d9-448c-9a05-986f1bac2447 req-b70d664a-95fc-408e-b954-09443459504c service nova] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Received event network-vif-unplugged-4457ec1e-80ee-4038-9838-3af879097230 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:39:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-cf61a4ee-c4d9-448c-9a05-986f1bac2447 req-b70d664a-95fc-408e-b954-09443459504c service nova] Acquiring lock "958af87e-69d0-4da1-8fcf-90e0f275d62e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:39:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-cf61a4ee-c4d9-448c-9a05-986f1bac2447 req-b70d664a-95fc-408e-b954-09443459504c service nova] Lock "958af87e-69d0-4da1-8fcf-90e0f275d62e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:39:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-cf61a4ee-c4d9-448c-9a05-986f1bac2447 req-b70d664a-95fc-408e-b954-09443459504c service nova] Lock "958af87e-69d0-4da1-8fcf-90e0f275d62e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:39:04 user nova-compute[74247]: DEBUG nova.compute.manager [req-cf61a4ee-c4d9-448c-9a05-986f1bac2447 req-b70d664a-95fc-408e-b954-09443459504c service nova] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] No waiting events found dispatching network-vif-unplugged-4457ec1e-80ee-4038-9838-3af879097230 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:39:04 user nova-compute[74247]: WARNING nova.compute.manager [req-cf61a4ee-c4d9-448c-9a05-986f1bac2447 req-b70d664a-95fc-408e-b954-09443459504c service nova] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Received unexpected event network-vif-unplugged-4457ec1e-80ee-4038-9838-3af879097230 for instance with vm_state rescued and task_state unrescuing.
Oct 16 18:39:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:04 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:39:04 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Instance destroyed successfully.
Oct 16 18:39:05 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:39:05 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:39:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:39:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:39:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:39:05 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 18:39:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:06 user nova-compute[74247]: DEBUG nova.compute.manager [req-5592ec39-67e6-4a25-ad52-1400a66da636 req-80e4d785-6242-40ba-bbab-49169faaf0df service nova] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Received event network-vif-plugged-4457ec1e-80ee-4038-9838-3af879097230 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:39:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-5592ec39-67e6-4a25-ad52-1400a66da636 req-80e4d785-6242-40ba-bbab-49169faaf0df service nova] Acquiring lock "958af87e-69d0-4da1-8fcf-90e0f275d62e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:39:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-5592ec39-67e6-4a25-ad52-1400a66da636 req-80e4d785-6242-40ba-bbab-49169faaf0df service nova] Lock "958af87e-69d0-4da1-8fcf-90e0f275d62e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:39:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-5592ec39-67e6-4a25-ad52-1400a66da636 req-80e4d785-6242-40ba-bbab-49169faaf0df service nova] Lock "958af87e-69d0-4da1-8fcf-90e0f275d62e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:39:06 user nova-compute[74247]: DEBUG nova.compute.manager [req-5592ec39-67e6-4a25-ad52-1400a66da636 req-80e4d785-6242-40ba-bbab-49169faaf0df service nova] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] No waiting events found dispatching network-vif-plugged-4457ec1e-80ee-4038-9838-3af879097230 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:39:06 user nova-compute[74247]: WARNING nova.compute.manager [req-5592ec39-67e6-4a25-ad52-1400a66da636 req-80e4d785-6242-40ba-bbab-49169faaf0df service nova] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Received unexpected event network-vif-plugged-4457ec1e-80ee-4038-9838-3af879097230 for instance with vm_state rescued and task_state unrescuing.
Oct 16 18:39:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:39:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:39:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:39:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:39:07 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:39:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:39:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:39:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:39:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:39:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:39:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:39:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:39:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:39:08 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:39:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:39:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:39:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:39:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:39:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:39:08 user nova-compute[74247]: DEBUG nova.compute.manager [req-7f149d71-f1a3-4209-8b3e-759af2e0bc0f req-b07ddd02-e7ae-42f5-9284-d51ee13f25af service nova] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Received event network-vif-plugged-4457ec1e-80ee-4038-9838-3af879097230 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:39:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7f149d71-f1a3-4209-8b3e-759af2e0bc0f req-b07ddd02-e7ae-42f5-9284-d51ee13f25af service nova] Acquiring lock "958af87e-69d0-4da1-8fcf-90e0f275d62e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:39:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7f149d71-f1a3-4209-8b3e-759af2e0bc0f req-b07ddd02-e7ae-42f5-9284-d51ee13f25af service nova] Lock "958af87e-69d0-4da1-8fcf-90e0f275d62e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:39:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7f149d71-f1a3-4209-8b3e-759af2e0bc0f req-b07ddd02-e7ae-42f5-9284-d51ee13f25af service nova] Lock "958af87e-69d0-4da1-8fcf-90e0f275d62e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:39:08 user nova-compute[74247]: DEBUG nova.compute.manager [req-7f149d71-f1a3-4209-8b3e-759af2e0bc0f req-b07ddd02-e7ae-42f5-9284-d51ee13f25af service nova] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] No waiting events found dispatching network-vif-plugged-4457ec1e-80ee-4038-9838-3af879097230 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:39:08 user nova-compute[74247]: WARNING nova.compute.manager [req-7f149d71-f1a3-4209-8b3e-759af2e0bc0f req-b07ddd02-e7ae-42f5-9284-d51ee13f25af service nova] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Received unexpected event network-vif-plugged-4457ec1e-80ee-4038-9838-3af879097230 for instance with vm_state rescued and task_state unrescuing.
Oct 16 18:39:08 user nova-compute[74247]: DEBUG nova.compute.manager [req-7f149d71-f1a3-4209-8b3e-759af2e0bc0f req-b07ddd02-e7ae-42f5-9284-d51ee13f25af service nova] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Received event network-vif-plugged-4457ec1e-80ee-4038-9838-3af879097230 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:39:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7f149d71-f1a3-4209-8b3e-759af2e0bc0f req-b07ddd02-e7ae-42f5-9284-d51ee13f25af service nova] Acquiring lock "958af87e-69d0-4da1-8fcf-90e0f275d62e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:39:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7f149d71-f1a3-4209-8b3e-759af2e0bc0f req-b07ddd02-e7ae-42f5-9284-d51ee13f25af service nova] Lock "958af87e-69d0-4da1-8fcf-90e0f275d62e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:39:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7f149d71-f1a3-4209-8b3e-759af2e0bc0f req-b07ddd02-e7ae-42f5-9284-d51ee13f25af service nova] Lock "958af87e-69d0-4da1-8fcf-90e0f275d62e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:39:08 user nova-compute[74247]: DEBUG nova.compute.manager [req-7f149d71-f1a3-4209-8b3e-759af2e0bc0f req-b07ddd02-e7ae-42f5-9284-d51ee13f25af service nova] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] No waiting events found dispatching network-vif-plugged-4457ec1e-80ee-4038-9838-3af879097230 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:39:08 user nova-compute[74247]: WARNING nova.compute.manager [req-7f149d71-f1a3-4209-8b3e-759af2e0bc0f req-b07ddd02-e7ae-42f5-9284-d51ee13f25af service nova] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Received unexpected event network-vif-plugged-4457ec1e-80ee-4038-9838-3af879097230 for instance with vm_state rescued and task_state unrescuing.
Oct 16 18:39:08 user nova-compute[74247]: DEBUG nova.compute.manager [None req-0a5fd538-01ae-43b8-8645-ab0daee0d3fa tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:39:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:39:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:39:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:39:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4a3995f-cd3e-41be-8901-876eefbe2bf3/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:39:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4a3995f-cd3e-41be-8901-876eefbe2bf3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:39:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4a3995f-cd3e-41be-8901-876eefbe2bf3/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:39:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4a3995f-cd3e-41be-8901-876eefbe2bf3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:39:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:39:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:39:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:39:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:39:10 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:39:10 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:39:10 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=8175MB free_disk=25.027889251708984GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 18:39:10 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:39:10 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:39:10 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Applying migration context for instance 88ea9961-7a1d-4193-b72f-63e398752141 as it has an incoming, in-progress migration 36967c71-3398-4e6f-9e8b-1cdc93a6ac56. Migration status is post-migrating {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 16 18:39:10 user nova-compute[74247]: INFO nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Updating resource usage from migration 36967c71-3398-4e6f-9e8b-1cdc93a6ac56
Oct 16 18:39:10 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance e37fbc27-3404-479a-be08-4d590391cf30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:39:10 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance cddf4842-1c25-4cc8-914e-af30849e4d6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:39:10 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 958af87e-69d0-4da1-8fcf-90e0f275d62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:39:10 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance d775101d-53a1-48c7-af24-91480be6af61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:39:10 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 7dcc08e9-7439-436b-8d9f-facaf04e22c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:39:10 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:39:10 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance d4a3995f-cd3e-41be-8901-876eefbe2bf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:39:10 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Migration 36967c71-3398-4e6f-9e8b-1cdc93a6ac56 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 16 18:39:10 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 88ea9961-7a1d-4193-b72f-63e398752141 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:39:10 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 18:39:10 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 18:39:10 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:39:10 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:39:10 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 18:39:10 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.492s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:39:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:16 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:39:16 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 18:39:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "220798e9-aea4-4c79-9737-175ab0598e7e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:39:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "220798e9-aea4-4c79-9737-175ab0598e7e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:39:22 user nova-compute[74247]: DEBUG nova.compute.manager [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 18:39:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:39:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:39:22 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:39:22 user nova-compute[74247]: INFO nova.compute.claims [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Claim successful on node user
Oct 16 18:39:23 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:39:23 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:39:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.420s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:39:23 user nova-compute[74247]: DEBUG nova.compute.manager [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 18:39:23 user nova-compute[74247]: DEBUG nova.compute.manager [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 18:39:23 user nova-compute[74247]: DEBUG nova.network.neutron [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 18:39:23 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 18:39:23 user nova-compute[74247]: DEBUG nova.compute.manager [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 18:39:23 user nova-compute[74247]: DEBUG nova.policy [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b01d3e5d2fcb40bc92c3d2fe1236d509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce6164a392e4cc2a027d12c49145e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 18:39:23 user nova-compute[74247]: DEBUG nova.compute.manager [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 18:39:23 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:39:23 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Creating image(s)
Oct 16 18:39:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "/opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:39:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "/opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:39:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "/opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:39:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:39:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.204s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:39:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "37399febbd18f60b85fd0f833558f6a3539ab231" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:39:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:39:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:39:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.206s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:39:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk 1073741824 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:39:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk 1073741824" returned: 0 in 0.119s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:39:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.332s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:39:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:39:24 user nova-compute[74247]: DEBUG nova.network.neutron [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Successfully created port: 2d83e040-9c34-466f-8a75-19b3710af8ea {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:39:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.177s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:39:24 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Checking if we can resize image /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk. size=1073741824 {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 18:39:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:39:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:39:24 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Cannot resize image /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk to a smaller size. {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 18:39:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 18:39:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Ensure instance console log exists: /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:39:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:39:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:39:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:39:24 user nova-compute[74247]: DEBUG nova.network.neutron [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Successfully updated port: 2d83e040-9c34-466f-8a75-19b3710af8ea {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:39:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "refresh_cache-220798e9-aea4-4c79-9737-175ab0598e7e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:39:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquired lock "refresh_cache-220798e9-aea4-4c79-9737-175ab0598e7e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:39:24 user nova-compute[74247]: DEBUG nova.network.neutron [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:39:24 user nova-compute[74247]: DEBUG nova.network.neutron [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:39:24 user nova-compute[74247]: DEBUG nova.compute.manager [req-4794996e-9368-45cd-8223-082052531512 req-a06352d3-1757-47f6-8f69-4be945be2a3d service nova] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Received event network-changed-2d83e040-9c34-466f-8a75-19b3710af8ea {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:39:24 user nova-compute[74247]: DEBUG nova.compute.manager [req-4794996e-9368-45cd-8223-082052531512 req-a06352d3-1757-47f6-8f69-4be945be2a3d service nova] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Refreshing instance network info cache due to event network-changed-2d83e040-9c34-466f-8a75-19b3710af8ea. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:39:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4794996e-9368-45cd-8223-082052531512 req-a06352d3-1757-47f6-8f69-4be945be2a3d service nova] Acquiring lock "refresh_cache-220798e9-aea4-4c79-9737-175ab0598e7e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG nova.network.neutron [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Updating instance_info_cache with network_info: [{"id": "2d83e040-9c34-466f-8a75-19b3710af8ea", "address": "fa:16:3e:25:a7:be", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d83e040-9c", "ovs_interfaceid": "2d83e040-9c34-466f-8a75-19b3710af8ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Releasing lock "refresh_cache-220798e9-aea4-4c79-9737-175ab0598e7e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG nova.compute.manager [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Instance network_info: |[{"id": "2d83e040-9c34-466f-8a75-19b3710af8ea", "address": "fa:16:3e:25:a7:be", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d83e040-9c", "ovs_interfaceid": "2d83e040-9c34-466f-8a75-19b3710af8ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4794996e-9368-45cd-8223-082052531512 req-a06352d3-1757-47f6-8f69-4be945be2a3d service nova] Acquired lock "refresh_cache-220798e9-aea4-4c79-9737-175ab0598e7e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG nova.network.neutron [req-4794996e-9368-45cd-8223-082052531512 req-a06352d3-1757-47f6-8f69-4be945be2a3d service nova] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Refreshing network info cache for port 2d83e040-9c34-466f-8a75-19b3710af8ea {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Start _get_guest_xml network_info=[{"id": "2d83e040-9c34-466f-8a75-19b3710af8ea", "address": "fa:16:3e:25:a7:be", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d83e040-9c", "ovs_interfaceid": "2d83e040-9c34-466f-8a75-19b3710af8ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': '83126bb1-29f5-42fe-8620-72ab0797f776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:39:25 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:39:25 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:39:25 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:39:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1560515371',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1560515371',id=29,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bce6164a392e4cc2a027d12c49145e6d',ramdisk_id='',reservation_id='r-yq4dqw9f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-656520712',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:39:24Z,user_data=None,user_id='b01d3e5d2fcb40bc92c3d2fe1236d509',uuid=220798e9-aea4-4c79-9737-175ab0598e7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d83e040-9c34-466f-8a75-19b3710af8ea", "address": "fa:16:3e:25:a7:be", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d83e040-9c", "ovs_interfaceid": "2d83e040-9c34-466f-8a75-19b3710af8ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Converting VIF {"id": "2d83e040-9c34-466f-8a75-19b3710af8ea", "address": "fa:16:3e:25:a7:be", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d83e040-9c", "ovs_interfaceid": "2d83e040-9c34-466f-8a75-19b3710af8ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:a7:be,bridge_name='br-int',has_traffic_filtering=True,id=2d83e040-9c34-466f-8a75-19b3710af8ea,network=Network(2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d83e040-9c') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG nova.objects.instance [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lazy-loading 'pci_devices' on Instance uuid 220798e9-aea4-4c79-9737-175ab0598e7e {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:39:25 user nova-compute[74247]:   <uuid>220798e9-aea4-4c79-9737-175ab0598e7e</uuid>
Oct 16 18:39:25 user nova-compute[74247]:   <name>instance-0000001d</name>
Oct 16 18:39:25 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:39:25 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:39:25 user nova-compute[74247]:   <metadata>
Oct 16 18:39:25 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:39:25 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:39:25 user nova-compute[74247]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1560515371</nova:name>
Oct 16 18:39:25 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:39:25</nova:creationTime>
Oct 16 18:39:25 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:39:25 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:39:25 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:39:25 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:39:25 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:39:25 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:39:25 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:39:25 user nova-compute[74247]:       <nova:owner>
Oct 16 18:39:25 user nova-compute[74247]:         <nova:user uuid="b01d3e5d2fcb40bc92c3d2fe1236d509">tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member</nova:user>
Oct 16 18:39:25 user nova-compute[74247]:         <nova:project uuid="bce6164a392e4cc2a027d12c49145e6d">tempest-ServerBootFromVolumeStableRescueTest-656520712</nova:project>
Oct 16 18:39:25 user nova-compute[74247]:       </nova:owner>
Oct 16 18:39:25 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:39:25 user nova-compute[74247]:       <nova:ports>
Oct 16 18:39:25 user nova-compute[74247]:         <nova:port uuid="2d83e040-9c34-466f-8a75-19b3710af8ea">
Oct 16 18:39:25 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 16 18:39:25 user nova-compute[74247]:         </nova:port>
Oct 16 18:39:25 user nova-compute[74247]:       </nova:ports>
Oct 16 18:39:25 user nova-compute[74247]:     </nova:instance>
Oct 16 18:39:25 user nova-compute[74247]:   </metadata>
Oct 16 18:39:25 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:39:25 user nova-compute[74247]:     <system>
Oct 16 18:39:25 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:39:25 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:39:25 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:39:25 user nova-compute[74247]:       <entry name="serial">220798e9-aea4-4c79-9737-175ab0598e7e</entry>
Oct 16 18:39:25 user nova-compute[74247]:       <entry name="uuid">220798e9-aea4-4c79-9737-175ab0598e7e</entry>
Oct 16 18:39:25 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:39:25 user nova-compute[74247]:     </system>
Oct 16 18:39:25 user nova-compute[74247]:   </sysinfo>
Oct 16 18:39:25 user nova-compute[74247]:   <os>
Oct 16 18:39:25 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:39:25 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:39:25 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:39:25 user nova-compute[74247]:   </os>
Oct 16 18:39:25 user nova-compute[74247]:   <features>
Oct 16 18:39:25 user nova-compute[74247]:     <acpi/>
Oct 16 18:39:25 user nova-compute[74247]:     <apic/>
Oct 16 18:39:25 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:39:25 user nova-compute[74247]:   </features>
Oct 16 18:39:25 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:39:25 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:39:25 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:39:25 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:39:25 user nova-compute[74247]:   </clock>
Oct 16 18:39:25 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:39:25 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:39:25 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:39:25 user nova-compute[74247]:   </cpu>
Oct 16 18:39:25 user nova-compute[74247]:   <devices>
Oct 16 18:39:25 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:39:25 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:39:25 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk"/>
Oct 16 18:39:25 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:39:25 user nova-compute[74247]:     </disk>
Oct 16 18:39:25 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:39:25 user nova-compute[74247]:       <mac address="fa:16:3e:25:a7:be"/>
Oct 16 18:39:25 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:39:25 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:39:25 user nova-compute[74247]:       <target dev="tap2d83e040-9c"/>
Oct 16 18:39:25 user nova-compute[74247]:     </interface>
Oct 16 18:39:25 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:39:25 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/console.log" append="off"/>
Oct 16 18:39:25 user nova-compute[74247]:     </serial>
Oct 16 18:39:25 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:39:25 user nova-compute[74247]:     <video>
Oct 16 18:39:25 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:39:25 user nova-compute[74247]:     </video>
Oct 16 18:39:25 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:39:25 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:39:25 user nova-compute[74247]:     </rng>
Oct 16 18:39:25 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:39:25 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:39:25 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:39:25 user nova-compute[74247]:     </memballoon>
Oct 16 18:39:25 user nova-compute[74247]:   </devices>
Oct 16 18:39:25 user nova-compute[74247]: </domain>
Oct 16 18:39:25 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:39:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1560515371',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1560515371',id=29,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bce6164a392e4cc2a027d12c49145e6d',ramdisk_id='',reservation_id='r-yq4dqw9f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-656520712',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:39:24Z,user_data=None,user_id='b01d3e5d2fcb40bc92c3d2fe1236d509',uuid=220798e9-aea4-4c79-9737-175ab0598e7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d83e040-9c34-466f-8a75-19b3710af8ea", "address": "fa:16:3e:25:a7:be", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d83e040-9c", "ovs_interfaceid": "2d83e040-9c34-466f-8a75-19b3710af8ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Converting VIF {"id": "2d83e040-9c34-466f-8a75-19b3710af8ea", "address": "fa:16:3e:25:a7:be", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d83e040-9c", "ovs_interfaceid": "2d83e040-9c34-466f-8a75-19b3710af8ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:a7:be,bridge_name='br-int',has_traffic_filtering=True,id=2d83e040-9c34-466f-8a75-19b3710af8ea,network=Network(2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d83e040-9c') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG os_vif [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:a7:be,bridge_name='br-int',has_traffic_filtering=True,id=2d83e040-9c34-466f-8a75-19b3710af8ea,network=Network(2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d83e040-9c') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e52e777-3b2c-5bfc-9ff9-8436fcfa66f5', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d83e040-9c, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2d83e040-9c, col_values=(('qos', UUID('2f7cacb6-ede4-40b5-ae65-755f8a157062')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2d83e040-9c, col_values=(('external_ids', {'iface-id': '2d83e040-9c34-466f-8a75-19b3710af8ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:a7:be', 'vm-uuid': '220798e9-aea4-4c79-9737-175ab0598e7e'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:25 user nova-compute[74247]: INFO os_vif [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:a7:be,bridge_name='br-int',has_traffic_filtering=True,id=2d83e040-9c34-466f-8a75-19b3710af8ea,network=Network(2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d83e040-9c')
Oct 16 18:39:25 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] No VIF found with MAC fa:16:3e:25:a7:be, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG nova.network.neutron [req-4794996e-9368-45cd-8223-082052531512 req-a06352d3-1757-47f6-8f69-4be945be2a3d service nova] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Updated VIF entry in instance network info cache for port 2d83e040-9c34-466f-8a75-19b3710af8ea. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG nova.network.neutron [req-4794996e-9368-45cd-8223-082052531512 req-a06352d3-1757-47f6-8f69-4be945be2a3d service nova] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Updating instance_info_cache with network_info: [{"id": "2d83e040-9c34-466f-8a75-19b3710af8ea", "address": "fa:16:3e:25:a7:be", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d83e040-9c", "ovs_interfaceid": "2d83e040-9c34-466f-8a75-19b3710af8ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:39:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4794996e-9368-45cd-8223-082052531512 req-a06352d3-1757-47f6-8f69-4be945be2a3d service nova] Releasing lock "refresh_cache-220798e9-aea4-4c79-9737-175ab0598e7e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:39:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:26 user nova-compute[74247]: DEBUG nova.compute.manager [req-873af6f0-a565-4e4a-a585-fca5ecb6b107 req-5954373f-ffee-4778-888b-7766b4bee4e8 service nova] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Received event network-vif-plugged-2d83e040-9c34-466f-8a75-19b3710af8ea {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:39:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-873af6f0-a565-4e4a-a585-fca5ecb6b107 req-5954373f-ffee-4778-888b-7766b4bee4e8 service nova] Acquiring lock "220798e9-aea4-4c79-9737-175ab0598e7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:39:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-873af6f0-a565-4e4a-a585-fca5ecb6b107 req-5954373f-ffee-4778-888b-7766b4bee4e8 service nova] Lock "220798e9-aea4-4c79-9737-175ab0598e7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:39:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-873af6f0-a565-4e4a-a585-fca5ecb6b107 req-5954373f-ffee-4778-888b-7766b4bee4e8 service nova] Lock "220798e9-aea4-4c79-9737-175ab0598e7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:39:26 user nova-compute[74247]: DEBUG nova.compute.manager [req-873af6f0-a565-4e4a-a585-fca5ecb6b107 req-5954373f-ffee-4778-888b-7766b4bee4e8 service nova] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] No waiting events found dispatching network-vif-plugged-2d83e040-9c34-466f-8a75-19b3710af8ea {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:39:26 user nova-compute[74247]: WARNING nova.compute.manager [req-873af6f0-a565-4e4a-a585-fca5ecb6b107 req-5954373f-ffee-4778-888b-7766b4bee4e8 service nova] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Received unexpected event network-vif-plugged-2d83e040-9c34-466f-8a75-19b3710af8ea for instance with vm_state building and task_state spawning.
Oct 16 18:39:28 user nova-compute[74247]: DEBUG nova.compute.manager [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:39:28 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:39:28 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Instance spawned successfully.
Oct 16 18:39:28 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 18:39:28 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:39:28 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:39:28 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:39:28 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:39:28 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:39:28 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:39:28 user nova-compute[74247]: INFO nova.compute.manager [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Took 5.38 seconds to spawn the instance on the hypervisor.
Oct 16 18:39:28 user nova-compute[74247]: DEBUG nova.compute.manager [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:39:29 user nova-compute[74247]: DEBUG nova.compute.manager [req-5eb73610-439f-4e69-b027-f7d158a8bcb1 req-e154e12c-48e9-44c4-89bc-877623574272 service nova] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Received event network-vif-plugged-2d83e040-9c34-466f-8a75-19b3710af8ea {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:39:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-5eb73610-439f-4e69-b027-f7d158a8bcb1 req-e154e12c-48e9-44c4-89bc-877623574272 service nova] Acquiring lock "220798e9-aea4-4c79-9737-175ab0598e7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:39:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-5eb73610-439f-4e69-b027-f7d158a8bcb1 req-e154e12c-48e9-44c4-89bc-877623574272 service nova] Lock "220798e9-aea4-4c79-9737-175ab0598e7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:39:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-5eb73610-439f-4e69-b027-f7d158a8bcb1 req-e154e12c-48e9-44c4-89bc-877623574272 service nova] Lock "220798e9-aea4-4c79-9737-175ab0598e7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:39:29 user nova-compute[74247]: DEBUG nova.compute.manager [req-5eb73610-439f-4e69-b027-f7d158a8bcb1 req-e154e12c-48e9-44c4-89bc-877623574272 service nova] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] No waiting events found dispatching network-vif-plugged-2d83e040-9c34-466f-8a75-19b3710af8ea {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:39:29 user nova-compute[74247]: WARNING nova.compute.manager [req-5eb73610-439f-4e69-b027-f7d158a8bcb1 req-e154e12c-48e9-44c4-89bc-877623574272 service nova] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Received unexpected event network-vif-plugged-2d83e040-9c34-466f-8a75-19b3710af8ea for instance with vm_state building and task_state spawning.
Oct 16 18:39:29 user nova-compute[74247]: INFO nova.compute.manager [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Took 6.14 seconds to build instance.
Oct 16 18:39:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-91ffbf8d-3140-4cba-8d75-79f17f593478 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "220798e9-aea4-4c79-9737-175ab0598e7e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.234s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RwLoCldU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:39:30 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:39:30 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:39:30 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:39:30 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:39:30 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:39:30 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273 -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1886033b-48b8-49b5-a25c-b97ad0bbadaa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 18:39:30 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273 -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a81007b-729c-46f8-aee0-e062dffbafa0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273] added
Oct 16 18:39:30 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[934872e1-b4f9-40b6-959a-fe952e7c2ced]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[665b9ea8-ed36-447f-a526-f12729a8c510]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RwLoCldU {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RwLoCldU" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[694db0ca-b737-4737-95a3-b9e4479d8589]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RwLoCldU'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabedf7c-2015-42c8-acf5-10f12f72f472]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Starting finish_migration {{(pid=74247) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Instance directory exists: not creating {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 16 18:39:30 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Creating image(s)
Oct 16 18:39:30 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Did not create local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Ensure instance console log exists: /opt/stack/data/nova/instances/88ea9961-7a1d-4193-b72f-63e398752141/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Start _get_guest_xml network_info=[{"id": "f5845781-33be-4018-bc2c-72bb980ad8c8", "address": "fa:16:3e:92:70:e9", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1201038774-network", "vif_mac": "fa:16:3e:92:70:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5845781-33", "ovs_interfaceid": "f5845781-33be-4018-bc2c-72bb980ad8c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wXPfgxSi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '88ea9961-7a1d-4193-b72f-63e398752141', 'attached_at': '2023-10-16T18:39:31.000000', 'detached_at': '', 'volume_id': '6fe688e0-e202-4c50-9a51-1fe480c399fa', 'serial': '6fe688e0-e202-4c50-9a51-1fe480c399fa'}, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '08c487df-d57e-42aa-918b-9a6606d6d1b0', 'guest_format': None, 'volume_type': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:39:30 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:39:30 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:39:30 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9cdd03-7be5-4e05-a942-a8a9ed96cb7b]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:39:30 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:39:30 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:05Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wXPfgxSi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:39:30 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:39:30 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273 -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[77398a63-236b-4c85-90db-81a93d2cec76]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273, portal: 172.16.0.220,3260]
Oct 16 18:39:30 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273, portal: 172.16.0.220,3260] successful.
Oct 16 18:39:30 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8c11d5-418e-4439-ab27-515aafda75d0]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8a96a6-8057-4e94-af47-a3d7b06b9022]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:39:30 user nova-compute[74247]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273 (non-flash)
Oct 16 18:39:30 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:39:30 user nova-compute[74247]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273 (non-flash)
Oct 16 18:39:30 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:39:30 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a6b51a-db4b-43bb-ab18-7687500c49b3]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:39:31 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: None {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:39:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:31 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:39:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RwLoCldU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:39:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26431343464626133', 'path': '/dev/sdb'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431343464626133', 'path': '/dev/sdb'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.112s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:39:32 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:39:32 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:39:32 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:39:32 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG nova.objects.instance [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lazy-loading 'flavor' on Instance uuid 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2ce4d8-15d8-4f20-843d-24e5129c71dd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 18:39:32 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 18:39:32 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:39:32 user nova-compute[74247]:   <source dev="/dev/sdb"/>
Oct 16 18:39:32 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:39:32 user nova-compute[74247]:   <serial>5f6ea7d3-1870-4dd4-aed5-f296ce384273</serial>
Oct 16 18:39:32 user nova-compute[74247]: </disk>
Oct 16 18:39:32 user nova-compute[74247]:  {{(pid=74247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79c168d-3e60-43b6-8605-b0e8c4386e73]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa] added
Oct 16 18:39:32 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64d819f-83fa-4454-a94e-f526b5bd5bbc]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe45fcd-d678-4907-9dc1-352d280cdbf2]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wXPfgxSi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wXPfgxSi" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f62401-fc5d-4891-9bfa-e4df92f469d7]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wXPfgxSi'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e20d93a-42de-4bf0-b550-846a29ad22c3]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce05316-28e8-45f4-a01f-ff2eaea9be2c]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:39:32 user nova-compute[74247]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273 (non-flash)
Oct 16 18:39:32 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:39:32 user nova-compute[74247]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273 (non-flash)
Oct 16 18:39:32 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f02195e-1e4c-4550-985c-0a9994c1b964]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa, portal: 172.16.0.220,3260]
Oct 16 18:39:32 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa, portal: 172.16.0.220,3260] successful.
Oct 16 18:39:32 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e2a730-3807-48e6-876a-6460c88d08f6]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[523a2cda-1c89-4ecc-b21c-989da09ca018]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:39:32 user nova-compute[74247]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273 (non-flash)
Oct 16 18:39:32 user nova-compute[74247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)
Oct 16 18:39:32 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:39:32 user nova-compute[74247]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273 (non-flash)
Oct 16 18:39:32 user nova-compute[74247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)
Oct 16 18:39:32 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] HCTL ('35', '-', '-', 0) found on session 27 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88f05ad-b646-4855-8e0e-8304e452e4c7]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wXPfgxSi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] No VIF found with MAC fa:16:3e:d7:26:52, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:39:32 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3d7cb06e-f32f-4fa5-91f1-5e38eecc92d4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 43.305s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:39:33 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:39:33 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] <== connect_volume: return (2459ms) {'type': 'block', 'scsi_wwn': '23266323563653463', 'path': '/dev/sdd'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:39:33 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266323563653463', 'path': '/dev/sdd'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:39:33 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1833793690',display_name='tempest-ServerActionsTestOtherA-server-1833793690',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1833793690',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/sQ/2CMkopvPZot1Iryii0p1Iq3sQgAbR+a1zff3LwsTrC97Bkir58aQPXckuRP2Pk52sgcmyihyOLiY8s4svRhqknfDOoanrdDaAunocHU/6uHElK38rY7fNKG4cJVA==',key_name='tempest-keypair-869426560',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:37:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='42bd3eb752f04fd48dfe0623fdf2fe9f',ramdisk_id='',reservation_id='r-b3ywbhfa',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-291765974',owner_user_name='tempest-ServerActionsTestOtherA-291765974-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:38:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3635a30f06234f0d9a8e0604c25f1208',uuid=88ea9961-7a1d-4193-b72f-63e398752141,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5845781-33be-4018-bc2c-72bb980ad8c8", "address": "fa:16:3e:92:70:e9", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1201038774-network", "vif_mac": "fa:16:3e:92:70:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5845781-33", "ovs_interfaceid": "f5845781-33be-4018-bc2c-72bb980ad8c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:39:33 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Converting VIF {"id": "f5845781-33be-4018-bc2c-72bb980ad8c8", "address": "fa:16:3e:92:70:e9", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1201038774-network", "vif_mac": "fa:16:3e:92:70:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5845781-33", "ovs_interfaceid": "f5845781-33be-4018-bc2c-72bb980ad8c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:39:33 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:70:e9,bridge_name='br-int',has_traffic_filtering=True,id=f5845781-33be-4018-bc2c-72bb980ad8c8,network=Network(0a61bae1-2607-4e42-b573-e74ac3edf09a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5845781-33') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:39:33 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:39:33 user nova-compute[74247]:   <uuid>88ea9961-7a1d-4193-b72f-63e398752141</uuid>
Oct 16 18:39:33 user nova-compute[74247]:   <name>instance-0000001b</name>
Oct 16 18:39:33 user nova-compute[74247]:   <memory>2097152</memory>
Oct 16 18:39:33 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:39:33 user nova-compute[74247]:   <metadata>
Oct 16 18:39:33 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:39:33 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:39:33 user nova-compute[74247]:       <nova:name>tempest-ServerActionsTestOtherA-server-1833793690</nova:name>
Oct 16 18:39:33 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:39:30</nova:creationTime>
Oct 16 18:39:33 user nova-compute[74247]:       <nova:flavor name="m1.small">
Oct 16 18:39:33 user nova-compute[74247]:         <nova:memory>2048</nova:memory>
Oct 16 18:39:33 user nova-compute[74247]:         <nova:disk>20</nova:disk>
Oct 16 18:39:33 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:39:33 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:39:33 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:39:33 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:39:33 user nova-compute[74247]:       <nova:owner>
Oct 16 18:39:33 user nova-compute[74247]:         <nova:user uuid="3635a30f06234f0d9a8e0604c25f1208">tempest-ServerActionsTestOtherA-291765974-project-member</nova:user>
Oct 16 18:39:33 user nova-compute[74247]:         <nova:project uuid="42bd3eb752f04fd48dfe0623fdf2fe9f">tempest-ServerActionsTestOtherA-291765974</nova:project>
Oct 16 18:39:33 user nova-compute[74247]:       </nova:owner>
Oct 16 18:39:33 user nova-compute[74247]:       <nova:ports>
Oct 16 18:39:33 user nova-compute[74247]:         <nova:port uuid="f5845781-33be-4018-bc2c-72bb980ad8c8">
Oct 16 18:39:33 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 16 18:39:33 user nova-compute[74247]:         </nova:port>
Oct 16 18:39:33 user nova-compute[74247]:       </nova:ports>
Oct 16 18:39:33 user nova-compute[74247]:     </nova:instance>
Oct 16 18:39:33 user nova-compute[74247]:   </metadata>
Oct 16 18:39:33 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:39:33 user nova-compute[74247]:     <system>
Oct 16 18:39:33 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:39:33 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:39:33 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:39:33 user nova-compute[74247]:       <entry name="serial">88ea9961-7a1d-4193-b72f-63e398752141</entry>
Oct 16 18:39:33 user nova-compute[74247]:       <entry name="uuid">88ea9961-7a1d-4193-b72f-63e398752141</entry>
Oct 16 18:39:33 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:39:33 user nova-compute[74247]:     </system>
Oct 16 18:39:33 user nova-compute[74247]:   </sysinfo>
Oct 16 18:39:33 user nova-compute[74247]:   <os>
Oct 16 18:39:33 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:39:33 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:39:33 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:39:33 user nova-compute[74247]:   </os>
Oct 16 18:39:33 user nova-compute[74247]:   <features>
Oct 16 18:39:33 user nova-compute[74247]:     <acpi/>
Oct 16 18:39:33 user nova-compute[74247]:     <apic/>
Oct 16 18:39:33 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:39:33 user nova-compute[74247]:   </features>
Oct 16 18:39:33 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:39:33 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:39:33 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:39:33 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:39:33 user nova-compute[74247]:   </clock>
Oct 16 18:39:33 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:39:33 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:39:33 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:39:33 user nova-compute[74247]:   </cpu>
Oct 16 18:39:33 user nova-compute[74247]:   <devices>
Oct 16 18:39:33 user nova-compute[74247]:     <disk type="block" device="disk">
Oct 16 18:39:33 user nova-compute[74247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:39:33 user nova-compute[74247]:       <source dev="/dev/sdd"/>
Oct 16 18:39:33 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:39:33 user nova-compute[74247]:       <serial>6fe688e0-e202-4c50-9a51-1fe480c399fa</serial>
Oct 16 18:39:33 user nova-compute[74247]:     </disk>
Oct 16 18:39:33 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:39:33 user nova-compute[74247]:       <mac address="fa:16:3e:92:70:e9"/>
Oct 16 18:39:33 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:39:33 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:39:33 user nova-compute[74247]:       <target dev="tapf5845781-33"/>
Oct 16 18:39:33 user nova-compute[74247]:     </interface>
Oct 16 18:39:33 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:39:33 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/88ea9961-7a1d-4193-b72f-63e398752141/console.log" append="off"/>
Oct 16 18:39:33 user nova-compute[74247]:     </serial>
Oct 16 18:39:33 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:39:33 user nova-compute[74247]:     <video>
Oct 16 18:39:33 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:39:33 user nova-compute[74247]:     </video>
Oct 16 18:39:33 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:39:33 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:39:33 user nova-compute[74247]:     </rng>
Oct 16 18:39:33 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:39:33 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:39:33 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:39:33 user nova-compute[74247]:     </memballoon>
Oct 16 18:39:33 user nova-compute[74247]:   </devices>
Oct 16 18:39:33 user nova-compute[74247]: </domain>
Oct 16 18:39:33 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:39:33 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1833793690',display_name='tempest-ServerActionsTestOtherA-server-1833793690',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1833793690',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/sQ/2CMkopvPZot1Iryii0p1Iq3sQgAbR+a1zff3LwsTrC97Bkir58aQPXckuRP2Pk52sgcmyihyOLiY8s4svRhqknfDOoanrdDaAunocHU/6uHElK38rY7fNKG4cJVA==',key_name='tempest-keypair-869426560',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:37:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='42bd3eb752f04fd48dfe0623fdf2fe9f',ramdisk_id='',reservation_id='r-b3ywbhfa',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-291765974',owner_user_name='tempest-ServerActionsTestOtherA-291765974-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:38:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3635a30f06234f0d9a8e0604c25f1208',uuid=88ea9961-7a1d-4193-b72f-63e398752141,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5845781-33be-4018-bc2c-72bb980ad8c8", "address": "fa:16:3e:92:70:e9", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1201038774-network", "vif_mac": "fa:16:3e:92:70:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5845781-33", "ovs_interfaceid": "f5845781-33be-4018-bc2c-72bb980ad8c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:39:33 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Converting VIF {"id": "f5845781-33be-4018-bc2c-72bb980ad8c8", "address": "fa:16:3e:92:70:e9", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1201038774-network", "vif_mac": "fa:16:3e:92:70:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5845781-33", "ovs_interfaceid": "f5845781-33be-4018-bc2c-72bb980ad8c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:39:33 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:70:e9,bridge_name='br-int',has_traffic_filtering=True,id=f5845781-33be-4018-bc2c-72bb980ad8c8,network=Network(0a61bae1-2607-4e42-b573-e74ac3edf09a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5845781-33') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:39:33 user nova-compute[74247]: DEBUG os_vif [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:70:e9,bridge_name='br-int',has_traffic_filtering=True,id=f5845781-33be-4018-bc2c-72bb980ad8c8,network=Network(0a61bae1-2607-4e42-b573-e74ac3edf09a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5845781-33') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:39:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:39:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:39:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '63f6a782-2463-5bac-9503-ff8060045d96', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:39:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5845781-33, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:39:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf5845781-33, col_values=(('qos', UUID('2e7cd2aa-f091-430c-849e-8b3ba20fb548')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:39:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf5845781-33, col_values=(('external_ids', {'iface-id': 'f5845781-33be-4018-bc2c-72bb980ad8c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:70:e9', 'vm-uuid': '88ea9961-7a1d-4193-b72f-63e398752141'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:39:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:39:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:33 user nova-compute[74247]: INFO os_vif [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:70:e9,bridge_name='br-int',has_traffic_filtering=True,id=f5845781-33be-4018-bc2c-72bb980ad8c8,network=Network(0a61bae1-2607-4e42-b573-e74ac3edf09a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5845781-33')
Oct 16 18:39:33 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:39:33 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] No VIF found with MAC fa:16:3e:92:70:e9, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:39:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:35 user nova-compute[74247]: DEBUG nova.compute.manager [req-59429117-87b6-411b-aa97-2c58e6875fe1 req-d3edf453-0b70-4356-a2cb-a134466ff3f7 service nova] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Received event network-vif-plugged-f5845781-33be-4018-bc2c-72bb980ad8c8 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:39:35 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-59429117-87b6-411b-aa97-2c58e6875fe1 req-d3edf453-0b70-4356-a2cb-a134466ff3f7 service nova] Acquiring lock "88ea9961-7a1d-4193-b72f-63e398752141-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:39:35 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-59429117-87b6-411b-aa97-2c58e6875fe1 req-d3edf453-0b70-4356-a2cb-a134466ff3f7 service nova] Lock "88ea9961-7a1d-4193-b72f-63e398752141-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:39:35 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-59429117-87b6-411b-aa97-2c58e6875fe1 req-d3edf453-0b70-4356-a2cb-a134466ff3f7 service nova] Lock "88ea9961-7a1d-4193-b72f-63e398752141-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:39:35 user nova-compute[74247]: DEBUG nova.compute.manager [req-59429117-87b6-411b-aa97-2c58e6875fe1 req-d3edf453-0b70-4356-a2cb-a134466ff3f7 service nova] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] No waiting events found dispatching network-vif-plugged-f5845781-33be-4018-bc2c-72bb980ad8c8 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:39:35 user nova-compute[74247]: WARNING nova.compute.manager [req-59429117-87b6-411b-aa97-2c58e6875fe1 req-d3edf453-0b70-4356-a2cb-a134466ff3f7 service nova] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Received unexpected event network-vif-plugged-f5845781-33be-4018-bc2c-72bb980ad8c8 for instance with vm_state active and task_state resize_finish.
Oct 16 18:39:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:37 user nova-compute[74247]: DEBUG nova.compute.manager [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:39:37 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Instance running successfully.
Oct 16 18:39:37 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Failed to set time: agent not configured {{(pid=74247) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 16 18:39:37 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a61c8678-0046-4366-b093-9f29b6a4a379 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] finish_migration finished successfully. {{(pid=74247) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 16 18:39:37 user nova-compute[74247]: DEBUG nova.compute.manager [req-480e4747-76af-445f-94d0-c895c9b58a11 req-152552bf-da7e-4e38-b919-bdec47087bdc service nova] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Received event network-vif-plugged-f5845781-33be-4018-bc2c-72bb980ad8c8 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:39:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-480e4747-76af-445f-94d0-c895c9b58a11 req-152552bf-da7e-4e38-b919-bdec47087bdc service nova] Acquiring lock "88ea9961-7a1d-4193-b72f-63e398752141-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:39:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-480e4747-76af-445f-94d0-c895c9b58a11 req-152552bf-da7e-4e38-b919-bdec47087bdc service nova] Lock "88ea9961-7a1d-4193-b72f-63e398752141-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:39:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-480e4747-76af-445f-94d0-c895c9b58a11 req-152552bf-da7e-4e38-b919-bdec47087bdc service nova] Lock "88ea9961-7a1d-4193-b72f-63e398752141-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:39:37 user nova-compute[74247]: DEBUG nova.compute.manager [req-480e4747-76af-445f-94d0-c895c9b58a11 req-152552bf-da7e-4e38-b919-bdec47087bdc service nova] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] No waiting events found dispatching network-vif-plugged-f5845781-33be-4018-bc2c-72bb980ad8c8 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:39:37 user nova-compute[74247]: WARNING nova.compute.manager [req-480e4747-76af-445f-94d0-c895c9b58a11 req-152552bf-da7e-4e38-b919-bdec47087bdc service nova] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Received unexpected event network-vif-plugged-f5845781-33be-4018-bc2c-72bb980ad8c8 for instance with vm_state active and task_state resize_finish.
Oct 16 18:39:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:39 user nova-compute[74247]: DEBUG nova.compute.manager [req-e6675ffb-8103-4616-8cff-1fec3ee4bf0d req-60829922-30eb-4d92-88a8-720ec2337c57 service nova] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Received event network-changed-68286914-fc60-4ccc-a7c9-28c15f8fbaf4 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:39:39 user nova-compute[74247]: DEBUG nova.compute.manager [req-e6675ffb-8103-4616-8cff-1fec3ee4bf0d req-60829922-30eb-4d92-88a8-720ec2337c57 service nova] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Refreshing instance network info cache due to event network-changed-68286914-fc60-4ccc-a7c9-28c15f8fbaf4. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:39:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e6675ffb-8103-4616-8cff-1fec3ee4bf0d req-60829922-30eb-4d92-88a8-720ec2337c57 service nova] Acquiring lock "refresh_cache-d4a3995f-cd3e-41be-8901-876eefbe2bf3" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:39:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e6675ffb-8103-4616-8cff-1fec3ee4bf0d req-60829922-30eb-4d92-88a8-720ec2337c57 service nova] Acquired lock "refresh_cache-d4a3995f-cd3e-41be-8901-876eefbe2bf3" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:39:39 user nova-compute[74247]: DEBUG nova.network.neutron [req-e6675ffb-8103-4616-8cff-1fec3ee4bf0d req-60829922-30eb-4d92-88a8-720ec2337c57 service nova] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Refreshing network info cache for port 68286914-fc60-4ccc-a7c9-28c15f8fbaf4 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:39:39 user nova-compute[74247]: DEBUG nova.network.neutron [req-e6675ffb-8103-4616-8cff-1fec3ee4bf0d req-60829922-30eb-4d92-88a8-720ec2337c57 service nova] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Updated VIF entry in instance network info cache for port 68286914-fc60-4ccc-a7c9-28c15f8fbaf4. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:39:39 user nova-compute[74247]: DEBUG nova.network.neutron [req-e6675ffb-8103-4616-8cff-1fec3ee4bf0d req-60829922-30eb-4d92-88a8-720ec2337c57 service nova] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Updating instance_info_cache with network_info: [{"id": "68286914-fc60-4ccc-a7c9-28c15f8fbaf4", "address": "fa:16:3e:77:59:59", "network": {"id": "fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1988491128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96ced9d4c0c474fbc7edeed6f73324a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68286914-fc", "ovs_interfaceid": "68286914-fc60-4ccc-a7c9-28c15f8fbaf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:39:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e6675ffb-8103-4616-8cff-1fec3ee4bf0d req-60829922-30eb-4d92-88a8-720ec2337c57 service nova] Releasing lock "refresh_cache-d4a3995f-cd3e-41be-8901-876eefbe2bf3" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:39:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:43 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:44 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "d4a3995f-cd3e-41be-8901-876eefbe2bf3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:39:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "d4a3995f-cd3e-41be-8901-876eefbe2bf3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:39:45 user nova-compute[74247]: DEBUG nova.objects.instance [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lazy-loading 'flavor' on Instance uuid d4a3995f-cd3e-41be-8901-876eefbe2bf3 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:39:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "d4a3995f-cd3e-41be-8901-876eefbe2bf3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:39:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "d4a3995f-cd3e-41be-8901-876eefbe2bf3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:39:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "d4a3995f-cd3e-41be-8901-876eefbe2bf3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:39:45 user nova-compute[74247]: INFO nova.compute.manager [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Attaching volume 5ebca4eb-599b-4fb0-afdc-99aad2670ba5 to /dev/vdb
Oct 16 18:39:45 user nova-compute[74247]: DEBUG os_brick.utils [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:39:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:39:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:39:45 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[065537d6-c6ea-4e50-8fc7-511fa32c6915]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:39:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:39:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:39:45 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9167b299-9d53-4aa3-899f-730b71f2bfbd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:39:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:39:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:39:45 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc71a225-1fc7-4a25-95ac-f0962612bfbe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:39:45 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d8b284-ef2a-4cd1-be21-d468bda29510]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:39:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:39:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:39:45 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 18:39:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:39:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:39:45 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 18:39:45 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[39eb3c56-e2af-4163-b7b6-62b219092686]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:39:45 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 18:39:45 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 18:39:45 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 18:39:45 user nova-compute[74247]: DEBUG os_brick.utils [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:39:45 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Updating existing volume attachment record: 72071407-99e5-43de-8934-354f0fed2d7b {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 18:39:46 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:48 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:48 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:55 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:39:55 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Cleaning up deleted instances with incomplete migration  {{(pid=74247) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 16 18:39:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:39:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:40:00 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:40:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:40:02 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:40:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ptmzdTKl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:40:02 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:40:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:40:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:40:02 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:40:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:40:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:40:02 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:40:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5 -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1661722d-c3b4-4aeb-8acf-8256b1300a8d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 18:40:02 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:40:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3353e02f-4a9d-4cea-bb31-c8da0f0ace65]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5] added
Oct 16 18:40:02 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:40:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e92800-9e6e-43f6-8f0f-ac69f0e47375]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:40:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fc53ec-0480-4631-88f5-a199afad3a79]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:40:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ptmzdTKl {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ptmzdTKl" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d53d34-8e21-4567-8c08-6cbb9e5954bd]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ptmzdTKl'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:40:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2fe520-ba74-4b40-8a1b-b2c8db08bed3]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:40:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e0d82b-d412-4bd3-a78c-5264b1dd0e3b]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:40:03 user nova-compute[74247]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273 (non-flash)
Oct 16 18:40:03 user nova-compute[74247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)
Oct 16 18:40:03 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:40:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:40:03 user nova-compute[74247]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273 (non-flash)
Oct 16 18:40:03 user nova-compute[74247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)
Oct 16 18:40:03 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:40:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5 -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7395ae-4cb9-4ec4-b086-aa5945bcdc3c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5, portal: 172.16.0.220,3260]
Oct 16 18:40:03 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5, portal: 172.16.0.220,3260] successful.
Oct 16 18:40:03 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:40:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d12116-a883-4969-93ea-f147de7a8923]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:40:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b399ec3-4c04-4daf-8cc8-b7e39571fc31]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:40:03 user nova-compute[74247]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273 (non-flash)
Oct 16 18:40:03 user nova-compute[74247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)
Oct 16 18:40:03 user nova-compute[74247]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5 (non-flash)
Oct 16 18:40:03 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:40:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:40:03 user nova-compute[74247]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273 (non-flash)
Oct 16 18:40:03 user nova-compute[74247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)
Oct 16 18:40:03 user nova-compute[74247]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5 (non-flash)
Oct 16 18:40:03 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:40:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:40:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:40:03 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] HCTL ('36', '-', '-', 0) found on session 28 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:40:03 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:40:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cecc8f-61bb-482f-a983-0d0aff281f6a]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:03 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: None {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:40:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:40:03 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:40:04 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:40:04 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ptmzdTKl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:40:04 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:40:04 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23363623631636537', 'path': '/dev/sde'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:40:04 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363623631636537', 'path': '/dev/sde'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:40:04 user nova-compute[74247]: DEBUG nova.objects.instance [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lazy-loading 'flavor' on Instance uuid d4a3995f-cd3e-41be-8901-876eefbe2bf3 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:40:04 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 18:40:04 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:40:04 user nova-compute[74247]:   <source dev="/dev/sde"/>
Oct 16 18:40:04 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:40:04 user nova-compute[74247]:   <serial>5ebca4eb-599b-4fb0-afdc-99aad2670ba5</serial>
Oct 16 18:40:04 user nova-compute[74247]: </disk>
Oct 16 18:40:04 user nova-compute[74247]:  {{(pid=74247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 18:40:04 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:40:04 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:40:04 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 18:40:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "refresh_cache-7dcc08e9-7439-436b-8d9f-facaf04e22c1" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:40:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquired lock "refresh_cache-7dcc08e9-7439-436b-8d9f-facaf04e22c1" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:40:04 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Forcefully refreshing network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 18:40:04 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:40:04 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:40:04 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] No VIF found with MAC fa:16:3e:77:59:59, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:40:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-d53e3c45-446f-40c6-ac71-393f505a39da tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "d4a3995f-cd3e-41be-8901-876eefbe2bf3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.174s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:40:05 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Updating instance_info_cache with network_info: [{"id": "b7a0865a-62eb-4517-83ba-eb30ff219e50", "address": "fa:16:3e:47:07:5d", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a0865a-62", "ovs_interfaceid": "b7a0865a-62eb-4517-83ba-eb30ff219e50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:40:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Releasing lock "refresh_cache-7dcc08e9-7439-436b-8d9f-facaf04e22c1" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:40:05 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Updated the network info_cache for instance {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 18:40:05 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:40:05 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:40:05 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:40:05 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:40:05 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Cleaning up deleted instances {{(pid=74247) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 16 18:40:05 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] There are 0 instances to clean {{(pid=74247) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 16 18:40:05 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:40:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5c10ff0a-358d-4c22-954b-7100a820f040 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "d4a3995f-cd3e-41be-8901-876eefbe2bf3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:40:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5c10ff0a-358d-4c22-954b-7100a820f040 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "d4a3995f-cd3e-41be-8901-876eefbe2bf3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:40:05 user nova-compute[74247]: INFO nova.compute.manager [None req-5c10ff0a-358d-4c22-954b-7100a820f040 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Detaching volume 5ebca4eb-599b-4fb0-afdc-99aad2670ba5
Oct 16 18:40:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-756276e2-141f-47c2-844c-bfa9ea520877 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Acquiring lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:40:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-756276e2-141f-47c2-844c-bfa9ea520877 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:40:05 user nova-compute[74247]: INFO nova.compute.manager [None req-756276e2-141f-47c2-844c-bfa9ea520877 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Detaching volume 5f6ea7d3-1870-4dd4-aed5-f296ce384273
Oct 16 18:40:05 user nova-compute[74247]: INFO nova.virt.block_device [None req-5c10ff0a-358d-4c22-954b-7100a820f040 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Attempting to driver detach volume 5ebca4eb-599b-4fb0-afdc-99aad2670ba5 from mountpoint /dev/vdb
Oct 16 18:40:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-5c10ff0a-358d-4c22-954b-7100a820f040 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Attempting to detach device vdb from instance d4a3995f-cd3e-41be-8901-876eefbe2bf3 from the persistent domain config. {{(pid=74247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 18:40:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-5c10ff0a-358d-4c22-954b-7100a820f040 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 18:40:05 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:40:05 user nova-compute[74247]:   <source dev="/dev/sde"/>
Oct 16 18:40:05 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:40:05 user nova-compute[74247]:   <serial>5ebca4eb-599b-4fb0-afdc-99aad2670ba5</serial>
Oct 16 18:40:05 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 18:40:05 user nova-compute[74247]: </disk>
Oct 16 18:40:05 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:40:05 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-5c10ff0a-358d-4c22-954b-7100a820f040 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Successfully detached device vdb from instance d4a3995f-cd3e-41be-8901-876eefbe2bf3 from the persistent domain config.
Oct 16 18:40:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-5c10ff0a-358d-4c22-954b-7100a820f040 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d4a3995f-cd3e-41be-8901-876eefbe2bf3 from the live domain config. {{(pid=74247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 18:40:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-5c10ff0a-358d-4c22-954b-7100a820f040 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 18:40:05 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:40:05 user nova-compute[74247]:   <source dev="/dev/sde"/>
Oct 16 18:40:05 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:40:05 user nova-compute[74247]:   <serial>5ebca4eb-599b-4fb0-afdc-99aad2670ba5</serial>
Oct 16 18:40:05 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 18:40:05 user nova-compute[74247]: </disk>
Oct 16 18:40:05 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:40:05 user nova-compute[74247]: INFO nova.virt.block_device [None req-756276e2-141f-47c2-844c-bfa9ea520877 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Attempting to driver detach volume 5f6ea7d3-1870-4dd4-aed5-f296ce384273 from mountpoint /dev/vdb
Oct 16 18:40:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-756276e2-141f-47c2-844c-bfa9ea520877 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Attempting to detach device vdb from instance 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 from the persistent domain config. {{(pid=74247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 18:40:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-756276e2-141f-47c2-844c-bfa9ea520877 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 18:40:05 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:40:05 user nova-compute[74247]:   <source dev="/dev/sdb"/>
Oct 16 18:40:05 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:40:05 user nova-compute[74247]:   <serial>5f6ea7d3-1870-4dd4-aed5-f296ce384273</serial>
Oct 16 18:40:05 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 18:40:05 user nova-compute[74247]: </disk>
Oct 16 18:40:05 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:40:05 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-756276e2-141f-47c2-844c-bfa9ea520877 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Successfully detached device vdb from instance 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 from the persistent domain config.
Oct 16 18:40:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-756276e2-141f-47c2-844c-bfa9ea520877 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 from the live domain config. {{(pid=74247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 18:40:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-756276e2-141f-47c2-844c-bfa9ea520877 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 18:40:05 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:40:05 user nova-compute[74247]:   <source dev="/dev/sdb"/>
Oct 16 18:40:05 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:40:05 user nova-compute[74247]:   <serial>5f6ea7d3-1870-4dd4-aed5-f296ce384273</serial>
Oct 16 18:40:05 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 18:40:05 user nova-compute[74247]: </disk>
Oct 16 18:40:05 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:40:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-5c10ff0a-358d-4c22-954b-7100a820f040 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d4a3995f-cd3e-41be-8901-876eefbe2bf3 {{(pid=74247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 18:40:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:40:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-756276e2-141f-47c2-844c-bfa9ea520877 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 {{(pid=74247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 18:40:06 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:40:07 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:40:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:40:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:40:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:40:07 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 18:40:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:40:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:08 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:40:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:09 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:40:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:10 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:10 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4a3995f-cd3e-41be-8901-876eefbe2bf3/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:10 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4a3995f-cd3e-41be-8901-876eefbe2bf3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:10 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4a3995f-cd3e-41be-8901-876eefbe2bf3/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:10 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4a3995f-cd3e-41be-8901-876eefbe2bf3/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:10 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:10 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:10 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:10 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:40:11 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:40:11 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:40:11 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=7788MB free_disk=24.986679077148438GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 18:40:11 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:40:11 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:40:11 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Applying migration context for instance 88ea9961-7a1d-4193-b72f-63e398752141 as it has an incoming, in-progress migration 36967c71-3398-4e6f-9e8b-1cdc93a6ac56. Migration status is finished {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 16 18:40:11 user nova-compute[74247]: INFO nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Updating resource usage from migration 36967c71-3398-4e6f-9e8b-1cdc93a6ac56
Oct 16 18:40:11 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance e37fbc27-3404-479a-be08-4d590391cf30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:40:11 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance cddf4842-1c25-4cc8-914e-af30849e4d6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:40:11 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 958af87e-69d0-4da1-8fcf-90e0f275d62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:40:11 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance d775101d-53a1-48c7-af24-91480be6af61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:40:11 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 7dcc08e9-7439-436b-8d9f-facaf04e22c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:40:11 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:40:11 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance d4a3995f-cd3e-41be-8901-876eefbe2bf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:40:11 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Migration 36967c71-3398-4e6f-9e8b-1cdc93a6ac56 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 16 18:40:11 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 88ea9961-7a1d-4193-b72f-63e398752141 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:40:11 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 220798e9-aea4-4c79-9737-175ab0598e7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:40:11 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 18:40:11 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 18:40:11 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Refreshing inventories for resource provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 16 18:40:11 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Updating ProviderTree inventory for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 16 18:40:11 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Updating inventory in ProviderTree for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 16 18:40:11 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Refreshing aggregate associations for resource provider 7b8a7b7b-c686-4162-903b-700fbc4d7273, aggregates: None {{(pid=74247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 16 18:40:11 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Refreshing trait associations for resource provider 7b8a7b7b-c686-4162-903b-700fbc4d7273, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=74247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 16 18:40:12 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:40:12 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:40:12 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 18:40:12 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.780s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:40:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:40:17 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:40:17 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 18:40:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:40:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:40:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 18:40:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 18:40:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 18:40:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:40:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:40:23 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._sync_power_states {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:40:23 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Triggering sync for uuid e37fbc27-3404-479a-be08-4d590391cf30 {{(pid=74247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 18:40:23 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Triggering sync for uuid cddf4842-1c25-4cc8-914e-af30849e4d6c {{(pid=74247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 18:40:23 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Triggering sync for uuid 958af87e-69d0-4da1-8fcf-90e0f275d62e {{(pid=74247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 18:40:23 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Triggering sync for uuid d775101d-53a1-48c7-af24-91480be6af61 {{(pid=74247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 18:40:23 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Triggering sync for uuid 7dcc08e9-7439-436b-8d9f-facaf04e22c1 {{(pid=74247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 18:40:23 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Triggering sync for uuid 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 {{(pid=74247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 18:40:23 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Triggering sync for uuid 88ea9961-7a1d-4193-b72f-63e398752141 {{(pid=74247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 18:40:23 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Triggering sync for uuid d4a3995f-cd3e-41be-8901-876eefbe2bf3 {{(pid=74247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 18:40:23 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Triggering sync for uuid 220798e9-aea4-4c79-9737-175ab0598e7e {{(pid=74247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 18:40:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "e37fbc27-3404-479a-be08-4d590391cf30" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:40:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "e37fbc27-3404-479a-be08-4d590391cf30" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:40:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "cddf4842-1c25-4cc8-914e-af30849e4d6c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:40:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "cddf4842-1c25-4cc8-914e-af30849e4d6c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:40:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "958af87e-69d0-4da1-8fcf-90e0f275d62e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:40:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "958af87e-69d0-4da1-8fcf-90e0f275d62e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:40:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "d775101d-53a1-48c7-af24-91480be6af61" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:40:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "d775101d-53a1-48c7-af24-91480be6af61" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:40:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:40:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:40:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:40:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "88ea9961-7a1d-4193-b72f-63e398752141" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:40:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "88ea9961-7a1d-4193-b72f-63e398752141" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:40:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "d4a3995f-cd3e-41be-8901-876eefbe2bf3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:40:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "220798e9-aea4-4c79-9737-175ab0598e7e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:40:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "220798e9-aea4-4c79-9737-175ab0598e7e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:40:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "e37fbc27-3404-479a-be08-4d590391cf30" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:40:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "cddf4842-1c25-4cc8-914e-af30849e4d6c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:40:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "958af87e-69d0-4da1-8fcf-90e0f275d62e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:40:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "d775101d-53a1-48c7-af24-91480be6af61" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:40:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "88ea9961-7a1d-4193-b72f-63e398752141" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:40:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:40:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "220798e9-aea4-4c79-9737-175ab0598e7e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:40:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquiring lock "cbdb3c4c-7a6f-4966-bc13-049efe0cded2" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:40:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "cbdb3c4c-7a6f-4966-bc13-049efe0cded2" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:40:24 user nova-compute[74247]: INFO nova.compute.manager [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Unshelving
Oct 16 18:40:24 user nova-compute[74247]: INFO nova.virt.block_device [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Booting with volume ba9fcdbe-9281-4ef4-97e8-4938a4d44476 at /dev/vdc
Oct 16 18:40:24 user nova-compute[74247]: DEBUG os_brick.utils [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:40:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:24 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7335bff-f6b1-48d7-9519-3b743ee77412]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:24 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9742e623-be1d-4d6e-a80d-302bc225294b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:24 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad0e79a-167a-4069-88fc-d1218a19d699]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:24 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f56f9f-edf5-42b9-8d1b-a2894aaa5ea6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:40:24 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 18:40:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:40:24 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 18:40:24 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d9ca8f-8a40-4248-bc4a-06ef592ff859]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:24 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 18:40:24 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 18:40:24 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 18:40:24 user nova-compute[74247]: DEBUG os_brick.utils [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:40:24 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Updating existing volume attachment record: ea301968-4b9f-4ba9-a0fe-207e5d022380 {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 18:40:26 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-5c10ff0a-358d-4c22-954b-7100a820f040 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d4a3995f-cd3e-41be-8901-876eefbe2bf3 is timed out.
Oct 16 18:40:26 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-5c10ff0a-358d-4c22-954b-7100a820f040 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Successfully detached device vdb from instance d4a3995f-cd3e-41be-8901-876eefbe2bf3 from the live domain config.
Oct 16 18:40:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c10ff0a-358d-4c22-954b-7100a820f040 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c10ff0a-358d-4c22-954b-7100a820f040 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ptmzdTKl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:40:26 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-5c10ff0a-358d-4c22-954b-7100a820f040 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:40:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-5c10ff0a-358d-4c22-954b-7100a820f040 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-5c10ff0a-358d-4c22-954b-7100a820f040 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6854dff-5ca2-4f2d-aeaa-42ce3177ec67]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c10ff0a-358d-4c22-954b-7100a820f040 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 18:40:26 user nova-compute[74247]: No targets found.
Oct 16 18:40:26 user nova-compute[74247]: iSNS:
Oct 16 18:40:26 user nova-compute[74247]: No targets found.
Oct 16 18:40:26 user nova-compute[74247]: STATIC:
Oct 16 18:40:26 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa
Oct 16 18:40:26 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:40:26 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:40:26 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273
Oct 16 18:40:26 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:40:26 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:40:26 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc
Oct 16 18:40:26 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:40:26 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:40:26 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5
Oct 16 18:40:26 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:40:26 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:40:26 user nova-compute[74247]: FIRMWARE:
Oct 16 18:40:26 user nova-compute[74247]: No targets found.
Oct 16 18:40:26 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c10ff0a-358d-4c22-954b-7100a820f040 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 18:40:26 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 18:40:26 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c10ff0a-358d-4c22-954b-7100a820f040 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b820d8f2-bc5c-4ae3-a290-fcd0ebf276f4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a36151-d5fa-411a-8403-3d9d701a309a]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c10ff0a-358d-4c22-954b-7100a820f040 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:40:26 user nova-compute[74247]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273 (non-flash)
Oct 16 18:40:26 user nova-compute[74247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)
Oct 16 18:40:26 user nova-compute[74247]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5 (non-flash)
Oct 16 18:40:26 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c10ff0a-358d-4c22-954b-7100a820f040 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:40:26 user nova-compute[74247]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273 (non-flash)
Oct 16 18:40:26 user nova-compute[74247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)
Oct 16 18:40:26 user nova-compute[74247]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5 (non-flash)
Oct 16 18:40:26 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c10ff0a-358d-4c22-954b-7100a820f040 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe0780f3ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5'): ({'sde'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-5c10ff0a-358d-4c22-954b-7100a820f040 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Removing single pathed devices sde {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6796a2e2-d984-4c07-a53d-b0d562ee0ef5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e644eb-679c-414f-bb03-85f63e0e159b]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-5c10ff0a-358d-4c22-954b-7100a820f040 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Flushing IO for device /dev/sde {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a9e726-2360-4a5e-8279-717ae088de4b]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-5c10ff0a-358d-4c22-954b-7100a820f040 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b455ae-5bfe-4dcb-8ff4-6f760912c808]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-5c10ff0a-358d-4c22-954b-7100a820f040 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-5c10ff0a-358d-4c22-954b-7100a820f040 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] SCSI volumes sde have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c10ff0a-358d-4c22-954b-7100a820f040 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.097s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67489f1-c8c8-4b5d-8ae2-124ea554e383]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c10ff0a-358d-4c22-954b-7100a820f040 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5 -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:26 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-756276e2-141f-47c2-844c-bfa9ea520877 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 is timed out.
Oct 16 18:40:26 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-756276e2-141f-47c2-844c-bfa9ea520877 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Successfully detached device vdb from instance 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 from the live domain config.
Oct 16 18:40:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-756276e2-141f-47c2-844c-bfa9ea520877 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-756276e2-141f-47c2-844c-bfa9ea520877 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RwLoCldU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:40:26 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-756276e2-141f-47c2-844c-bfa9ea520877 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:40:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-756276e2-141f-47c2-844c-bfa9ea520877 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0062608-8f06-4cbd-9561-deb8b92d0305]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c10ff0a-358d-4c22-954b-7100a820f040 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5, portal: 172.16.0.220,3260]
Oct 16 18:40:26 user nova-compute[74247]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5, portal: 172.16.0.220,3260] successful.
Oct 16 18:40:26 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5 -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebca4eb-599b-4fb0-afdc-99aad2670ba5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d73da13-29e1-4dbf-b873-64cc438d590b]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c10ff0a-358d-4c22-954b-7100a820f040 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-5c10ff0a-358d-4c22-954b-7100a820f040 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.405s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c10ff0a-358d-4c22-954b-7100a820f040 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] <== disconnect_volume: return (408ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c10ff0a-358d-4c22-954b-7100a820f040 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-756276e2-141f-47c2-844c-bfa9ea520877 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.055s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8cfde5-fb42-4bf0-8d43-5a70814df3a0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-756276e2-141f-47c2-844c-bfa9ea520877 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 18:40:26 user nova-compute[74247]: No targets found.
Oct 16 18:40:26 user nova-compute[74247]: iSNS:
Oct 16 18:40:26 user nova-compute[74247]: No targets found.
Oct 16 18:40:26 user nova-compute[74247]: STATIC:
Oct 16 18:40:26 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa
Oct 16 18:40:26 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:40:26 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:40:26 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273
Oct 16 18:40:26 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:40:26 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:40:26 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc
Oct 16 18:40:26 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:40:26 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:40:26 user nova-compute[74247]: FIRMWARE:
Oct 16 18:40:26 user nova-compute[74247]: No targets found.
Oct 16 18:40:26 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-756276e2-141f-47c2-844c-bfa9ea520877 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 18:40:26 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 18:40:26 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-756276e2-141f-47c2-844c-bfa9ea520877 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b50d2c-5135-49ba-a7dd-b7c2f5073802]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8bfa15c-1d03-436d-9ed1-0c62bd680d04]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-756276e2-141f-47c2-844c-bfa9ea520877 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:40:26 user nova-compute[74247]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273 (non-flash)
Oct 16 18:40:26 user nova-compute[74247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)
Oct 16 18:40:26 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-756276e2-141f-47c2-844c-bfa9ea520877 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:40:26 user nova-compute[74247]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273 (non-flash)
Oct 16 18:40:26 user nova-compute[74247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)
Oct 16 18:40:26 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-756276e2-141f-47c2-844c-bfa9ea520877 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe0484124d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273'): ({'sdb'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-756276e2-141f-47c2-844c-bfa9ea520877 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Removing single pathed devices sdb {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8c75ba-5678-45db-98f9-6d88643229f8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8131e3-3f8f-471b-8ed6-f17f81a040ed]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-756276e2-141f-47c2-844c-bfa9ea520877 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Flushing IO for device /dev/sdb {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1a33cb-61e5-4dde-8a4f-3e747d73cc70]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-756276e2-141f-47c2-844c-bfa9ea520877 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a0dd15-5a19-4b7f-8918-016559053552]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-756276e2-141f-47c2-844c-bfa9ea520877 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-756276e2-141f-47c2-844c-bfa9ea520877 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] SCSI volumes sdb have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-756276e2-141f-47c2-844c-bfa9ea520877 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8366387c-5ee4-49a6-908e-f227d595fe4e]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-756276e2-141f-47c2-844c-bfa9ea520877 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273 -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b4ea3a-b06b-4fa1-92a2-bd07ee911f26]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-756276e2-141f-47c2-844c-bfa9ea520877 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273, portal: 172.16.0.220,3260]
Oct 16 18:40:26 user nova-compute[74247]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273, portal: 172.16.0.220,3260] successful.
Oct 16 18:40:26 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273 -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f6ea7d3-1870-4dd4-aed5-f296ce384273 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f0a4b5-7108-43e0-803d-95b9a703cc39]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-756276e2-141f-47c2-844c-bfa9ea520877 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-756276e2-141f-47c2-844c-bfa9ea520877 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-756276e2-141f-47c2-844c-bfa9ea520877 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] <== disconnect_volume: return (362ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:40:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-756276e2-141f-47c2-844c-bfa9ea520877 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 18:40:27 user nova-compute[74247]: DEBUG nova.objects.instance [None req-756276e2-141f-47c2-844c-bfa9ea520877 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lazy-loading 'flavor' on Instance uuid 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:40:27 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-756276e2-141f-47c2-844c-bfa9ea520877 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.178s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:40:27 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 3.920s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:40:27 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:40:28 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:40:31 user nova-compute[74247]: DEBUG nova.objects.instance [None req-5c10ff0a-358d-4c22-954b-7100a820f040 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lazy-loading 'flavor' on Instance uuid d4a3995f-cd3e-41be-8901-876eefbe2bf3 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:40:31 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5c10ff0a-358d-4c22-954b-7100a820f040 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "d4a3995f-cd3e-41be-8901-876eefbe2bf3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.563s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:40:31 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "d4a3995f-cd3e-41be-8901-876eefbe2bf3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 7.257s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:40:31 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "d4a3995f-cd3e-41be-8901-876eefbe2bf3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:40:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:40:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:40:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:40:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:40:41 user nova-compute[74247]: DEBUG nova.objects.instance [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lazy-loading 'pci_requests' on Instance uuid cbdb3c4c-7a6f-4966-bc13-049efe0cded2 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:40:41 user nova-compute[74247]: DEBUG nova.objects.instance [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lazy-loading 'numa_topology' on Instance uuid cbdb3c4c-7a6f-4966-bc13-049efe0cded2 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:40:41 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:40:41 user nova-compute[74247]: INFO nova.compute.claims [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Claim successful on node user
Oct 16 18:40:41 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:40:41 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:40:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:40:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:40:41 user nova-compute[74247]: INFO nova.network.neutron [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Updating port 867368eb-89d8-4de5-a8cd-9a1435b624fb with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 16 18:40:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquiring lock "refresh_cache-cbdb3c4c-7a6f-4966-bc13-049efe0cded2" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:40:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquired lock "refresh_cache-cbdb3c4c-7a6f-4966-bc13-049efe0cded2" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:40:42 user nova-compute[74247]: DEBUG nova.network.neutron [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:40:42 user nova-compute[74247]: DEBUG nova.compute.manager [req-17639757-3d18-42a6-979e-40723e7ad0eb req-559d68da-3753-4e0e-bffe-d7bf3ce089f7 service nova] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Received event network-changed-867368eb-89d8-4de5-a8cd-9a1435b624fb {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:40:42 user nova-compute[74247]: DEBUG nova.compute.manager [req-17639757-3d18-42a6-979e-40723e7ad0eb req-559d68da-3753-4e0e-bffe-d7bf3ce089f7 service nova] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Refreshing instance network info cache due to event network-changed-867368eb-89d8-4de5-a8cd-9a1435b624fb. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:40:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-17639757-3d18-42a6-979e-40723e7ad0eb req-559d68da-3753-4e0e-bffe-d7bf3ce089f7 service nova] Acquiring lock "refresh_cache-cbdb3c4c-7a6f-4966-bc13-049efe0cded2" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:40:42 user nova-compute[74247]: DEBUG nova.network.neutron [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Updating instance_info_cache with network_info: [{"id": "867368eb-89d8-4de5-a8cd-9a1435b624fb", "address": "fa:16:3e:61:36:9f", "network": {"id": "88a1b265-5360-4362-90bc-3506f805688f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-620663417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5204c1aec5764c298a206429645eb268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867368eb-89", "ovs_interfaceid": "867368eb-89d8-4de5-a8cd-9a1435b624fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:40:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Releasing lock "refresh_cache-cbdb3c4c-7a6f-4966-bc13-049efe0cded2" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:40:42 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:40:42 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Creating image(s)
Oct 16 18:40:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquiring lock "/opt/stack/data/nova/instances/cbdb3c4c-7a6f-4966-bc13-049efe0cded2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:40:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "/opt/stack/data/nova/instances/cbdb3c4c-7a6f-4966-bc13-049efe0cded2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:40:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "/opt/stack/data/nova/instances/cbdb3c4c-7a6f-4966-bc13-049efe0cded2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:40:42 user nova-compute[74247]: DEBUG nova.objects.instance [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lazy-loading 'trusted_certs' on Instance uuid cbdb3c4c-7a6f-4966-bc13-049efe0cded2 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:40:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-17639757-3d18-42a6-979e-40723e7ad0eb req-559d68da-3753-4e0e-bffe-d7bf3ce089f7 service nova] Acquired lock "refresh_cache-cbdb3c4c-7a6f-4966-bc13-049efe0cded2" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:40:42 user nova-compute[74247]: DEBUG nova.network.neutron [req-17639757-3d18-42a6-979e-40723e7ad0eb req-559d68da-3753-4e0e-bffe-d7bf3ce089f7 service nova] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Refreshing network info cache for port 867368eb-89d8-4de5-a8cd-9a1435b624fb {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:40:42 user nova-compute[74247]: DEBUG nova.objects.base [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Object Instance<cbdb3c4c-7a6f-4966-bc13-049efe0cded2> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:40:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquiring lock "d277c484e2e431185468996468b02e6a3473c85c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:40:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "d277c484e2e431185468996468b02e6a3473c85c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:40:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d277c484e2e431185468996468b02e6a3473c85c.part --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:43 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:40:43 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-167d9705-8d95-48dc-8748-ab74d95b6bd3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "88ea9961-7a1d-4193-b72f-63e398752141" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:40:43 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-167d9705-8d95-48dc-8748-ab74d95b6bd3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "88ea9961-7a1d-4193-b72f-63e398752141" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:40:43 user nova-compute[74247]: DEBUG nova.compute.manager [None req-167d9705-8d95-48dc-8748-ab74d95b6bd3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Going to confirm migration 2 {{(pid=74247) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4773}}
Oct 16 18:40:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d277c484e2e431185468996468b02e6a3473c85c.part --force-share --output=json" returned: 0 in 0.185s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:43 user nova-compute[74247]: DEBUG nova.virt.images [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] 1d90996e-c523-4d83-9407-5415a6eea9ad was qcow2, converting to raw {{(pid=74247) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 16 18:40:43 user nova-compute[74247]: DEBUG nova.privsep.utils [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74247) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 18:40:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d277c484e2e431185468996468b02e6a3473c85c.part /opt/stack/data/nova/instances/_base/d277c484e2e431185468996468b02e6a3473c85c.converted {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d277c484e2e431185468996468b02e6a3473c85c.part /opt/stack/data/nova/instances/_base/d277c484e2e431185468996468b02e6a3473c85c.converted" returned: 0 in 0.257s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d277c484e2e431185468996468b02e6a3473c85c.converted --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-167d9705-8d95-48dc-8748-ab74d95b6bd3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "refresh_cache-88ea9961-7a1d-4193-b72f-63e398752141" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:40:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-167d9705-8d95-48dc-8748-ab74d95b6bd3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquired lock "refresh_cache-88ea9961-7a1d-4193-b72f-63e398752141" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:40:44 user nova-compute[74247]: DEBUG nova.network.neutron [None req-167d9705-8d95-48dc-8748-ab74d95b6bd3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:40:44 user nova-compute[74247]: DEBUG nova.objects.instance [None req-167d9705-8d95-48dc-8748-ab74d95b6bd3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lazy-loading 'info_cache' on Instance uuid 88ea9961-7a1d-4193-b72f-63e398752141 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:40:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d277c484e2e431185468996468b02e6a3473c85c.converted --force-share --output=json" returned: 0 in 0.185s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "d277c484e2e431185468996468b02e6a3473c85c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.523s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:40:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d277c484e2e431185468996468b02e6a3473c85c --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:44 user nova-compute[74247]: DEBUG nova.network.neutron [req-17639757-3d18-42a6-979e-40723e7ad0eb req-559d68da-3753-4e0e-bffe-d7bf3ce089f7 service nova] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Updated VIF entry in instance network info cache for port 867368eb-89d8-4de5-a8cd-9a1435b624fb. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:40:44 user nova-compute[74247]: DEBUG nova.network.neutron [req-17639757-3d18-42a6-979e-40723e7ad0eb req-559d68da-3753-4e0e-bffe-d7bf3ce089f7 service nova] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Updating instance_info_cache with network_info: [{"id": "867368eb-89d8-4de5-a8cd-9a1435b624fb", "address": "fa:16:3e:61:36:9f", "network": {"id": "88a1b265-5360-4362-90bc-3506f805688f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-620663417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5204c1aec5764c298a206429645eb268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867368eb-89", "ovs_interfaceid": "867368eb-89d8-4de5-a8cd-9a1435b624fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:40:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-17639757-3d18-42a6-979e-40723e7ad0eb req-559d68da-3753-4e0e-bffe-d7bf3ce089f7 service nova] Releasing lock "refresh_cache-cbdb3c4c-7a6f-4966-bc13-049efe0cded2" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:40:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d277c484e2e431185468996468b02e6a3473c85c --force-share --output=json" returned: 0 in 0.175s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquiring lock "d277c484e2e431185468996468b02e6a3473c85c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:40:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "d277c484e2e431185468996468b02e6a3473c85c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:40:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d277c484e2e431185468996468b02e6a3473c85c --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:44 user nova-compute[74247]: DEBUG nova.network.neutron [None req-167d9705-8d95-48dc-8748-ab74d95b6bd3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Updating instance_info_cache with network_info: [{"id": "f5845781-33be-4018-bc2c-72bb980ad8c8", "address": "fa:16:3e:92:70:e9", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5845781-33", "ovs_interfaceid": "f5845781-33be-4018-bc2c-72bb980ad8c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:40:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d277c484e2e431185468996468b02e6a3473c85c --force-share --output=json" returned: 0 in 0.181s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d277c484e2e431185468996468b02e6a3473c85c,backing_fmt=raw /opt/stack/data/nova/instances/cbdb3c4c-7a6f-4966-bc13-049efe0cded2/disk 1073741824 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-167d9705-8d95-48dc-8748-ab74d95b6bd3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Releasing lock "refresh_cache-88ea9961-7a1d-4193-b72f-63e398752141" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:40:44 user nova-compute[74247]: DEBUG nova.objects.instance [None req-167d9705-8d95-48dc-8748-ab74d95b6bd3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lazy-loading 'migration_context' on Instance uuid 88ea9961-7a1d-4193-b72f-63e398752141 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:40:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d277c484e2e431185468996468b02e6a3473c85c,backing_fmt=raw /opt/stack/data/nova/instances/cbdb3c4c-7a6f-4966-bc13-049efe0cded2/disk 1073741824" returned: 0 in 0.056s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "d277c484e2e431185468996468b02e6a3473c85c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:40:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d277c484e2e431185468996468b02e6a3473c85c --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:44 user nova-compute[74247]: DEBUG nova.objects.base [None req-167d9705-8d95-48dc-8748-ab74d95b6bd3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Object Instance<88ea9961-7a1d-4193-b72f-63e398752141> lazy-loaded attributes: info_cache,migration_context {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:40:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-167d9705-8d95-48dc-8748-ab74d95b6bd3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:40:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-167d9705-8d95-48dc-8748-ab74d95b6bd3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:40:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d277c484e2e431185468996468b02e6a3473c85c --force-share --output=json" returned: 0 in 0.188s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:44 user nova-compute[74247]: DEBUG nova.objects.instance [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lazy-loading 'migration_context' on Instance uuid cbdb3c4c-7a6f-4966-bc13-049efe0cded2 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:40:44 user nova-compute[74247]: DEBUG nova.objects.base [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Object Instance<cbdb3c4c-7a6f-4966-bc13-049efe0cded2> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:40:44 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Rebasing disk image.
Oct 16 18:40:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.182s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 -F raw /opt/stack/data/nova/instances/cbdb3c4c-7a6f-4966-bc13-049efe0cded2/disk {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:45 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-167d9705-8d95-48dc-8748-ab74d95b6bd3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:40:45 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-167d9705-8d95-48dc-8748-ab74d95b6bd3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:40:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-167d9705-8d95-48dc-8748-ab74d95b6bd3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.593s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:40:45 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-167d9705-8d95-48dc-8748-ab74d95b6bd3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Deleted allocation for migration 36967c71-3398-4e6f-9e8b-1cdc93a6ac56
Oct 16 18:40:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-167d9705-8d95-48dc-8748-ab74d95b6bd3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "88ea9961-7a1d-4193-b72f-63e398752141" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.798s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 -F raw /opt/stack/data/nova/instances/cbdb3c4c-7a6f-4966-bc13-049efe0cded2/disk" returned: 0 in 2.184s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Ensure instance console log exists: /opt/stack/data/nova/instances/cbdb3c4c-7a6f-4966-bc13-049efe0cded2/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Start _get_guest_xml network_info=[{"id": "867368eb-89d8-4de5-a8cd-9a1435b624fb", "address": "fa:16:3e:61:36:9f", "network": {"id": "88a1b265-5360-4362-90bc-3506f805688f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-620663417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5204c1aec5764c298a206429645eb268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867368eb-89", "ovs_interfaceid": "867368eb-89d8-4de5-a8cd-9a1435b624fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='0d2846f508e0d223fcacc7502f36e9d3',container_format='bare',created_at=2023-10-16T18:38:31Z,direct_url=<?>,disk_format='qcow2',id=1d90996e-c523-4d83-9407-5415a6eea9ad,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-803649508-shelved',owner='5204c1aec5764c298a206429645eb268',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-16T18:38:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': '83126bb1-29f5-42fe-8620-72ab0797f776'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdc', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oEbtUpcj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'cbdb3c4c-7a6f-4966-bc13-049efe0cded2', 'attached_at': '', 'detached_at': '', 'volume_id': 'ba9fcdbe-9281-4ef4-97e8-4938a4d44476', 'serial': 'ba9fcdbe-9281-4ef4-97e8-4938a4d44476'}, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'ea301968-4b9f-4ba9-a0fe-207e5d022380', 'guest_format': None, 'volume_type': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:40:47 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:40:47 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:40:47 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0d2846f508e0d223fcacc7502f36e9d3',container_format='bare',created_at=2023-10-16T18:38:31Z,direct_url=<?>,disk_format='qcow2',id=1d90996e-c523-4d83-9407-5415a6eea9ad,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-803649508-shelved',owner='5204c1aec5764c298a206429645eb268',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-16T18:38:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG nova.objects.instance [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lazy-loading 'vcpu_model' on Instance uuid cbdb3c4c-7a6f-4966-bc13-049efe0cded2 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG nova.objects.base [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Object Instance<cbdb3c4c-7a6f-4966-bc13-049efe0cded2> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oEbtUpcj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:40:47 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:40:47 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:40:47 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:40:47 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:40:47 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:40:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476 -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5601f3e4-6c98-44cc-9724-91f2fef4bb9c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 18:40:47 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476 -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0587f78-cb3b-47f6-8eaa-4cac85f5120c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476] added
Oct 16 18:40:47 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1078001-3f47-4afb-88f5-75877dd2c177]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5874c9ce-e543-4f13-93ff-67e20a3e4ba3]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oEbtUpcj {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oEbtUpcj" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1dc421-7a8e-4ff7-a9b1-f51122bf459f]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oEbtUpcj'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[709474be-4362-4845-8736-9f1709309587]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae75b968-9a72-4ba1-aef2-e84969bdda57]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:40:47 user nova-compute[74247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)
Oct 16 18:40:47 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:40:47 user nova-compute[74247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)
Oct 16 18:40:47 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476 -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba77bec-277f-4baa-b5e1-ecc3a8778cdf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476, portal: 172.16.0.220,3260]
Oct 16 18:40:47 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476, portal: 172.16.0.220,3260] successful.
Oct 16 18:40:47 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ed0628-95d7-4bba-9774-741f6e10a534]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6731218f-fbb2-45ee-aa26-2254fed627a9]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:40:47 user nova-compute[74247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)
Oct 16 18:40:47 user nova-compute[74247]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476 (non-flash)
Oct 16 18:40:47 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:40:47 user nova-compute[74247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)
Oct 16 18:40:47 user nova-compute[74247]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476 (non-flash)
Oct 16 18:40:47 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.029s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef51195-9d8d-4f0e-8ec0-d04aacf88944]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:40:47 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: None {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:40:48 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:40:48 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:40:48 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oEbtUpcj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:40:48 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:40:48 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '26462666163666337', 'path': '/dev/sdb'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:40:48 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462666163666337', 'path': '/dev/sdb'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:40:48 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T18:36:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-803649508',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-803649508',id=25,image_ref='1d90996e-c523-4d83-9407-5415a6eea9ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1823297427',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:36:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5204c1aec5764c298a206429645eb268',ramdisk_id='',reservation_id='r-cnkbq1wz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-537076068',owner_user_name='tempest-AttachVolumeShelveTestJSON-537076068-project-member',shelved_at='2023-10-16T18:38:35.775297',shelved_host='user',shelved_image_id='1d90996e-c523-4d83-9407-5415a6eea9ad'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:40:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bda4c43b45347be96b152caba47b07d',uuid=cbdb3c4c-7a6f-4966-bc13-049efe0cded2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "867368eb-89d8-4de5-a8cd-9a1435b624fb", "address": "fa:16:3e:61:36:9f", "network": {"id": "88a1b265-5360-4362-90bc-3506f805688f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-620663417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5204c1aec5764c298a206429645eb268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867368eb-89", "ovs_interfaceid": "867368eb-89d8-4de5-a8cd-9a1435b624fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:40:48 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Converting VIF {"id": "867368eb-89d8-4de5-a8cd-9a1435b624fb", "address": "fa:16:3e:61:36:9f", "network": {"id": "88a1b265-5360-4362-90bc-3506f805688f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-620663417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5204c1aec5764c298a206429645eb268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867368eb-89", "ovs_interfaceid": "867368eb-89d8-4de5-a8cd-9a1435b624fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:40:48 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:36:9f,bridge_name='br-int',has_traffic_filtering=True,id=867368eb-89d8-4de5-a8cd-9a1435b624fb,network=Network(88a1b265-5360-4362-90bc-3506f805688f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867368eb-89') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:40:48 user nova-compute[74247]: DEBUG nova.objects.instance [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lazy-loading 'pci_devices' on Instance uuid cbdb3c4c-7a6f-4966-bc13-049efe0cded2 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:40:48 user nova-compute[74247]: DEBUG nova.objects.base [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Object Instance<cbdb3c4c-7a6f-4966-bc13-049efe0cded2> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:40:48 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:40:48 user nova-compute[74247]:   <uuid>cbdb3c4c-7a6f-4966-bc13-049efe0cded2</uuid>
Oct 16 18:40:48 user nova-compute[74247]:   <name>instance-00000019</name>
Oct 16 18:40:48 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:40:48 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:40:48 user nova-compute[74247]:   <metadata>
Oct 16 18:40:48 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:40:48 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:40:48 user nova-compute[74247]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-803649508</nova:name>
Oct 16 18:40:48 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:40:47</nova:creationTime>
Oct 16 18:40:48 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:40:48 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:40:48 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:40:48 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:40:48 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:40:48 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:40:48 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:40:48 user nova-compute[74247]:       <nova:owner>
Oct 16 18:40:48 user nova-compute[74247]:         <nova:user uuid="2bda4c43b45347be96b152caba47b07d">tempest-AttachVolumeShelveTestJSON-537076068-project-member</nova:user>
Oct 16 18:40:48 user nova-compute[74247]:         <nova:project uuid="5204c1aec5764c298a206429645eb268">tempest-AttachVolumeShelveTestJSON-537076068</nova:project>
Oct 16 18:40:48 user nova-compute[74247]:       </nova:owner>
Oct 16 18:40:48 user nova-compute[74247]:       <nova:root type="image" uuid="1d90996e-c523-4d83-9407-5415a6eea9ad"/>
Oct 16 18:40:48 user nova-compute[74247]:       <nova:ports>
Oct 16 18:40:48 user nova-compute[74247]:         <nova:port uuid="867368eb-89d8-4de5-a8cd-9a1435b624fb">
Oct 16 18:40:48 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 16 18:40:48 user nova-compute[74247]:         </nova:port>
Oct 16 18:40:48 user nova-compute[74247]:       </nova:ports>
Oct 16 18:40:48 user nova-compute[74247]:     </nova:instance>
Oct 16 18:40:48 user nova-compute[74247]:   </metadata>
Oct 16 18:40:48 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:40:48 user nova-compute[74247]:     <system>
Oct 16 18:40:48 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:40:48 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:40:48 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:40:48 user nova-compute[74247]:       <entry name="serial">cbdb3c4c-7a6f-4966-bc13-049efe0cded2</entry>
Oct 16 18:40:48 user nova-compute[74247]:       <entry name="uuid">cbdb3c4c-7a6f-4966-bc13-049efe0cded2</entry>
Oct 16 18:40:48 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:40:48 user nova-compute[74247]:     </system>
Oct 16 18:40:48 user nova-compute[74247]:   </sysinfo>
Oct 16 18:40:48 user nova-compute[74247]:   <os>
Oct 16 18:40:48 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:40:48 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:40:48 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:40:48 user nova-compute[74247]:   </os>
Oct 16 18:40:48 user nova-compute[74247]:   <features>
Oct 16 18:40:48 user nova-compute[74247]:     <acpi/>
Oct 16 18:40:48 user nova-compute[74247]:     <apic/>
Oct 16 18:40:48 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:40:48 user nova-compute[74247]:   </features>
Oct 16 18:40:48 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:40:48 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:40:48 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:40:48 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:40:48 user nova-compute[74247]:   </clock>
Oct 16 18:40:48 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:40:48 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:40:48 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:40:48 user nova-compute[74247]:   </cpu>
Oct 16 18:40:48 user nova-compute[74247]:   <devices>
Oct 16 18:40:48 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:40:48 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:40:48 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/cbdb3c4c-7a6f-4966-bc13-049efe0cded2/disk"/>
Oct 16 18:40:48 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:40:48 user nova-compute[74247]:     </disk>
Oct 16 18:40:48 user nova-compute[74247]:     <disk type="block" device="disk">
Oct 16 18:40:48 user nova-compute[74247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:40:48 user nova-compute[74247]:       <source dev="/dev/sdb"/>
Oct 16 18:40:48 user nova-compute[74247]:       <target dev="vdc" bus="virtio"/>
Oct 16 18:40:48 user nova-compute[74247]:       <serial>ba9fcdbe-9281-4ef4-97e8-4938a4d44476</serial>
Oct 16 18:40:48 user nova-compute[74247]:     </disk>
Oct 16 18:40:48 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:40:48 user nova-compute[74247]:       <mac address="fa:16:3e:61:36:9f"/>
Oct 16 18:40:48 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:40:48 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:40:48 user nova-compute[74247]:       <target dev="tap867368eb-89"/>
Oct 16 18:40:48 user nova-compute[74247]:     </interface>
Oct 16 18:40:48 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:40:48 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/cbdb3c4c-7a6f-4966-bc13-049efe0cded2/console.log" append="off"/>
Oct 16 18:40:48 user nova-compute[74247]:     </serial>
Oct 16 18:40:48 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:40:48 user nova-compute[74247]:     <video>
Oct 16 18:40:48 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:40:48 user nova-compute[74247]:     </video>
Oct 16 18:40:48 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:40:48 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:40:48 user nova-compute[74247]:     </rng>
Oct 16 18:40:48 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:40:48 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:40:48 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:40:48 user nova-compute[74247]:     </memballoon>
Oct 16 18:40:48 user nova-compute[74247]:   </devices>
Oct 16 18:40:48 user nova-compute[74247]: </domain>
Oct 16 18:40:48 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:40:48 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T18:36:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-803649508',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-803649508',id=25,image_ref='1d90996e-c523-4d83-9407-5415a6eea9ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1823297427',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:36:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5204c1aec5764c298a206429645eb268',ramdisk_id='',reservation_id='r-cnkbq1wz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-537076068',owner_user_name='tempest-AttachVolumeShelveTestJSON-537076068-project-member',shelved_at='2023-10-16T18:38:35.775297',shelved_host='user',shelved_image_id='1d90996e-c523-4d83-9407-5415a6eea9ad'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:40:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bda4c43b45347be96b152caba47b07d',uuid=cbdb3c4c-7a6f-4966-bc13-049efe0cded2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "867368eb-89d8-4de5-a8cd-9a1435b624fb", "address": "fa:16:3e:61:36:9f", "network": {"id": "88a1b265-5360-4362-90bc-3506f805688f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-620663417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5204c1aec5764c298a206429645eb268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867368eb-89", "ovs_interfaceid": "867368eb-89d8-4de5-a8cd-9a1435b624fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:40:48 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Converting VIF {"id": "867368eb-89d8-4de5-a8cd-9a1435b624fb", "address": "fa:16:3e:61:36:9f", "network": {"id": "88a1b265-5360-4362-90bc-3506f805688f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-620663417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5204c1aec5764c298a206429645eb268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867368eb-89", "ovs_interfaceid": "867368eb-89d8-4de5-a8cd-9a1435b624fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:40:48 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:36:9f,bridge_name='br-int',has_traffic_filtering=True,id=867368eb-89d8-4de5-a8cd-9a1435b624fb,network=Network(88a1b265-5360-4362-90bc-3506f805688f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867368eb-89') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:40:48 user nova-compute[74247]: DEBUG os_vif [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:36:9f,bridge_name='br-int',has_traffic_filtering=True,id=867368eb-89d8-4de5-a8cd-9a1435b624fb,network=Network(88a1b265-5360-4362-90bc-3506f805688f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867368eb-89') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:40:48 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:40:48 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:40:48 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:40:48 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:40:48 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6e2a5c44-a606-51e5-aa97-7447108fe7dd', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:40:48 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:40:48 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:40:48 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:40:48 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap867368eb-89, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:40:48 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap867368eb-89, col_values=(('qos', UUID('33844961-bd7b-47e0-a3e9-a5e2a1159e24')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:40:48 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap867368eb-89, col_values=(('external_ids', {'iface-id': '867368eb-89d8-4de5-a8cd-9a1435b624fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:36:9f', 'vm-uuid': 'cbdb3c4c-7a6f-4966-bc13-049efe0cded2'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:40:48 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:40:48 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:40:48 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:40:48 user nova-compute[74247]: INFO os_vif [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:36:9f,bridge_name='br-int',has_traffic_filtering=True,id=867368eb-89d8-4de5-a8cd-9a1435b624fb,network=Network(88a1b265-5360-4362-90bc-3506f805688f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867368eb-89')
Oct 16 18:40:48 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:40:48 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:40:48 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] No VIF found with MAC fa:16:3e:61:36:9f, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:40:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:40:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:40:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:40:50 user nova-compute[74247]: DEBUG nova.compute.manager [req-19fe3a9f-43d4-43ae-9ec6-e25c15c72ff5 req-1f47fa2a-7445-47ae-a267-7843dc8a0a6f service nova] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Received event network-vif-plugged-867368eb-89d8-4de5-a8cd-9a1435b624fb {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:40:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-19fe3a9f-43d4-43ae-9ec6-e25c15c72ff5 req-1f47fa2a-7445-47ae-a267-7843dc8a0a6f service nova] Acquiring lock "cbdb3c4c-7a6f-4966-bc13-049efe0cded2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:40:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-19fe3a9f-43d4-43ae-9ec6-e25c15c72ff5 req-1f47fa2a-7445-47ae-a267-7843dc8a0a6f service nova] Lock "cbdb3c4c-7a6f-4966-bc13-049efe0cded2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:40:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-19fe3a9f-43d4-43ae-9ec6-e25c15c72ff5 req-1f47fa2a-7445-47ae-a267-7843dc8a0a6f service nova] Lock "cbdb3c4c-7a6f-4966-bc13-049efe0cded2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:40:50 user nova-compute[74247]: DEBUG nova.compute.manager [req-19fe3a9f-43d4-43ae-9ec6-e25c15c72ff5 req-1f47fa2a-7445-47ae-a267-7843dc8a0a6f service nova] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] No waiting events found dispatching network-vif-plugged-867368eb-89d8-4de5-a8cd-9a1435b624fb {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:40:50 user nova-compute[74247]: WARNING nova.compute.manager [req-19fe3a9f-43d4-43ae-9ec6-e25c15c72ff5 req-1f47fa2a-7445-47ae-a267-7843dc8a0a6f service nova] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Received unexpected event network-vif-plugged-867368eb-89d8-4de5-a8cd-9a1435b624fb for instance with vm_state shelved_offloaded and task_state spawning.
Oct 16 18:40:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:40:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:40:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:40:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:40:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:40:52 user nova-compute[74247]: DEBUG nova.compute.manager [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:40:52 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:40:52 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Instance spawned successfully.
Oct 16 18:40:52 user nova-compute[74247]: DEBUG nova.compute.manager [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:40:52 user nova-compute[74247]: DEBUG nova.compute.manager [req-8f53d7e4-d253-4bf9-ae68-49cebfa05b25 req-01346988-5200-4353-9b4d-d91247cc71a1 service nova] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Received event network-vif-plugged-867368eb-89d8-4de5-a8cd-9a1435b624fb {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:40:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-8f53d7e4-d253-4bf9-ae68-49cebfa05b25 req-01346988-5200-4353-9b4d-d91247cc71a1 service nova] Acquiring lock "cbdb3c4c-7a6f-4966-bc13-049efe0cded2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:40:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-8f53d7e4-d253-4bf9-ae68-49cebfa05b25 req-01346988-5200-4353-9b4d-d91247cc71a1 service nova] Lock "cbdb3c4c-7a6f-4966-bc13-049efe0cded2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:40:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-8f53d7e4-d253-4bf9-ae68-49cebfa05b25 req-01346988-5200-4353-9b4d-d91247cc71a1 service nova] Lock "cbdb3c4c-7a6f-4966-bc13-049efe0cded2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:40:52 user nova-compute[74247]: DEBUG nova.compute.manager [req-8f53d7e4-d253-4bf9-ae68-49cebfa05b25 req-01346988-5200-4353-9b4d-d91247cc71a1 service nova] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] No waiting events found dispatching network-vif-plugged-867368eb-89d8-4de5-a8cd-9a1435b624fb {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:40:52 user nova-compute[74247]: WARNING nova.compute.manager [req-8f53d7e4-d253-4bf9-ae68-49cebfa05b25 req-01346988-5200-4353-9b4d-d91247cc71a1 service nova] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Received unexpected event network-vif-plugged-867368eb-89d8-4de5-a8cd-9a1435b624fb for instance with vm_state shelved_offloaded and task_state spawning.
Oct 16 18:40:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-856d19df-57ee-4529-9ee8-ddc99e6fe640 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "cbdb3c4c-7a6f-4966-bc13-049efe0cded2" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 28.417s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:40:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:40:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-42594f14-e98e-4517-ab29-f3c9085f48c2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "d4a3995f-cd3e-41be-8901-876eefbe2bf3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:40:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-42594f14-e98e-4517-ab29-f3c9085f48c2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "d4a3995f-cd3e-41be-8901-876eefbe2bf3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:40:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-42594f14-e98e-4517-ab29-f3c9085f48c2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "d4a3995f-cd3e-41be-8901-876eefbe2bf3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:40:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-42594f14-e98e-4517-ab29-f3c9085f48c2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "d4a3995f-cd3e-41be-8901-876eefbe2bf3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:40:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-42594f14-e98e-4517-ab29-f3c9085f48c2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "d4a3995f-cd3e-41be-8901-876eefbe2bf3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:40:55 user nova-compute[74247]: INFO nova.compute.manager [None req-42594f14-e98e-4517-ab29-f3c9085f48c2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Terminating instance
Oct 16 18:40:56 user nova-compute[74247]: DEBUG nova.compute.manager [None req-42594f14-e98e-4517-ab29-f3c9085f48c2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 18:40:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:40:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:40:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:40:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:40:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:40:56 user nova-compute[74247]: DEBUG nova.compute.manager [req-0e913ff0-55d6-4fd3-bb44-af18f95f6b95 req-9a5ddec7-4466-4bae-b4cc-5d87a786ab30 service nova] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Received event network-vif-unplugged-68286914-fc60-4ccc-a7c9-28c15f8fbaf4 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:40:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0e913ff0-55d6-4fd3-bb44-af18f95f6b95 req-9a5ddec7-4466-4bae-b4cc-5d87a786ab30 service nova] Acquiring lock "d4a3995f-cd3e-41be-8901-876eefbe2bf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:40:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0e913ff0-55d6-4fd3-bb44-af18f95f6b95 req-9a5ddec7-4466-4bae-b4cc-5d87a786ab30 service nova] Lock "d4a3995f-cd3e-41be-8901-876eefbe2bf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:40:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0e913ff0-55d6-4fd3-bb44-af18f95f6b95 req-9a5ddec7-4466-4bae-b4cc-5d87a786ab30 service nova] Lock "d4a3995f-cd3e-41be-8901-876eefbe2bf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:40:56 user nova-compute[74247]: DEBUG nova.compute.manager [req-0e913ff0-55d6-4fd3-bb44-af18f95f6b95 req-9a5ddec7-4466-4bae-b4cc-5d87a786ab30 service nova] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] No waiting events found dispatching network-vif-unplugged-68286914-fc60-4ccc-a7c9-28c15f8fbaf4 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:40:56 user nova-compute[74247]: DEBUG nova.compute.manager [req-0e913ff0-55d6-4fd3-bb44-af18f95f6b95 req-9a5ddec7-4466-4bae-b4cc-5d87a786ab30 service nova] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Received event network-vif-unplugged-68286914-fc60-4ccc-a7c9-28c15f8fbaf4 for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:40:57 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Instance destroyed successfully.
Oct 16 18:40:57 user nova-compute[74247]: DEBUG nova.objects.instance [None req-42594f14-e98e-4517-ab29-f3c9085f48c2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lazy-loading 'resources' on Instance uuid d4a3995f-cd3e-41be-8901-876eefbe2bf3 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:40:57 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-42594f14-e98e-4517-ab29-f3c9085f48c2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:37:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1641719442',display_name='tempest-AttachVolumeNegativeTest-server-1641719442',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1641719442',id=28,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0opAjv/rnWQNgTWt1EWKYD3cHYUa4w2NcYl8C+PJ2CqgwCzHHyQUqb06qj65YJlCsjDCTEZJZ5aFEVG1MfIJ4I8f1zqnVAu8snshO6RRlGRKUwQ75iSRcABbbj51UHtA==',key_name='tempest-keypair-1748542013',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:37:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c96ced9d4c0c474fbc7edeed6f73324a',ramdisk_id='',reservation_id='r-lu7tl6o7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1731725928',owner_user_name='tempest-AttachVolumeNegativeTest-1731725928-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:37:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bd70613da1f489f86227655ff364795',uuid=d4a3995f-cd3e-41be-8901-876eefbe2bf3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68286914-fc60-4ccc-a7c9-28c15f8fbaf4", "address": "fa:16:3e:77:59:59", "network": {"id": "fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1988491128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96ced9d4c0c474fbc7edeed6f73324a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68286914-fc", "ovs_interfaceid": "68286914-fc60-4ccc-a7c9-28c15f8fbaf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:40:57 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-42594f14-e98e-4517-ab29-f3c9085f48c2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Converting VIF {"id": "68286914-fc60-4ccc-a7c9-28c15f8fbaf4", "address": "fa:16:3e:77:59:59", "network": {"id": "fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1988491128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96ced9d4c0c474fbc7edeed6f73324a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68286914-fc", "ovs_interfaceid": "68286914-fc60-4ccc-a7c9-28c15f8fbaf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:40:57 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-42594f14-e98e-4517-ab29-f3c9085f48c2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:59:59,bridge_name='br-int',has_traffic_filtering=True,id=68286914-fc60-4ccc-a7c9-28c15f8fbaf4,network=Network(fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68286914-fc') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:40:57 user nova-compute[74247]: DEBUG os_vif [None req-42594f14-e98e-4517-ab29-f3c9085f48c2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:59:59,bridge_name='br-int',has_traffic_filtering=True,id=68286914-fc60-4ccc-a7c9-28c15f8fbaf4,network=Network(fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68286914-fc') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:40:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:40:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68286914-fc, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:40:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:40:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:40:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:40:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=68985845-0d18-4da4-8f3e-e739ed96bb56) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:40:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:40:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:40:57 user nova-compute[74247]: INFO os_vif [None req-42594f14-e98e-4517-ab29-f3c9085f48c2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:59:59,bridge_name='br-int',has_traffic_filtering=True,id=68286914-fc60-4ccc-a7c9-28c15f8fbaf4,network=Network(fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68286914-fc')
Oct 16 18:40:57 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-42594f14-e98e-4517-ab29-f3c9085f48c2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Deleting instance files /opt/stack/data/nova/instances/d4a3995f-cd3e-41be-8901-876eefbe2bf3_del
Oct 16 18:40:57 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-42594f14-e98e-4517-ab29-f3c9085f48c2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Deletion of /opt/stack/data/nova/instances/d4a3995f-cd3e-41be-8901-876eefbe2bf3_del complete
Oct 16 18:40:57 user nova-compute[74247]: INFO nova.compute.manager [None req-42594f14-e98e-4517-ab29-f3c9085f48c2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Took 1.16 seconds to destroy the instance on the hypervisor.
Oct 16 18:40:57 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-42594f14-e98e-4517-ab29-f3c9085f48c2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 18:40:57 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 18:40:57 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 18:40:58 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:40:58 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Took 1.11 seconds to deallocate network for instance.
Oct 16 18:40:58 user nova-compute[74247]: DEBUG nova.compute.manager [req-e7bbaf71-96d4-4276-8382-1c7e600f09ed req-412abd01-6f31-48aa-a4ae-6297d19135de service nova] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Received event network-vif-deleted-68286914-fc60-4ccc-a7c9-28c15f8fbaf4 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:40:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-42594f14-e98e-4517-ab29-f3c9085f48c2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:40:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-42594f14-e98e-4517-ab29-f3c9085f48c2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:40:58 user nova-compute[74247]: DEBUG nova.compute.manager [req-40b2bcfa-636f-4850-86f5-5c03bdc09e09 req-39cb3d6e-f840-47c7-a532-d837e553ddfb service nova] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Received event network-vif-plugged-68286914-fc60-4ccc-a7c9-28c15f8fbaf4 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:40:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-40b2bcfa-636f-4850-86f5-5c03bdc09e09 req-39cb3d6e-f840-47c7-a532-d837e553ddfb service nova] Acquiring lock "d4a3995f-cd3e-41be-8901-876eefbe2bf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:40:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-40b2bcfa-636f-4850-86f5-5c03bdc09e09 req-39cb3d6e-f840-47c7-a532-d837e553ddfb service nova] Lock "d4a3995f-cd3e-41be-8901-876eefbe2bf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:40:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-40b2bcfa-636f-4850-86f5-5c03bdc09e09 req-39cb3d6e-f840-47c7-a532-d837e553ddfb service nova] Lock "d4a3995f-cd3e-41be-8901-876eefbe2bf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:40:58 user nova-compute[74247]: DEBUG nova.compute.manager [req-40b2bcfa-636f-4850-86f5-5c03bdc09e09 req-39cb3d6e-f840-47c7-a532-d837e553ddfb service nova] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] No waiting events found dispatching network-vif-plugged-68286914-fc60-4ccc-a7c9-28c15f8fbaf4 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:40:58 user nova-compute[74247]: WARNING nova.compute.manager [req-40b2bcfa-636f-4850-86f5-5c03bdc09e09 req-39cb3d6e-f840-47c7-a532-d837e553ddfb service nova] [instance: d4a3995f-cd3e-41be-8901-876eefbe2bf3] Received unexpected event network-vif-plugged-68286914-fc60-4ccc-a7c9-28c15f8fbaf4 for instance with vm_state deleted and task_state None.
Oct 16 18:40:58 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-42594f14-e98e-4517-ab29-f3c9085f48c2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:40:58 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-42594f14-e98e-4517-ab29-f3c9085f48c2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:40:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-42594f14-e98e-4517-ab29-f3c9085f48c2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.371s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:40:58 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-42594f14-e98e-4517-ab29-f3c9085f48c2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Deleted allocations for instance d4a3995f-cd3e-41be-8901-876eefbe2bf3
Oct 16 18:40:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-42594f14-e98e-4517-ab29-f3c9085f48c2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "d4a3995f-cd3e-41be-8901-876eefbe2bf3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.847s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:41:02 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:41:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquiring lock "3dfec5ff-83b2-442e-af36-d17e959bf316" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:41:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "3dfec5ff-83b2-442e-af36-d17e959bf316" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:41:02 user nova-compute[74247]: DEBUG nova.compute.manager [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 18:41:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:41:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:41:02 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:41:02 user nova-compute[74247]: INFO nova.compute.claims [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Claim successful on node user
Oct 16 18:41:03 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:41:03 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:41:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.450s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:41:03 user nova-compute[74247]: DEBUG nova.compute.manager [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 18:41:03 user nova-compute[74247]: DEBUG nova.compute.manager [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 18:41:03 user nova-compute[74247]: DEBUG nova.network.neutron [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 18:41:03 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 18:41:03 user nova-compute[74247]: DEBUG nova.compute.manager [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 18:41:03 user nova-compute[74247]: DEBUG nova.policy [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '51026968ba1f49eaa8e0cc27a81855db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16160dad45544c6e8d9758e883089822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 18:41:03 user nova-compute[74247]: DEBUG nova.compute.manager [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 18:41:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:41:03 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Creating image(s)
Oct 16 18:41:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquiring lock "/opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:41:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "/opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:41:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "/opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:41:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.307s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquiring lock "37399febbd18f60b85fd0f833558f6a3539ab231" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:41:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:41:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.214s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/disk 1073741824 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/disk 1073741824" returned: 0 in 0.061s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:41:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.220s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:04 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/disk. size=1073741824 {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 18:41:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:04 user nova-compute[74247]: DEBUG nova.network.neutron [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Successfully created port: 2ebee28a-6811-4631-a379-665b2ac7c97b {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:41:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:04 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Cannot resize image /opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/disk to a smaller size. {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 18:41:04 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 18:41:04 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Ensure instance console log exists: /opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:41:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:41:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:41:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:41:04 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:41:04 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 18:41:04 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Didn't find any instances for network info cache update. {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 18:41:04 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG nova.network.neutron [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Successfully updated port: 2ebee28a-6811-4631-a379-665b2ac7c97b {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquiring lock "refresh_cache-3dfec5ff-83b2-442e-af36-d17e959bf316" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquired lock "refresh_cache-3dfec5ff-83b2-442e-af36-d17e959bf316" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG nova.network.neutron [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-5c3060fb-b561-4a1b-93c7-f132edea6d5b req-67f18cf3-f02e-4701-a8e8-4783f7e3a1c4 service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Received event network-changed-2ebee28a-6811-4631-a379-665b2ac7c97b {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-5c3060fb-b561-4a1b-93c7-f132edea6d5b req-67f18cf3-f02e-4701-a8e8-4783f7e3a1c4 service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Refreshing instance network info cache due to event network-changed-2ebee28a-6811-4631-a379-665b2ac7c97b. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-5c3060fb-b561-4a1b-93c7-f132edea6d5b req-67f18cf3-f02e-4701-a8e8-4783f7e3a1c4 service nova] Acquiring lock "refresh_cache-3dfec5ff-83b2-442e-af36-d17e959bf316" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG nova.network.neutron [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG nova.network.neutron [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Updating instance_info_cache with network_info: [{"id": "2ebee28a-6811-4631-a379-665b2ac7c97b", "address": "fa:16:3e:12:f3:44", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebee28a-68", "ovs_interfaceid": "2ebee28a-6811-4631-a379-665b2ac7c97b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Releasing lock "refresh_cache-3dfec5ff-83b2-442e-af36-d17e959bf316" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG nova.compute.manager [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Instance network_info: |[{"id": "2ebee28a-6811-4631-a379-665b2ac7c97b", "address": "fa:16:3e:12:f3:44", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebee28a-68", "ovs_interfaceid": "2ebee28a-6811-4631-a379-665b2ac7c97b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-5c3060fb-b561-4a1b-93c7-f132edea6d5b req-67f18cf3-f02e-4701-a8e8-4783f7e3a1c4 service nova] Acquired lock "refresh_cache-3dfec5ff-83b2-442e-af36-d17e959bf316" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG nova.network.neutron [req-5c3060fb-b561-4a1b-93c7-f132edea6d5b req-67f18cf3-f02e-4701-a8e8-4783f7e3a1c4 service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Refreshing network info cache for port 2ebee28a-6811-4631-a379-665b2ac7c97b {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Start _get_guest_xml network_info=[{"id": "2ebee28a-6811-4631-a379-665b2ac7c97b", "address": "fa:16:3e:12:f3:44", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebee28a-68", "ovs_interfaceid": "2ebee28a-6811-4631-a379-665b2ac7c97b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': '83126bb1-29f5-42fe-8620-72ab0797f776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:41:05 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:41:05 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:41:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:41:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1641247620',display_name='tempest-ServerRescueNegativeTestJSON-server-1641247620',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1641247620',id=30,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPsDWRwLQfsC0Y7dw9Z15xe1y5GC7wHRETqUhbz5J1D6I9OPjIxouEGDX+yZjSp+CFSUIs9c1ficEwzIGhYvXQr7II5hyw6ajkuKxYHIVRNPTwDYN/rcvL+tVrC3iDbD+Q==',key_name='tempest-keypair-1614073413',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16160dad45544c6e8d9758e883089822',ramdisk_id='',reservation_id='r-61vw28hu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2007731322',owner_user_name='tempest-ServerRescueNegativeTestJSON-2007731322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:41:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51026968ba1f49eaa8e0cc27a81855db',uuid=3dfec5ff-83b2-442e-af36-d17e959bf316,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ebee28a-6811-4631-a379-665b2ac7c97b", "address": "fa:16:3e:12:f3:44", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebee28a-68", "ovs_interfaceid": "2ebee28a-6811-4631-a379-665b2ac7c97b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Converting VIF {"id": "2ebee28a-6811-4631-a379-665b2ac7c97b", "address": "fa:16:3e:12:f3:44", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebee28a-68", "ovs_interfaceid": "2ebee28a-6811-4631-a379-665b2ac7c97b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:f3:44,bridge_name='br-int',has_traffic_filtering=True,id=2ebee28a-6811-4631-a379-665b2ac7c97b,network=Network(57ee1ccc-d7df-4a86-9234-c3c5f447e051),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ebee28a-68') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG nova.objects.instance [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lazy-loading 'pci_devices' on Instance uuid 3dfec5ff-83b2-442e-af36-d17e959bf316 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:41:05 user nova-compute[74247]:   <uuid>3dfec5ff-83b2-442e-af36-d17e959bf316</uuid>
Oct 16 18:41:05 user nova-compute[74247]:   <name>instance-0000001e</name>
Oct 16 18:41:05 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:41:05 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:41:05 user nova-compute[74247]:   <metadata>
Oct 16 18:41:05 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:41:05 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:41:05 user nova-compute[74247]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1641247620</nova:name>
Oct 16 18:41:05 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:41:05</nova:creationTime>
Oct 16 18:41:05 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:41:05 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:41:05 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:41:05 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:41:05 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:41:05 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:41:05 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:41:05 user nova-compute[74247]:       <nova:owner>
Oct 16 18:41:05 user nova-compute[74247]:         <nova:user uuid="51026968ba1f49eaa8e0cc27a81855db">tempest-ServerRescueNegativeTestJSON-2007731322-project-member</nova:user>
Oct 16 18:41:05 user nova-compute[74247]:         <nova:project uuid="16160dad45544c6e8d9758e883089822">tempest-ServerRescueNegativeTestJSON-2007731322</nova:project>
Oct 16 18:41:05 user nova-compute[74247]:       </nova:owner>
Oct 16 18:41:05 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:41:05 user nova-compute[74247]:       <nova:ports>
Oct 16 18:41:05 user nova-compute[74247]:         <nova:port uuid="2ebee28a-6811-4631-a379-665b2ac7c97b">
Oct 16 18:41:05 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 16 18:41:05 user nova-compute[74247]:         </nova:port>
Oct 16 18:41:05 user nova-compute[74247]:       </nova:ports>
Oct 16 18:41:05 user nova-compute[74247]:     </nova:instance>
Oct 16 18:41:05 user nova-compute[74247]:   </metadata>
Oct 16 18:41:05 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:41:05 user nova-compute[74247]:     <system>
Oct 16 18:41:05 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:41:05 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:41:05 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:41:05 user nova-compute[74247]:       <entry name="serial">3dfec5ff-83b2-442e-af36-d17e959bf316</entry>
Oct 16 18:41:05 user nova-compute[74247]:       <entry name="uuid">3dfec5ff-83b2-442e-af36-d17e959bf316</entry>
Oct 16 18:41:05 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:41:05 user nova-compute[74247]:     </system>
Oct 16 18:41:05 user nova-compute[74247]:   </sysinfo>
Oct 16 18:41:05 user nova-compute[74247]:   <os>
Oct 16 18:41:05 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:41:05 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:41:05 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:41:05 user nova-compute[74247]:   </os>
Oct 16 18:41:05 user nova-compute[74247]:   <features>
Oct 16 18:41:05 user nova-compute[74247]:     <acpi/>
Oct 16 18:41:05 user nova-compute[74247]:     <apic/>
Oct 16 18:41:05 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:41:05 user nova-compute[74247]:   </features>
Oct 16 18:41:05 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:41:05 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:41:05 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:41:05 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:41:05 user nova-compute[74247]:   </clock>
Oct 16 18:41:05 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:41:05 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:41:05 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:41:05 user nova-compute[74247]:   </cpu>
Oct 16 18:41:05 user nova-compute[74247]:   <devices>
Oct 16 18:41:05 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:41:05 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:41:05 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/disk"/>
Oct 16 18:41:05 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:41:05 user nova-compute[74247]:     </disk>
Oct 16 18:41:05 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:41:05 user nova-compute[74247]:       <mac address="fa:16:3e:12:f3:44"/>
Oct 16 18:41:05 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:41:05 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:41:05 user nova-compute[74247]:       <target dev="tap2ebee28a-68"/>
Oct 16 18:41:05 user nova-compute[74247]:     </interface>
Oct 16 18:41:05 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:41:05 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/console.log" append="off"/>
Oct 16 18:41:05 user nova-compute[74247]:     </serial>
Oct 16 18:41:05 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:41:05 user nova-compute[74247]:     <video>
Oct 16 18:41:05 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:41:05 user nova-compute[74247]:     </video>
Oct 16 18:41:05 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:41:05 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:41:05 user nova-compute[74247]:     </rng>
Oct 16 18:41:05 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:41:05 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:41:05 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:41:05 user nova-compute[74247]:     </memballoon>
Oct 16 18:41:05 user nova-compute[74247]:   </devices>
Oct 16 18:41:05 user nova-compute[74247]: </domain>
Oct 16 18:41:05 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:41:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1641247620',display_name='tempest-ServerRescueNegativeTestJSON-server-1641247620',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1641247620',id=30,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPsDWRwLQfsC0Y7dw9Z15xe1y5GC7wHRETqUhbz5J1D6I9OPjIxouEGDX+yZjSp+CFSUIs9c1ficEwzIGhYvXQr7II5hyw6ajkuKxYHIVRNPTwDYN/rcvL+tVrC3iDbD+Q==',key_name='tempest-keypair-1614073413',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16160dad45544c6e8d9758e883089822',ramdisk_id='',reservation_id='r-61vw28hu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2007731322',owner_user_name='tempest-ServerRescueNegativeTestJSON-2007731322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:41:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51026968ba1f49eaa8e0cc27a81855db',uuid=3dfec5ff-83b2-442e-af36-d17e959bf316,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ebee28a-6811-4631-a379-665b2ac7c97b", "address": "fa:16:3e:12:f3:44", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebee28a-68", "ovs_interfaceid": "2ebee28a-6811-4631-a379-665b2ac7c97b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Converting VIF {"id": "2ebee28a-6811-4631-a379-665b2ac7c97b", "address": "fa:16:3e:12:f3:44", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebee28a-68", "ovs_interfaceid": "2ebee28a-6811-4631-a379-665b2ac7c97b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:f3:44,bridge_name='br-int',has_traffic_filtering=True,id=2ebee28a-6811-4631-a379-665b2ac7c97b,network=Network(57ee1ccc-d7df-4a86-9234-c3c5f447e051),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ebee28a-68') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG os_vif [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:f3:44,bridge_name='br-int',has_traffic_filtering=True,id=2ebee28a-6811-4631-a379-665b2ac7c97b,network=Network(57ee1ccc-d7df-4a86-9234-c3c5f447e051),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ebee28a-68') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bd1bcb73-094b-513d-a661-5104d55fe525', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ebee28a-68, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2ebee28a-68, col_values=(('qos', UUID('21538f63-ae28-4fd6-81a2-af2d346e0ab8')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2ebee28a-68, col_values=(('external_ids', {'iface-id': '2ebee28a-6811-4631-a379-665b2ac7c97b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:f3:44', 'vm-uuid': '3dfec5ff-83b2-442e-af36-d17e959bf316'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:41:05 user nova-compute[74247]: INFO os_vif [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:f3:44,bridge_name='br-int',has_traffic_filtering=True,id=2ebee28a-6811-4631-a379-665b2ac7c97b,network=Network(57ee1ccc-d7df-4a86-9234-c3c5f447e051),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ebee28a-68')
Oct 16 18:41:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] No VIF found with MAC fa:16:3e:12:f3:44, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG nova.network.neutron [req-5c3060fb-b561-4a1b-93c7-f132edea6d5b req-67f18cf3-f02e-4701-a8e8-4783f7e3a1c4 service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Updated VIF entry in instance network info cache for port 2ebee28a-6811-4631-a379-665b2ac7c97b. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG nova.network.neutron [req-5c3060fb-b561-4a1b-93c7-f132edea6d5b req-67f18cf3-f02e-4701-a8e8-4783f7e3a1c4 service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Updating instance_info_cache with network_info: [{"id": "2ebee28a-6811-4631-a379-665b2ac7c97b", "address": "fa:16:3e:12:f3:44", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebee28a-68", "ovs_interfaceid": "2ebee28a-6811-4631-a379-665b2ac7c97b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:41:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-5c3060fb-b561-4a1b-93c7-f132edea6d5b req-67f18cf3-f02e-4701-a8e8-4783f7e3a1c4 service nova] Releasing lock "refresh_cache-3dfec5ff-83b2-442e-af36-d17e959bf316" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:41:06 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:41:06 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:41:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:41:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:41:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:41:07 user nova-compute[74247]: DEBUG nova.compute.manager [req-36fe3a3b-9ffa-4e64-b159-562360ecc427 req-acc994d9-4028-4011-993c-d4ef99fb15a6 service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Received event network-vif-plugged-2ebee28a-6811-4631-a379-665b2ac7c97b {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:41:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-36fe3a3b-9ffa-4e64-b159-562360ecc427 req-acc994d9-4028-4011-993c-d4ef99fb15a6 service nova] Acquiring lock "3dfec5ff-83b2-442e-af36-d17e959bf316-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:41:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-36fe3a3b-9ffa-4e64-b159-562360ecc427 req-acc994d9-4028-4011-993c-d4ef99fb15a6 service nova] Lock "3dfec5ff-83b2-442e-af36-d17e959bf316-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:41:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-36fe3a3b-9ffa-4e64-b159-562360ecc427 req-acc994d9-4028-4011-993c-d4ef99fb15a6 service nova] Lock "3dfec5ff-83b2-442e-af36-d17e959bf316-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:41:07 user nova-compute[74247]: DEBUG nova.compute.manager [req-36fe3a3b-9ffa-4e64-b159-562360ecc427 req-acc994d9-4028-4011-993c-d4ef99fb15a6 service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] No waiting events found dispatching network-vif-plugged-2ebee28a-6811-4631-a379-665b2ac7c97b {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:41:07 user nova-compute[74247]: WARNING nova.compute.manager [req-36fe3a3b-9ffa-4e64-b159-562360ecc427 req-acc994d9-4028-4011-993c-d4ef99fb15a6 service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Received unexpected event network-vif-plugged-2ebee28a-6811-4631-a379-665b2ac7c97b for instance with vm_state building and task_state spawning.
Oct 16 18:41:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:41:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:41:08 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:41:08 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:41:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:41:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:41:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:41:08 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 18:41:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:09 user nova-compute[74247]: DEBUG nova.compute.manager [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:41:09 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:41:09 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Instance spawned successfully.
Oct 16 18:41:09 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 18:41:09 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:41:09 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:41:09 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:41:09 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:41:09 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:41:09 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:41:09 user nova-compute[74247]: DEBUG nova.compute.manager [req-b50ff070-3a0f-4f0a-8ee1-44b9baa36d66 req-2b4d9e01-c481-4c86-a044-e959d9b4cf8e service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Received event network-vif-plugged-2ebee28a-6811-4631-a379-665b2ac7c97b {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:41:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-b50ff070-3a0f-4f0a-8ee1-44b9baa36d66 req-2b4d9e01-c481-4c86-a044-e959d9b4cf8e service nova] Acquiring lock "3dfec5ff-83b2-442e-af36-d17e959bf316-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:41:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-b50ff070-3a0f-4f0a-8ee1-44b9baa36d66 req-2b4d9e01-c481-4c86-a044-e959d9b4cf8e service nova] Lock "3dfec5ff-83b2-442e-af36-d17e959bf316-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:41:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-b50ff070-3a0f-4f0a-8ee1-44b9baa36d66 req-2b4d9e01-c481-4c86-a044-e959d9b4cf8e service nova] Lock "3dfec5ff-83b2-442e-af36-d17e959bf316-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:41:09 user nova-compute[74247]: DEBUG nova.compute.manager [req-b50ff070-3a0f-4f0a-8ee1-44b9baa36d66 req-2b4d9e01-c481-4c86-a044-e959d9b4cf8e service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] No waiting events found dispatching network-vif-plugged-2ebee28a-6811-4631-a379-665b2ac7c97b {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:41:09 user nova-compute[74247]: WARNING nova.compute.manager [req-b50ff070-3a0f-4f0a-8ee1-44b9baa36d66 req-2b4d9e01-c481-4c86-a044-e959d9b4cf8e service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Received unexpected event network-vif-plugged-2ebee28a-6811-4631-a379-665b2ac7c97b for instance with vm_state building and task_state spawning.
Oct 16 18:41:09 user nova-compute[74247]: INFO nova.compute.manager [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Took 5.72 seconds to spawn the instance on the hypervisor.
Oct 16 18:41:09 user nova-compute[74247]: DEBUG nova.compute.manager [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:41:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:09 user nova-compute[74247]: INFO nova.compute.manager [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Took 6.65 seconds to build instance.
Oct 16 18:41:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-06bb6c7f-5e9c-4a8a-8ef0-b83332ea633d tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "3dfec5ff-83b2-442e-af36-d17e959bf316" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.772s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:41:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:09 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:41:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:10 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:10 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:10 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:10 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:41:10 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:10 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:41:10 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:10 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:10 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:10 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbdb3c4c-7a6f-4966-bc13-049efe0cded2/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:10 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbdb3c4c-7a6f-4966-bc13-049efe0cded2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:10 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbdb3c4c-7a6f-4966-bc13-049efe0cded2/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbdb3c4c-7a6f-4966-bc13-049efe0cded2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:11 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:41:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:41:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json" returned: 0 in 0.319s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:12 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Acquiring lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:41:12 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:41:12 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:41:12 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:41:12 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=7807MB free_disk=24.985912322998047GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 18:41:12 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:41:12 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:41:12 user nova-compute[74247]: DEBUG nova.objects.instance [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lazy-loading 'flavor' on Instance uuid 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:41:12 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:41:13 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance e37fbc27-3404-479a-be08-4d590391cf30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:41:13 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance cddf4842-1c25-4cc8-914e-af30849e4d6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:41:13 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 958af87e-69d0-4da1-8fcf-90e0f275d62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:41:13 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance d775101d-53a1-48c7-af24-91480be6af61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:41:13 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 7dcc08e9-7439-436b-8d9f-facaf04e22c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:41:13 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:41:13 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 88ea9961-7a1d-4193-b72f-63e398752141 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:41:13 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 220798e9-aea4-4c79-9737-175ab0598e7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:41:13 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance cbdb3c4c-7a6f-4966-bc13-049efe0cded2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:41:13 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 3dfec5ff-83b2-442e-af36-d17e959bf316 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:41:13 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 18:41:13 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 18:41:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Acquiring lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:41:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:41:13 user nova-compute[74247]: INFO nova.compute.manager [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Attaching volume bdd5aad4-4706-4b96-a3a2-858c830150eb to /dev/vdb
Oct 16 18:41:13 user nova-compute[74247]: DEBUG os_brick.utils [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:41:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:13 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8b7b2b-700d-4fde-8d4e-57c93809c2aa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:41:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:13 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e94716a-8049-4551-b8f5-bb1e068959bd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:41:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:13 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[50dbb7b5-3a4d-42ee-bbaa-27ad5a17b036]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:41:13 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62b1de5-c0cb-41b4-bf8c-ea406a4d6a04]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:41:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:41:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 18:41:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:41:13 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 18:41:13 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e30d47-1951-4542-948c-0188d6b17c1b]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:41:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 18:41:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 18:41:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 18:41:13 user nova-compute[74247]: DEBUG os_brick.utils [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:41:13 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Updating existing volume attachment record: 44551b98-d714-4c31-a776-0b2774612ba3 {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 18:41:13 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:41:13 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:41:13 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 18:41:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.638s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:41:13 user nova-compute[74247]: DEBUG nova.compute.manager [None req-9520620b-dfee-4887-a36e-669aac64ea78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:41:13 user nova-compute[74247]: INFO nova.compute.manager [None req-9520620b-dfee-4887-a36e-669aac64ea78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] instance snapshotting
Oct 16 18:41:13 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-9520620b-dfee-4887-a36e-669aac64ea78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Beginning live snapshot process
Oct 16 18:41:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-9520620b-dfee-4887-a36e-669aac64ea78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk --force-share --output=json -f qcow2 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-9520620b-dfee-4887-a36e-669aac64ea78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk --force-share --output=json -f qcow2" returned: 0 in 0.191s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-9520620b-dfee-4887-a36e-669aac64ea78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk --force-share --output=json -f qcow2 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-9520620b-dfee-4887-a36e-669aac64ea78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-9520620b-dfee-4887-a36e-669aac64ea78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-9520620b-dfee-4887-a36e-669aac64ea78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.180s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-9520620b-dfee-4887-a36e-669aac64ea78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp6hb4eznf/415b7f8a43d9487b9a5fae3941fd49d5.delta 1073741824 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-9520620b-dfee-4887-a36e-669aac64ea78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp6hb4eznf/415b7f8a43d9487b9a5fae3941fd49d5.delta 1073741824" returned: 0 in 0.073s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:14 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-9520620b-dfee-4887-a36e-669aac64ea78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 16 18:41:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:41:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-9520620b-dfee-4887-a36e-669aac64ea78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 18:41:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:41:16 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-9520620b-dfee-4887-a36e-669aac64ea78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] COPY block job progress, current cursor: 75497471 final cursor: 75497472 {{(pid=74247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 18:41:16 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-9520620b-dfee-4887-a36e-669aac64ea78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 18:41:16 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-9520620b-dfee-4887-a36e-669aac64ea78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 16 18:41:17 user nova-compute[74247]: DEBUG nova.privsep.utils [None req-9520620b-dfee-4887-a36e-669aac64ea78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74247) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 18:41:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-9520620b-dfee-4887-a36e-669aac64ea78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp6hb4eznf/415b7f8a43d9487b9a5fae3941fd49d5.delta /opt/stack/data/nova/instances/snapshots/tmp6hb4eznf/415b7f8a43d9487b9a5fae3941fd49d5 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-9520620b-dfee-4887-a36e-669aac64ea78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp6hb4eznf/415b7f8a43d9487b9a5fae3941fd49d5.delta /opt/stack/data/nova/instances/snapshots/tmp6hb4eznf/415b7f8a43d9487b9a5fae3941fd49d5" returned: 0 in 0.740s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:17 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-9520620b-dfee-4887-a36e-669aac64ea78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Snapshot extracted, beginning image upload
Oct 16 18:41:18 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:41:18 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 18:41:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:41:20 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-9520620b-dfee-4887-a36e-669aac64ea78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Snapshot image upload complete
Oct 16 18:41:20 user nova-compute[74247]: INFO nova.compute.manager [None req-9520620b-dfee-4887-a36e-669aac64ea78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Took 7.08 seconds to snapshot the instance on the hypervisor.
Oct 16 18:41:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:41:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:41:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:41:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:41:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:41:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:41:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:41:40 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:41:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:41:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:41:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:41:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "61819735-95a5-4543-915d-bd50c671002b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:41:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "61819735-95a5-4543-915d-bd50c671002b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:41:49 user nova-compute[74247]: DEBUG nova.compute.manager [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: 61819735-95a5-4543-915d-bd50c671002b] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 18:41:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:41:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:41:49 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:41:49 user nova-compute[74247]: INFO nova.compute.claims [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: 61819735-95a5-4543-915d-bd50c671002b] Claim successful on node user
Oct 16 18:41:49 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:41:49 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:41:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.409s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:41:49 user nova-compute[74247]: DEBUG nova.compute.manager [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: 61819735-95a5-4543-915d-bd50c671002b] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 18:41:50 user nova-compute[74247]: DEBUG nova.compute.manager [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: 61819735-95a5-4543-915d-bd50c671002b] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 18:41:50 user nova-compute[74247]: DEBUG nova.network.neutron [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: 61819735-95a5-4543-915d-bd50c671002b] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 18:41:50 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: 61819735-95a5-4543-915d-bd50c671002b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 18:41:50 user nova-compute[74247]: DEBUG nova.compute.manager [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: 61819735-95a5-4543-915d-bd50c671002b] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 18:41:50 user nova-compute[74247]: DEBUG nova.policy [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5bd70613da1f489f86227655ff364795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96ced9d4c0c474fbc7edeed6f73324a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 18:41:50 user nova-compute[74247]: DEBUG nova.compute.manager [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: 61819735-95a5-4543-915d-bd50c671002b] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 18:41:50 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: 61819735-95a5-4543-915d-bd50c671002b] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:41:50 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: 61819735-95a5-4543-915d-bd50c671002b] Creating image(s)
Oct 16 18:41:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "/opt/stack/data/nova/instances/61819735-95a5-4543-915d-bd50c671002b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:41:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "/opt/stack/data/nova/instances/61819735-95a5-4543-915d-bd50c671002b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:41:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "/opt/stack/data/nova/instances/61819735-95a5-4543-915d-bd50c671002b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:41:50 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:50 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.180s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "37399febbd18f60b85fd0f833558f6a3539ab231" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:41:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:41:50 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:41:50 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.177s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:50 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/61819735-95a5-4543-915d-bd50c671002b/disk 1073741824 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:50 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/61819735-95a5-4543-915d-bd50c671002b/disk 1073741824" returned: 0 in 0.061s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:41:50 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:50 user nova-compute[74247]: DEBUG nova.network.neutron [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: 61819735-95a5-4543-915d-bd50c671002b] Successfully created port: 02f2319c-e3f4-48f2-98e7-0b97b42da9c0 {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:41:50 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.193s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:50 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Checking if we can resize image /opt/stack/data/nova/instances/61819735-95a5-4543-915d-bd50c671002b/disk. size=1073741824 {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 18:41:50 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61819735-95a5-4543-915d-bd50c671002b/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61819735-95a5-4543-915d-bd50c671002b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Cannot resize image /opt/stack/data/nova/instances/61819735-95a5-4543-915d-bd50c671002b/disk to a smaller size. {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: 61819735-95a5-4543-915d-bd50c671002b] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: 61819735-95a5-4543-915d-bd50c671002b] Ensure instance console log exists: /opt/stack/data/nova/instances/61819735-95a5-4543-915d-bd50c671002b/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG nova.network.neutron [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: 61819735-95a5-4543-915d-bd50c671002b] Successfully updated port: 02f2319c-e3f4-48f2-98e7-0b97b42da9c0 {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "refresh_cache-61819735-95a5-4543-915d-bd50c671002b" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquired lock "refresh_cache-61819735-95a5-4543-915d-bd50c671002b" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG nova.network.neutron [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: 61819735-95a5-4543-915d-bd50c671002b] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG nova.compute.manager [req-6add7c76-d25a-4e3d-8079-bb69f7aa22b6 req-af79d222-9bf0-4648-aae8-35ef6656f424 service nova] [instance: 61819735-95a5-4543-915d-bd50c671002b] Received event network-changed-02f2319c-e3f4-48f2-98e7-0b97b42da9c0 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG nova.compute.manager [req-6add7c76-d25a-4e3d-8079-bb69f7aa22b6 req-af79d222-9bf0-4648-aae8-35ef6656f424 service nova] [instance: 61819735-95a5-4543-915d-bd50c671002b] Refreshing instance network info cache due to event network-changed-02f2319c-e3f4-48f2-98e7-0b97b42da9c0. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-6add7c76-d25a-4e3d-8079-bb69f7aa22b6 req-af79d222-9bf0-4648-aae8-35ef6656f424 service nova] Acquiring lock "refresh_cache-61819735-95a5-4543-915d-bd50c671002b" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG nova.network.neutron [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: 61819735-95a5-4543-915d-bd50c671002b] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG nova.network.neutron [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: 61819735-95a5-4543-915d-bd50c671002b] Updating instance_info_cache with network_info: [{"id": "02f2319c-e3f4-48f2-98e7-0b97b42da9c0", "address": "fa:16:3e:c0:62:93", "network": {"id": "fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1988491128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96ced9d4c0c474fbc7edeed6f73324a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02f2319c-e3", "ovs_interfaceid": "02f2319c-e3f4-48f2-98e7-0b97b42da9c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Releasing lock "refresh_cache-61819735-95a5-4543-915d-bd50c671002b" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG nova.compute.manager [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: 61819735-95a5-4543-915d-bd50c671002b] Instance network_info: |[{"id": "02f2319c-e3f4-48f2-98e7-0b97b42da9c0", "address": "fa:16:3e:c0:62:93", "network": {"id": "fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1988491128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96ced9d4c0c474fbc7edeed6f73324a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02f2319c-e3", "ovs_interfaceid": "02f2319c-e3f4-48f2-98e7-0b97b42da9c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-6add7c76-d25a-4e3d-8079-bb69f7aa22b6 req-af79d222-9bf0-4648-aae8-35ef6656f424 service nova] Acquired lock "refresh_cache-61819735-95a5-4543-915d-bd50c671002b" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG nova.network.neutron [req-6add7c76-d25a-4e3d-8079-bb69f7aa22b6 req-af79d222-9bf0-4648-aae8-35ef6656f424 service nova] [instance: 61819735-95a5-4543-915d-bd50c671002b] Refreshing network info cache for port 02f2319c-e3f4-48f2-98e7-0b97b42da9c0 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: 61819735-95a5-4543-915d-bd50c671002b] Start _get_guest_xml network_info=[{"id": "02f2319c-e3f4-48f2-98e7-0b97b42da9c0", "address": "fa:16:3e:c0:62:93", "network": {"id": "fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1988491128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96ced9d4c0c474fbc7edeed6f73324a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02f2319c-e3", "ovs_interfaceid": "02f2319c-e3f4-48f2-98e7-0b97b42da9c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': '83126bb1-29f5-42fe-8620-72ab0797f776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:41:51 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:41:51 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:41:51 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:41:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1801816855',display_name='tempest-AttachVolumeNegativeTest-server-1801816855',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1801816855',id=31,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKtr2HivV1IE/bw7qeFi+T2kA17TBbYndTh1M4sL20JL/aWNpUXUvzaMM9q8gMMaxn0CWMscDz3It7OHES7yEg0Jnxy0qDOC/R/759xRoWwBOypdHFoFnS96/dxAM9KFQ==',key_name='tempest-keypair-334338757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c96ced9d4c0c474fbc7edeed6f73324a',ramdisk_id='',reservation_id='r-s24t6rw4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1731725928',owner_user_name='tempest-AttachVolumeNegativeTest-1731725928-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:41:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bd70613da1f489f86227655ff364795',uuid=61819735-95a5-4543-915d-bd50c671002b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02f2319c-e3f4-48f2-98e7-0b97b42da9c0", "address": "fa:16:3e:c0:62:93", "network": {"id": "fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1988491128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96ced9d4c0c474fbc7edeed6f73324a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02f2319c-e3", "ovs_interfaceid": "02f2319c-e3f4-48f2-98e7-0b97b42da9c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Converting VIF {"id": "02f2319c-e3f4-48f2-98e7-0b97b42da9c0", "address": "fa:16:3e:c0:62:93", "network": {"id": "fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1988491128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96ced9d4c0c474fbc7edeed6f73324a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02f2319c-e3", "ovs_interfaceid": "02f2319c-e3f4-48f2-98e7-0b97b42da9c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:62:93,bridge_name='br-int',has_traffic_filtering=True,id=02f2319c-e3f4-48f2-98e7-0b97b42da9c0,network=Network(fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02f2319c-e3') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG nova.objects.instance [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lazy-loading 'pci_devices' on Instance uuid 61819735-95a5-4543-915d-bd50c671002b {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: 61819735-95a5-4543-915d-bd50c671002b] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:41:51 user nova-compute[74247]:   <uuid>61819735-95a5-4543-915d-bd50c671002b</uuid>
Oct 16 18:41:51 user nova-compute[74247]:   <name>instance-0000001f</name>
Oct 16 18:41:51 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:41:51 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:41:51 user nova-compute[74247]:   <metadata>
Oct 16 18:41:51 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:41:51 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:41:51 user nova-compute[74247]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1801816855</nova:name>
Oct 16 18:41:51 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:41:51</nova:creationTime>
Oct 16 18:41:51 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:41:51 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:41:51 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:41:51 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:41:51 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:41:51 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:41:51 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:41:51 user nova-compute[74247]:       <nova:owner>
Oct 16 18:41:51 user nova-compute[74247]:         <nova:user uuid="5bd70613da1f489f86227655ff364795">tempest-AttachVolumeNegativeTest-1731725928-project-member</nova:user>
Oct 16 18:41:51 user nova-compute[74247]:         <nova:project uuid="c96ced9d4c0c474fbc7edeed6f73324a">tempest-AttachVolumeNegativeTest-1731725928</nova:project>
Oct 16 18:41:51 user nova-compute[74247]:       </nova:owner>
Oct 16 18:41:51 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:41:51 user nova-compute[74247]:       <nova:ports>
Oct 16 18:41:51 user nova-compute[74247]:         <nova:port uuid="02f2319c-e3f4-48f2-98e7-0b97b42da9c0">
Oct 16 18:41:51 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 16 18:41:51 user nova-compute[74247]:         </nova:port>
Oct 16 18:41:51 user nova-compute[74247]:       </nova:ports>
Oct 16 18:41:51 user nova-compute[74247]:     </nova:instance>
Oct 16 18:41:51 user nova-compute[74247]:   </metadata>
Oct 16 18:41:51 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:41:51 user nova-compute[74247]:     <system>
Oct 16 18:41:51 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:41:51 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:41:51 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:41:51 user nova-compute[74247]:       <entry name="serial">61819735-95a5-4543-915d-bd50c671002b</entry>
Oct 16 18:41:51 user nova-compute[74247]:       <entry name="uuid">61819735-95a5-4543-915d-bd50c671002b</entry>
Oct 16 18:41:51 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:41:51 user nova-compute[74247]:     </system>
Oct 16 18:41:51 user nova-compute[74247]:   </sysinfo>
Oct 16 18:41:51 user nova-compute[74247]:   <os>
Oct 16 18:41:51 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:41:51 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:41:51 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:41:51 user nova-compute[74247]:   </os>
Oct 16 18:41:51 user nova-compute[74247]:   <features>
Oct 16 18:41:51 user nova-compute[74247]:     <acpi/>
Oct 16 18:41:51 user nova-compute[74247]:     <apic/>
Oct 16 18:41:51 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:41:51 user nova-compute[74247]:   </features>
Oct 16 18:41:51 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:41:51 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:41:51 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:41:51 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:41:51 user nova-compute[74247]:   </clock>
Oct 16 18:41:51 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:41:51 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:41:51 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:41:51 user nova-compute[74247]:   </cpu>
Oct 16 18:41:51 user nova-compute[74247]:   <devices>
Oct 16 18:41:51 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:41:51 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:41:51 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/61819735-95a5-4543-915d-bd50c671002b/disk"/>
Oct 16 18:41:51 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:41:51 user nova-compute[74247]:     </disk>
Oct 16 18:41:51 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:41:51 user nova-compute[74247]:       <mac address="fa:16:3e:c0:62:93"/>
Oct 16 18:41:51 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:41:51 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:41:51 user nova-compute[74247]:       <target dev="tap02f2319c-e3"/>
Oct 16 18:41:51 user nova-compute[74247]:     </interface>
Oct 16 18:41:51 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:41:51 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/61819735-95a5-4543-915d-bd50c671002b/console.log" append="off"/>
Oct 16 18:41:51 user nova-compute[74247]:     </serial>
Oct 16 18:41:51 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:41:51 user nova-compute[74247]:     <video>
Oct 16 18:41:51 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:41:51 user nova-compute[74247]:     </video>
Oct 16 18:41:51 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:41:51 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:41:51 user nova-compute[74247]:     </rng>
Oct 16 18:41:51 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:41:51 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:41:51 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:41:51 user nova-compute[74247]:     </memballoon>
Oct 16 18:41:51 user nova-compute[74247]:   </devices>
Oct 16 18:41:51 user nova-compute[74247]: </domain>
Oct 16 18:41:51 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:41:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1801816855',display_name='tempest-AttachVolumeNegativeTest-server-1801816855',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1801816855',id=31,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKtr2HivV1IE/bw7qeFi+T2kA17TBbYndTh1M4sL20JL/aWNpUXUvzaMM9q8gMMaxn0CWMscDz3It7OHES7yEg0Jnxy0qDOC/R/759xRoWwBOypdHFoFnS96/dxAM9KFQ==',key_name='tempest-keypair-334338757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c96ced9d4c0c474fbc7edeed6f73324a',ramdisk_id='',reservation_id='r-s24t6rw4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1731725928',owner_user_name='tempest-AttachVolumeNegativeTest-1731725928-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:41:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bd70613da1f489f86227655ff364795',uuid=61819735-95a5-4543-915d-bd50c671002b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02f2319c-e3f4-48f2-98e7-0b97b42da9c0", "address": "fa:16:3e:c0:62:93", "network": {"id": "fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1988491128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96ced9d4c0c474fbc7edeed6f73324a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02f2319c-e3", "ovs_interfaceid": "02f2319c-e3f4-48f2-98e7-0b97b42da9c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Converting VIF {"id": "02f2319c-e3f4-48f2-98e7-0b97b42da9c0", "address": "fa:16:3e:c0:62:93", "network": {"id": "fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1988491128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96ced9d4c0c474fbc7edeed6f73324a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02f2319c-e3", "ovs_interfaceid": "02f2319c-e3f4-48f2-98e7-0b97b42da9c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:62:93,bridge_name='br-int',has_traffic_filtering=True,id=02f2319c-e3f4-48f2-98e7-0b97b42da9c0,network=Network(fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02f2319c-e3') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG os_vif [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:62:93,bridge_name='br-int',has_traffic_filtering=True,id=02f2319c-e3f4-48f2-98e7-0b97b42da9c0,network=Network(fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02f2319c-e3') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ee52ee3c-a348-58cc-aba7-c03f880e2368', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap02f2319c-e3, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap02f2319c-e3, col_values=(('qos', UUID('7d73de72-0c9f-474a-a55c-ce198b63622a')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap02f2319c-e3, col_values=(('external_ids', {'iface-id': '02f2319c-e3f4-48f2-98e7-0b97b42da9c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:62:93', 'vm-uuid': '61819735-95a5-4543-915d-bd50c671002b'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:41:51 user nova-compute[74247]: INFO os_vif [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:62:93,bridge_name='br-int',has_traffic_filtering=True,id=02f2319c-e3f4-48f2-98e7-0b97b42da9c0,network=Network(fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02f2319c-e3')
Oct 16 18:41:51 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:41:51 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] No VIF found with MAC fa:16:3e:c0:62:93, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:41:52 user nova-compute[74247]: DEBUG nova.network.neutron [req-6add7c76-d25a-4e3d-8079-bb69f7aa22b6 req-af79d222-9bf0-4648-aae8-35ef6656f424 service nova] [instance: 61819735-95a5-4543-915d-bd50c671002b] Updated VIF entry in instance network info cache for port 02f2319c-e3f4-48f2-98e7-0b97b42da9c0. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:41:52 user nova-compute[74247]: DEBUG nova.network.neutron [req-6add7c76-d25a-4e3d-8079-bb69f7aa22b6 req-af79d222-9bf0-4648-aae8-35ef6656f424 service nova] [instance: 61819735-95a5-4543-915d-bd50c671002b] Updating instance_info_cache with network_info: [{"id": "02f2319c-e3f4-48f2-98e7-0b97b42da9c0", "address": "fa:16:3e:c0:62:93", "network": {"id": "fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1988491128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96ced9d4c0c474fbc7edeed6f73324a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02f2319c-e3", "ovs_interfaceid": "02f2319c-e3f4-48f2-98e7-0b97b42da9c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:41:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-6add7c76-d25a-4e3d-8079-bb69f7aa22b6 req-af79d222-9bf0-4648-aae8-35ef6656f424 service nova] Releasing lock "refresh_cache-61819735-95a5-4543-915d-bd50c671002b" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vhGiTJYx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:41:53 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:41:53 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:41:53 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:41:53 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:41:53 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:41:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef7e7d3-3e68-4da4-84a8-ab366e0ea32b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 18:41:53 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b68a79c-bb49-469c-a12f-f739b36d116b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb] added
Oct 16 18:41:53 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fdb225-eebb-4ce5-b5c7-18ecf25e9c7f]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a96d71d-f190-4500-b6fb-1843a0eee986]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vhGiTJYx {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vhGiTJYx" returned: 0 in 0.031s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fe3c65-8593-4731-a085-5f51c28f4e7b]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vhGiTJYx'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b299fb7-21c0-4364-9c94-8ed5212204af]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c1935a-d8a6-4659-8ba6-454c7f20b50f]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:41:53 user nova-compute[74247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)
Oct 16 18:41:53 user nova-compute[74247]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476 (non-flash)
Oct 16 18:41:53 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:41:53 user nova-compute[74247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)
Oct 16 18:41:53 user nova-compute[74247]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476 (non-flash)
Oct 16 18:41:53 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e279445-bc65-43c1-b7fe-4b37b700e17f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb, portal: 172.16.0.220,3260]
Oct 16 18:41:53 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb, portal: 172.16.0.220,3260] successful.
Oct 16 18:41:53 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2ff723-4eab-40fa-90ae-ace3e4345be3]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG nova.compute.manager [req-a330eef2-4308-4217-80f5-ebe7fcd8992f req-bb3c6be4-c46c-4f48-82bc-f26655a56cca service nova] [instance: 61819735-95a5-4543-915d-bd50c671002b] Received event network-vif-plugged-02f2319c-e3f4-48f2-98e7-0b97b42da9c0 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a330eef2-4308-4217-80f5-ebe7fcd8992f req-bb3c6be4-c46c-4f48-82bc-f26655a56cca service nova] Acquiring lock "61819735-95a5-4543-915d-bd50c671002b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a330eef2-4308-4217-80f5-ebe7fcd8992f req-bb3c6be4-c46c-4f48-82bc-f26655a56cca service nova] Lock "61819735-95a5-4543-915d-bd50c671002b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a330eef2-4308-4217-80f5-ebe7fcd8992f req-bb3c6be4-c46c-4f48-82bc-f26655a56cca service nova] Lock "61819735-95a5-4543-915d-bd50c671002b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG nova.compute.manager [req-a330eef2-4308-4217-80f5-ebe7fcd8992f req-bb3c6be4-c46c-4f48-82bc-f26655a56cca service nova] [instance: 61819735-95a5-4543-915d-bd50c671002b] No waiting events found dispatching network-vif-plugged-02f2319c-e3f4-48f2-98e7-0b97b42da9c0 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:41:53 user nova-compute[74247]: WARNING nova.compute.manager [req-a330eef2-4308-4217-80f5-ebe7fcd8992f req-bb3c6be4-c46c-4f48-82bc-f26655a56cca service nova] [instance: 61819735-95a5-4543-915d-bd50c671002b] Received unexpected event network-vif-plugged-02f2319c-e3f4-48f2-98e7-0b97b42da9c0 for instance with vm_state building and task_state spawning.
Oct 16 18:41:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c583b187-78c4-471a-9cdf-0d6b439d69c4]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:41:53 user nova-compute[74247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)
Oct 16 18:41:53 user nova-compute[74247]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476 (non-flash)
Oct 16 18:41:53 user nova-compute[74247]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb (non-flash)
Oct 16 18:41:53 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:41:53 user nova-compute[74247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)
Oct 16 18:41:53 user nova-compute[74247]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476 (non-flash)
Oct 16 18:41:53 user nova-compute[74247]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb (non-flash)
Oct 16 18:41:53 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.377s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb723f9-150c-4553-8e97-c789c7465621]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: None {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:41:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:41:54 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:41:54 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vhGiTJYx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:41:54 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.414s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:41:54 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] <== connect_volume: return (1415ms) {'type': 'block', 'scsi_wwn': '26134383034323731', 'path': '/dev/sde'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:41:54 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134383034323731', 'path': '/dev/sde'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:41:54 user nova-compute[74247]: DEBUG nova.objects.instance [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lazy-loading 'flavor' on Instance uuid 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:41:54 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 18:41:54 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:41:54 user nova-compute[74247]:   <source dev="/dev/sde"/>
Oct 16 18:41:54 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:41:54 user nova-compute[74247]:   <serial>bdd5aad4-4706-4b96-a3a2-858c830150eb</serial>
Oct 16 18:41:54 user nova-compute[74247]: </disk>
Oct 16 18:41:54 user nova-compute[74247]:  {{(pid=74247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 18:41:55 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:41:55 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:41:55 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] No VIF found with MAC fa:16:3e:d7:26:52, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:41:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3282f948-cad1-4e1f-a780-826c9d179dee tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 42.128s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:41:55 user nova-compute[74247]: DEBUG nova.compute.manager [req-5c9bf601-8229-4b85-ad69-aa51ba1a954a req-206ecbc7-20f0-49b6-8e50-e3db2f3bb1ef service nova] [instance: 61819735-95a5-4543-915d-bd50c671002b] Received event network-vif-plugged-02f2319c-e3f4-48f2-98e7-0b97b42da9c0 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:41:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-5c9bf601-8229-4b85-ad69-aa51ba1a954a req-206ecbc7-20f0-49b6-8e50-e3db2f3bb1ef service nova] Acquiring lock "61819735-95a5-4543-915d-bd50c671002b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:41:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-5c9bf601-8229-4b85-ad69-aa51ba1a954a req-206ecbc7-20f0-49b6-8e50-e3db2f3bb1ef service nova] Lock "61819735-95a5-4543-915d-bd50c671002b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:41:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-5c9bf601-8229-4b85-ad69-aa51ba1a954a req-206ecbc7-20f0-49b6-8e50-e3db2f3bb1ef service nova] Lock "61819735-95a5-4543-915d-bd50c671002b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:41:55 user nova-compute[74247]: DEBUG nova.compute.manager [req-5c9bf601-8229-4b85-ad69-aa51ba1a954a req-206ecbc7-20f0-49b6-8e50-e3db2f3bb1ef service nova] [instance: 61819735-95a5-4543-915d-bd50c671002b] No waiting events found dispatching network-vif-plugged-02f2319c-e3f4-48f2-98e7-0b97b42da9c0 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:41:55 user nova-compute[74247]: WARNING nova.compute.manager [req-5c9bf601-8229-4b85-ad69-aa51ba1a954a req-206ecbc7-20f0-49b6-8e50-e3db2f3bb1ef service nova] [instance: 61819735-95a5-4543-915d-bd50c671002b] Received unexpected event network-vif-plugged-02f2319c-e3f4-48f2-98e7-0b97b42da9c0 for instance with vm_state building and task_state spawning.
Oct 16 18:41:55 user nova-compute[74247]: DEBUG nova.compute.manager [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: 61819735-95a5-4543-915d-bd50c671002b] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:41:55 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: 61819735-95a5-4543-915d-bd50c671002b] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:41:55 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 61819735-95a5-4543-915d-bd50c671002b] Instance spawned successfully.
Oct 16 18:41:55 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: 61819735-95a5-4543-915d-bd50c671002b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 18:41:55 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: 61819735-95a5-4543-915d-bd50c671002b] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:41:55 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: 61819735-95a5-4543-915d-bd50c671002b] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:41:55 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: 61819735-95a5-4543-915d-bd50c671002b] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:41:55 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: 61819735-95a5-4543-915d-bd50c671002b] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:41:55 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: 61819735-95a5-4543-915d-bd50c671002b] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:41:55 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: 61819735-95a5-4543-915d-bd50c671002b] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:41:55 user nova-compute[74247]: INFO nova.compute.manager [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: 61819735-95a5-4543-915d-bd50c671002b] Took 5.46 seconds to spawn the instance on the hypervisor.
Oct 16 18:41:55 user nova-compute[74247]: DEBUG nova.compute.manager [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: 61819735-95a5-4543-915d-bd50c671002b] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:41:55 user nova-compute[74247]: INFO nova.compute.manager [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: 61819735-95a5-4543-915d-bd50c671002b] Took 6.23 seconds to build instance.
Oct 16 18:41:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5867e83f-9972-4241-8d6b-3d83e9bc2bad tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "61819735-95a5-4543-915d-bd50c671002b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.336s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:41:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:41:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:41:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-2db2d619-3151-4a35-9abb-99ba80a3c2ab tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Acquiring lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:41:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-2db2d619-3151-4a35-9abb-99ba80a3c2ab tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:41:57 user nova-compute[74247]: INFO nova.compute.manager [None req-2db2d619-3151-4a35-9abb-99ba80a3c2ab tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Detaching volume bdd5aad4-4706-4b96-a3a2-858c830150eb
Oct 16 18:41:57 user nova-compute[74247]: INFO nova.virt.block_device [None req-2db2d619-3151-4a35-9abb-99ba80a3c2ab tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Attempting to driver detach volume bdd5aad4-4706-4b96-a3a2-858c830150eb from mountpoint /dev/vdb
Oct 16 18:41:57 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-2db2d619-3151-4a35-9abb-99ba80a3c2ab tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Attempting to detach device vdb from instance 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 from the persistent domain config. {{(pid=74247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 18:41:57 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-2db2d619-3151-4a35-9abb-99ba80a3c2ab tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 18:41:57 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:41:57 user nova-compute[74247]:   <source dev="/dev/sde"/>
Oct 16 18:41:57 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:41:57 user nova-compute[74247]:   <serial>bdd5aad4-4706-4b96-a3a2-858c830150eb</serial>
Oct 16 18:41:57 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 18:41:57 user nova-compute[74247]: </disk>
Oct 16 18:41:57 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:41:57 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-2db2d619-3151-4a35-9abb-99ba80a3c2ab tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Successfully detached device vdb from instance 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 from the persistent domain config.
Oct 16 18:41:57 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-2db2d619-3151-4a35-9abb-99ba80a3c2ab tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 from the live domain config. {{(pid=74247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 18:41:57 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-2db2d619-3151-4a35-9abb-99ba80a3c2ab tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 18:41:57 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:41:57 user nova-compute[74247]:   <source dev="/dev/sde"/>
Oct 16 18:41:57 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:41:57 user nova-compute[74247]:   <serial>bdd5aad4-4706-4b96-a3a2-858c830150eb</serial>
Oct 16 18:41:57 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 18:41:57 user nova-compute[74247]: </disk>
Oct 16 18:41:57 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:41:58 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-2db2d619-3151-4a35-9abb-99ba80a3c2ab tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 {{(pid=74247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 18:42:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:42:01 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:42:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:42:05 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:42:05 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 18:42:05 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Rebuilding the list of instances to heal {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 18:42:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "refresh_cache-e37fbc27-3404-479a-be08-4d590391cf30" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:42:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquired lock "refresh_cache-e37fbc27-3404-479a-be08-4d590391cf30" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:42:05 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Forcefully refreshing network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 18:42:05 user nova-compute[74247]: DEBUG nova.objects.instance [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lazy-loading 'info_cache' on Instance uuid e37fbc27-3404-479a-be08-4d590391cf30 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:42:06 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Updating instance_info_cache with network_info: [{"id": "634511f9-ce96-4fe6-8bfc-51846e4dcb4f", "address": "fa:16:3e:d2:d2:f4", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634511f9-ce", "ovs_interfaceid": "634511f9-ce96-4fe6-8bfc-51846e4dcb4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:42:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Releasing lock "refresh_cache-e37fbc27-3404-479a-be08-4d590391cf30" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:42:06 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Updated the network info_cache for instance {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 18:42:06 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:42:06 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:42:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:42:07 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:42:07 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:42:08 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:42:10 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:42:10 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:42:10 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:42:10 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:42:10 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:42:10 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 18:42:10 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:42:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:42:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:42:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:42:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:42:11 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:42:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:42:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:42:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:42:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:42:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:42:12 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:42:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:42:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:42:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbdb3c4c-7a6f-4966-bc13-049efe0cded2/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbdb3c4c-7a6f-4966-bc13-049efe0cded2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:42:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbdb3c4c-7a6f-4966-bc13-049efe0cded2/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbdb3c4c-7a6f-4966-bc13-049efe0cded2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:42:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:42:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:42:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:42:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:42:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:42:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61819735-95a5-4543-915d-bd50c671002b/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61819735-95a5-4543-915d-bd50c671002b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:42:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61819735-95a5-4543-915d-bd50c671002b/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61819735-95a5-4543-915d-bd50c671002b/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:42:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:42:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-645bdc45-7060-4c0b-bd6b-54f5adf2b3b4 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquiring lock "cbdb3c4c-7a6f-4966-bc13-049efe0cded2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:42:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-645bdc45-7060-4c0b-bd6b-54f5adf2b3b4 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "cbdb3c4c-7a6f-4966-bc13-049efe0cded2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:42:14 user nova-compute[74247]: INFO nova.compute.manager [None req-645bdc45-7060-4c0b-bd6b-54f5adf2b3b4 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Detaching volume ba9fcdbe-9281-4ef4-97e8-4938a4d44476
Oct 16 18:42:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:42:15 user nova-compute[74247]: INFO nova.virt.block_device [None req-645bdc45-7060-4c0b-bd6b-54f5adf2b3b4 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Attempting to driver detach volume ba9fcdbe-9281-4ef4-97e8-4938a4d44476 from mountpoint /dev/vdc
Oct 16 18:42:15 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:42:15 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:42:15 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=7647MB free_disk=24.879478454589844GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 18:42:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:42:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:42:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-645bdc45-7060-4c0b-bd6b-54f5adf2b3b4 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Attempting to detach device vdc from instance cbdb3c4c-7a6f-4966-bc13-049efe0cded2 from the persistent domain config. {{(pid=74247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 18:42:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-645bdc45-7060-4c0b-bd6b-54f5adf2b3b4 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 18:42:15 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:42:15 user nova-compute[74247]:   <source dev="/dev/sdb"/>
Oct 16 18:42:15 user nova-compute[74247]:   <target dev="vdc" bus="virtio"/>
Oct 16 18:42:15 user nova-compute[74247]:   <serial>ba9fcdbe-9281-4ef4-97e8-4938a4d44476</serial>
Oct 16 18:42:15 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 16 18:42:15 user nova-compute[74247]: </disk>
Oct 16 18:42:15 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:42:15 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-645bdc45-7060-4c0b-bd6b-54f5adf2b3b4 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Successfully detached device vdc from instance cbdb3c4c-7a6f-4966-bc13-049efe0cded2 from the persistent domain config.
Oct 16 18:42:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-645bdc45-7060-4c0b-bd6b-54f5adf2b3b4 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance cbdb3c4c-7a6f-4966-bc13-049efe0cded2 from the live domain config. {{(pid=74247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 18:42:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-645bdc45-7060-4c0b-bd6b-54f5adf2b3b4 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 18:42:15 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:42:15 user nova-compute[74247]:   <source dev="/dev/sdb"/>
Oct 16 18:42:15 user nova-compute[74247]:   <target dev="vdc" bus="virtio"/>
Oct 16 18:42:15 user nova-compute[74247]:   <serial>ba9fcdbe-9281-4ef4-97e8-4938a4d44476</serial>
Oct 16 18:42:15 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 16 18:42:15 user nova-compute[74247]: </disk>
Oct 16 18:42:15 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:42:15 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance e37fbc27-3404-479a-be08-4d590391cf30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:42:15 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance cddf4842-1c25-4cc8-914e-af30849e4d6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:42:15 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 958af87e-69d0-4da1-8fcf-90e0f275d62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:42:15 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance d775101d-53a1-48c7-af24-91480be6af61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:42:15 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 7dcc08e9-7439-436b-8d9f-facaf04e22c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:42:15 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:42:15 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 88ea9961-7a1d-4193-b72f-63e398752141 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:42:15 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 220798e9-aea4-4c79-9737-175ab0598e7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:42:15 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance cbdb3c4c-7a6f-4966-bc13-049efe0cded2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:42:15 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 3dfec5ff-83b2-442e-af36-d17e959bf316 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:42:15 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 61819735-95a5-4543-915d-bd50c671002b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:42:15 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 18:42:15 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 18:42:15 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:42:15 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:42:15 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 18:42:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.477s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:42:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-645bdc45-7060-4c0b-bd6b-54f5adf2b3b4 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance cbdb3c4c-7a6f-4966-bc13-049efe0cded2 {{(pid=74247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 18:42:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:42:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:42:18 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-2db2d619-3151-4a35-9abb-99ba80a3c2ab tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 is timed out.
Oct 16 18:42:18 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-2db2d619-3151-4a35-9abb-99ba80a3c2ab tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Successfully detached device vdb from instance 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 from the live domain config.
Oct 16 18:42:18 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2db2d619-3151-4a35-9abb-99ba80a3c2ab tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db2d619-3151-4a35-9abb-99ba80a3c2ab tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vhGiTJYx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:42:18 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-2db2d619-3151-4a35-9abb-99ba80a3c2ab tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:42:18 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-2db2d619-3151-4a35-9abb-99ba80a3c2ab tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-2db2d619-3151-4a35-9abb-99ba80a3c2ab tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ec30a7-a1e0-4e1d-b2dc-307ab90ab64c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db2d619-3151-4a35-9abb-99ba80a3c2ab tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 18:42:18 user nova-compute[74247]: No targets found.
Oct 16 18:42:18 user nova-compute[74247]: iSNS:
Oct 16 18:42:18 user nova-compute[74247]: No targets found.
Oct 16 18:42:18 user nova-compute[74247]: STATIC:
Oct 16 18:42:18 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa
Oct 16 18:42:18 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:42:18 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:42:18 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb
Oct 16 18:42:18 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:42:18 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:42:18 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc
Oct 16 18:42:18 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:42:18 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:42:18 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476
Oct 16 18:42:18 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:42:18 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:42:18 user nova-compute[74247]: FIRMWARE:
Oct 16 18:42:18 user nova-compute[74247]: No targets found.
Oct 16 18:42:18 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db2d619-3151-4a35-9abb-99ba80a3c2ab tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 18:42:18 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 18:42:18 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db2d619-3151-4a35-9abb-99ba80a3c2ab tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b012f3b2-e305-4766-8c7f-f4cd149c8733]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[77312e03-901e-4841-a5e8-f94cc0adfb67]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db2d619-3151-4a35-9abb-99ba80a3c2ab tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:42:18 user nova-compute[74247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)
Oct 16 18:42:18 user nova-compute[74247]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476 (non-flash)
Oct 16 18:42:18 user nova-compute[74247]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb (non-flash)
Oct 16 18:42:18 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db2d619-3151-4a35-9abb-99ba80a3c2ab tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:42:18 user nova-compute[74247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)
Oct 16 18:42:18 user nova-compute[74247]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476 (non-flash)
Oct 16 18:42:18 user nova-compute[74247]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb (non-flash)
Oct 16 18:42:18 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db2d619-3151-4a35-9abb-99ba80a3c2ab tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe04833f370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb'): ({'sde'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-2db2d619-3151-4a35-9abb-99ba80a3c2ab tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Removing single pathed devices sde {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b428fe58-7b37-471d-8a29-c170b3e05fea]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[523072f5-3fe0-42bb-a1dd-1fb841643c21]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-2db2d619-3151-4a35-9abb-99ba80a3c2ab tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Flushing IO for device /dev/sde {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd9c163-d9ab-43f6-b723-e23e8483a8b7]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-2db2d619-3151-4a35-9abb-99ba80a3c2ab tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bc5d30-cd52-4c82-963b-a27bd6c833a9]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-2db2d619-3151-4a35-9abb-99ba80a3c2ab tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-2db2d619-3151-4a35-9abb-99ba80a3c2ab tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] SCSI volumes sde have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db2d619-3151-4a35-9abb-99ba80a3c2ab tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e3cc29-242f-47b1-8f44-7fd5227588ff]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db2d619-3151-4a35-9abb-99ba80a3c2ab tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[835f8d14-be48-4db3-bcc1-54f0ef7c563c]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db2d619-3151-4a35-9abb-99ba80a3c2ab tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb, portal: 172.16.0.220,3260]
Oct 16 18:42:18 user nova-compute[74247]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb, portal: 172.16.0.220,3260] successful.
Oct 16 18:42:18 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd5aad4-4706-4b96-a3a2-858c830150eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[107150ff-69ad-4a6e-9ce7-0e0d2cd4b965]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db2d619-3151-4a35-9abb-99ba80a3c2ab tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-2db2d619-3151-4a35-9abb-99ba80a3c2ab tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db2d619-3151-4a35-9abb-99ba80a3c2ab tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] <== disconnect_volume: return (294ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:42:18 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2db2d619-3151-4a35-9abb-99ba80a3c2ab tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 18:42:19 user nova-compute[74247]: DEBUG nova.objects.instance [None req-2db2d619-3151-4a35-9abb-99ba80a3c2ab tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lazy-loading 'flavor' on Instance uuid 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:42:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-2db2d619-3151-4a35-9abb-99ba80a3c2ab tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.737s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:42:19 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:42:19 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 18:42:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:42:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:42:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "25d69a8d-98d5-4044-987a-f376aedfbe2a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:42:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "25d69a8d-98d5-4044-987a-f376aedfbe2a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:42:22 user nova-compute[74247]: DEBUG nova.compute.manager [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 18:42:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:42:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:42:22 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:42:22 user nova-compute[74247]: INFO nova.compute.claims [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Claim successful on node user
Oct 16 18:42:22 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:42:22 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:42:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:42:23 user nova-compute[74247]: DEBUG nova.compute.manager [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 18:42:23 user nova-compute[74247]: DEBUG nova.compute.manager [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 18:42:23 user nova-compute[74247]: DEBUG nova.network.neutron [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 18:42:23 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 18:42:23 user nova-compute[74247]: DEBUG nova.compute.manager [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 18:42:23 user nova-compute[74247]: DEBUG nova.policy [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b01d3e5d2fcb40bc92c3d2fe1236d509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce6164a392e4cc2a027d12c49145e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 18:42:23 user nova-compute[74247]: INFO nova.virt.block_device [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Booting with volume-backed-image 83126bb1-29f5-42fe-8620-72ab0797f776 at /dev/vda
Oct 16 18:42:23 user nova-compute[74247]: DEBUG nova.network.neutron [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Successfully created port: 1e2af952-39b5-4add-9542-925c9babc88c {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:42:24 user nova-compute[74247]: DEBUG nova.network.neutron [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Successfully updated port: 1e2af952-39b5-4add-9542-925c9babc88c {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:42:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "refresh_cache-25d69a8d-98d5-4044-987a-f376aedfbe2a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:42:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquired lock "refresh_cache-25d69a8d-98d5-4044-987a-f376aedfbe2a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:42:24 user nova-compute[74247]: DEBUG nova.network.neutron [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:42:24 user nova-compute[74247]: DEBUG nova.compute.manager [req-6e256f84-dda0-419d-b5f8-124084d43480 req-9f399a87-4750-4f27-be78-ef307841c11b service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Received event network-changed-1e2af952-39b5-4add-9542-925c9babc88c {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:42:24 user nova-compute[74247]: DEBUG nova.compute.manager [req-6e256f84-dda0-419d-b5f8-124084d43480 req-9f399a87-4750-4f27-be78-ef307841c11b service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Refreshing instance network info cache due to event network-changed-1e2af952-39b5-4add-9542-925c9babc88c. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:42:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-6e256f84-dda0-419d-b5f8-124084d43480 req-9f399a87-4750-4f27-be78-ef307841c11b service nova] Acquiring lock "refresh_cache-25d69a8d-98d5-4044-987a-f376aedfbe2a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:42:24 user nova-compute[74247]: DEBUG nova.network.neutron [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:42:24 user nova-compute[74247]: DEBUG nova.network.neutron [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Updating instance_info_cache with network_info: [{"id": "1e2af952-39b5-4add-9542-925c9babc88c", "address": "fa:16:3e:32:37:ce", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2af952-39", "ovs_interfaceid": "1e2af952-39b5-4add-9542-925c9babc88c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:42:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Releasing lock "refresh_cache-25d69a8d-98d5-4044-987a-f376aedfbe2a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:42:24 user nova-compute[74247]: DEBUG nova.compute.manager [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Instance network_info: |[{"id": "1e2af952-39b5-4add-9542-925c9babc88c", "address": "fa:16:3e:32:37:ce", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2af952-39", "ovs_interfaceid": "1e2af952-39b5-4add-9542-925c9babc88c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 18:42:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-6e256f84-dda0-419d-b5f8-124084d43480 req-9f399a87-4750-4f27-be78-ef307841c11b service nova] Acquired lock "refresh_cache-25d69a8d-98d5-4044-987a-f376aedfbe2a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:42:24 user nova-compute[74247]: DEBUG nova.network.neutron [req-6e256f84-dda0-419d-b5f8-124084d43480 req-9f399a87-4750-4f27-be78-ef307841c11b service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Refreshing network info cache for port 1e2af952-39b5-4add-9542-925c9babc88c {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:42:25 user nova-compute[74247]: DEBUG nova.network.neutron [req-6e256f84-dda0-419d-b5f8-124084d43480 req-9f399a87-4750-4f27-be78-ef307841c11b service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Updated VIF entry in instance network info cache for port 1e2af952-39b5-4add-9542-925c9babc88c. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:42:25 user nova-compute[74247]: DEBUG nova.network.neutron [req-6e256f84-dda0-419d-b5f8-124084d43480 req-9f399a87-4750-4f27-be78-ef307841c11b service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Updating instance_info_cache with network_info: [{"id": "1e2af952-39b5-4add-9542-925c9babc88c", "address": "fa:16:3e:32:37:ce", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2af952-39", "ovs_interfaceid": "1e2af952-39b5-4add-9542-925c9babc88c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:42:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-6e256f84-dda0-419d-b5f8-124084d43480 req-9f399a87-4750-4f27-be78-ef307841c11b service nova] Releasing lock "refresh_cache-25d69a8d-98d5-4044-987a-f376aedfbe2a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:42:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:42:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:42:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:42:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:42:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 18:42:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 18:42:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 18:42:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:42:34 user nova-compute[74247]: INFO nova.compute.manager [None req-5023c8e9-76f0-4425-b9c9-b77420eb73e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Get console output
Oct 16 18:42:35 user nova-compute[74247]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Oct 16 18:42:35 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-645bdc45-7060-4c0b-bd6b-54f5adf2b3b4 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance cbdb3c4c-7a6f-4966-bc13-049efe0cded2 is timed out.
Oct 16 18:42:35 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-645bdc45-7060-4c0b-bd6b-54f5adf2b3b4 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Successfully detached device vdc from instance cbdb3c4c-7a6f-4966-bc13-049efe0cded2 from the live domain config.
Oct 16 18:42:35 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-645bdc45-7060-4c0b-bd6b-54f5adf2b3b4 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-645bdc45-7060-4c0b-bd6b-54f5adf2b3b4 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oEbtUpcj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:42:35 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-645bdc45-7060-4c0b-bd6b-54f5adf2b3b4 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:42:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-645bdc45-7060-4c0b-bd6b-54f5adf2b3b4 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-645bdc45-7060-4c0b-bd6b-54f5adf2b3b4 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0faa704b-5ff0-4f20-9f37-df1576d16713]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-645bdc45-7060-4c0b-bd6b-54f5adf2b3b4 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 18:42:35 user nova-compute[74247]: No targets found.
Oct 16 18:42:35 user nova-compute[74247]: iSNS:
Oct 16 18:42:35 user nova-compute[74247]: No targets found.
Oct 16 18:42:35 user nova-compute[74247]: STATIC:
Oct 16 18:42:35 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa
Oct 16 18:42:35 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:42:35 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:42:35 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc
Oct 16 18:42:35 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:42:35 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:42:35 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476
Oct 16 18:42:35 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:42:35 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:42:35 user nova-compute[74247]: FIRMWARE:
Oct 16 18:42:35 user nova-compute[74247]: No targets found.
Oct 16 18:42:35 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-645bdc45-7060-4c0b-bd6b-54f5adf2b3b4 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 18:42:35 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 18:42:35 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-645bdc45-7060-4c0b-bd6b-54f5adf2b3b4 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fba916-2a15-4520-bf1d-832bc9a3cdf5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d3d629-e0de-4c0f-b0f1-c6e0261e622c]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-645bdc45-7060-4c0b-bd6b-54f5adf2b3b4 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:42:35 user nova-compute[74247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)
Oct 16 18:42:35 user nova-compute[74247]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476 (non-flash)
Oct 16 18:42:35 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-645bdc45-7060-4c0b-bd6b-54f5adf2b3b4 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:42:35 user nova-compute[74247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)
Oct 16 18:42:35 user nova-compute[74247]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476 (non-flash)
Oct 16 18:42:35 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-645bdc45-7060-4c0b-bd6b-54f5adf2b3b4 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe0483fdea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476'): ({'sdb'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-645bdc45-7060-4c0b-bd6b-54f5adf2b3b4 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Removing single pathed devices sdb {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e0e000-cb6e-4455-93e9-87a3b66712e6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6c4e74-30c8-4ba0-bcb7-e4f15728c2b7]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-645bdc45-7060-4c0b-bd6b-54f5adf2b3b4 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Flushing IO for device /dev/sdb {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a261078d-d421-49f9-a26c-d7234eaae140]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-645bdc45-7060-4c0b-bd6b-54f5adf2b3b4 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.064s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a83cf86-ea04-4f9f-97c8-f5ca71eceff1]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-645bdc45-7060-4c0b-bd6b-54f5adf2b3b4 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-645bdc45-7060-4c0b-bd6b-54f5adf2b3b4 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] SCSI volumes sdb have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-645bdc45-7060-4c0b-bd6b-54f5adf2b3b4 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d6b7e9-77fa-4b8e-9639-c990b96514b4]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-645bdc45-7060-4c0b-bd6b-54f5adf2b3b4 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476 -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0655c8a1-52f1-4c2b-a18c-f9abe4a9fb71]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-645bdc45-7060-4c0b-bd6b-54f5adf2b3b4 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476, portal: 172.16.0.220,3260]
Oct 16 18:42:35 user nova-compute[74247]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476, portal: 172.16.0.220,3260] successful.
Oct 16 18:42:35 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476 -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba9fcdbe-9281-4ef4-97e8-4938a4d44476 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3686e8-13b4-433f-ae4d-f927f30ef02e]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-645bdc45-7060-4c0b-bd6b-54f5adf2b3b4 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-645bdc45-7060-4c0b-bd6b-54f5adf2b3b4 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-645bdc45-7060-4c0b-bd6b-54f5adf2b3b4 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] <== disconnect_volume: return (315ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:42:35 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-645bdc45-7060-4c0b-bd6b-54f5adf2b3b4 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 18:42:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:42:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:42:36 user nova-compute[74247]: DEBUG nova.objects.instance [None req-645bdc45-7060-4c0b-bd6b-54f5adf2b3b4 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lazy-loading 'flavor' on Instance uuid cbdb3c4c-7a6f-4966-bc13-049efe0cded2 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:42:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-645bdc45-7060-4c0b-bd6b-54f5adf2b3b4 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "cbdb3c4c-7a6f-4966-bc13-049efe0cded2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.166s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:42:38 user nova-compute[74247]: DEBUG os_brick.utils [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:42:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:39 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:42:39 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f64bb2-ee8b-4ff7-9d78-e99079e6e77e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:42:39 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:39 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:42:39 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c748ba-bdf9-4592-a980-34cd60e63fe9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:42:39 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:39 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:42:39 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13f0dff-e401-48c8-959f-46d81deef13e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:42:39 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2c3430-4fb9-4430-92d4-4c835ec5ff1b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:42:39 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:39 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:42:39 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 18:42:39 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:39 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:42:39 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 18:42:39 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[83de6a4b-37de-4fd0-a349-271cf9bbc9c3]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:42:39 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 18:42:39 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 18:42:39 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 18:42:39 user nova-compute[74247]: DEBUG os_brick.utils [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:42:39 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Updating existing volume attachment record: 85f26a53-7367-45fb-91a4-3c84f5fd42aa {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 18:42:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:42:46 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:42:46 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:42:46 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 18:42:46 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 18:42:46 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 18:42:46 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:42:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:42:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:42:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 18:42:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 18:42:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 18:42:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:42:53 user nova-compute[74247]: DEBUG nova.compute.manager [req-d43622b3-682c-462c-b275-2a11fde209d9 req-c5e5e855-a582-4aa0-a17c-a31bf5300973 service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Received event network-changed-2ebee28a-6811-4631-a379-665b2ac7c97b {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:42:53 user nova-compute[74247]: DEBUG nova.compute.manager [req-d43622b3-682c-462c-b275-2a11fde209d9 req-c5e5e855-a582-4aa0-a17c-a31bf5300973 service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Refreshing instance network info cache due to event network-changed-2ebee28a-6811-4631-a379-665b2ac7c97b. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:42:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d43622b3-682c-462c-b275-2a11fde209d9 req-c5e5e855-a582-4aa0-a17c-a31bf5300973 service nova] Acquiring lock "refresh_cache-3dfec5ff-83b2-442e-af36-d17e959bf316" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:42:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d43622b3-682c-462c-b275-2a11fde209d9 req-c5e5e855-a582-4aa0-a17c-a31bf5300973 service nova] Acquired lock "refresh_cache-3dfec5ff-83b2-442e-af36-d17e959bf316" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:42:53 user nova-compute[74247]: DEBUG nova.network.neutron [req-d43622b3-682c-462c-b275-2a11fde209d9 req-c5e5e855-a582-4aa0-a17c-a31bf5300973 service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Refreshing network info cache for port 2ebee28a-6811-4631-a379-665b2ac7c97b {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:42:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquiring lock "3dfec5ff-83b2-442e-af36-d17e959bf316" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:42:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "3dfec5ff-83b2-442e-af36-d17e959bf316" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:42:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:42:53 user nova-compute[74247]: DEBUG nova.objects.instance [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lazy-loading 'flavor' on Instance uuid 3dfec5ff-83b2-442e-af36-d17e959bf316 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:42:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "3dfec5ff-83b2-442e-af36-d17e959bf316" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.089s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:42:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquiring lock "3dfec5ff-83b2-442e-af36-d17e959bf316" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:42:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "3dfec5ff-83b2-442e-af36-d17e959bf316" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:42:53 user nova-compute[74247]: INFO nova.compute.manager [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Attaching volume c5377b24-e3c8-4620-9d52-23efadf4dc6f to /dev/vdb
Oct 16 18:42:54 user nova-compute[74247]: DEBUG os_brick.utils [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:42:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:42:54 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20aa4fe-a67d-4d0c-bd38-297d7a7ff71e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:42:54 user nova-compute[74247]: DEBUG nova.network.neutron [req-d43622b3-682c-462c-b275-2a11fde209d9 req-c5e5e855-a582-4aa0-a17c-a31bf5300973 service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Updated VIF entry in instance network info cache for port 2ebee28a-6811-4631-a379-665b2ac7c97b. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:42:54 user nova-compute[74247]: DEBUG nova.network.neutron [req-d43622b3-682c-462c-b275-2a11fde209d9 req-c5e5e855-a582-4aa0-a17c-a31bf5300973 service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Updating instance_info_cache with network_info: [{"id": "2ebee28a-6811-4631-a379-665b2ac7c97b", "address": "fa:16:3e:12:f3:44", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebee28a-68", "ovs_interfaceid": "2ebee28a-6811-4631-a379-665b2ac7c97b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:42:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:42:54 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2056adb-2ffa-49bc-ae1e-ba73bc497369]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:42:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:42:54 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[87db8de2-bd9d-4af6-bfcb-eb8d6812003b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:42:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d43622b3-682c-462c-b275-2a11fde209d9 req-c5e5e855-a582-4aa0-a17c-a31bf5300973 service nova] Releasing lock "refresh_cache-3dfec5ff-83b2-442e-af36-d17e959bf316" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:42:54 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c10d7a-ad5b-4aaa-9758-972cec1b5829]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:42:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:42:54 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 18:42:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:42:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:42:54 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 18:42:54 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c063ac0f-4a8f-42cc-b52f-c056a4d03a28]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:42:54 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 18:42:54 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 18:42:54 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 18:42:54 user nova-compute[74247]: DEBUG os_brick.utils [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:42:54 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Updating existing volume attachment record: 7e604450-ef95-47ac-8e47-544843490773 {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 18:42:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:42:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:42:59 user nova-compute[74247]: DEBUG nova.compute.manager [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 18:42:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:42:59 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Creating image(s)
Oct 16 18:42:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Did not create local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 18:42:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Ensure instance console log exists: /opt/stack/data/nova/instances/25d69a8d-98d5-4044-987a-f376aedfbe2a/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:42:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:42:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:42:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:42:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Start _get_guest_xml network_info=[{"id": "1e2af952-39b5-4add-9542-925c9babc88c", "address": "fa:16:3e:32:37:ce", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2af952-39", "ovs_interfaceid": "1e2af952-39b5-4add-9542-925c9babc88c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iBFLJvYf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '25d69a8d-98d5-4044-987a-f376aedfbe2a', 'attached_at': '', 'detached_at': '', 'volume_id': 'a5cf78da-abe8-4880-bed2-72611b707a27', 'serial': 'a5cf78da-abe8-4880-bed2-72611b707a27'}, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '85f26a53-7367-45fb-91a4-3c84f5fd42aa', 'guest_format': None, 'volume_type': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:42:59 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:42:59 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:42:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:42:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:42:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:42:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:42:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:42:59 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:42:59 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:42:59 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:42:59 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:42:59 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:42:59 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:42:59 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:42:59 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:42:59 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:42:59 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:42:59 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:42:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:42:59 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iBFLJvYf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:42:59 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:42:59 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:42:59 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:42:59 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:42:59 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:42:59 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:42:59 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:42:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0d2e75-4015-4a93-b6ad-e351a414d1fc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 18:43:00 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e0d328-bdc9-4594-ac13-11a6e9845b26]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27] added
Oct 16 18:43:00 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[927e2522-fcd3-46dc-a268-1941f854775d]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1503ef2a-c76f-45ac-98f9-a74b07bfe450]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iBFLJvYf {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iBFLJvYf" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9217e5a-2243-4b9d-b094-d46a987026d7]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iBFLJvYf'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2c54e5-5d57-4a95-b153-f75199baaf3c]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8d350b-0ff6-4dde-bd99-e6677620fee6]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:43:00 user nova-compute[74247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)
Oct 16 18:43:00 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:43:00 user nova-compute[74247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)
Oct 16 18:43:00 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6690ded4-2478-4715-90bb-002ceba4602b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27, portal: 172.16.0.220,3260]
Oct 16 18:43:00 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27, portal: 172.16.0.220,3260] successful.
Oct 16 18:43:00 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ac208f-9e09-4bec-bc6a-b2f68dd4beb6]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea783026-c288-4978-8fec-cbb38d26384f]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:43:00 user nova-compute[74247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)
Oct 16 18:43:00 user nova-compute[74247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)
Oct 16 18:43:00 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:43:00 user nova-compute[74247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)
Oct 16 18:43:00 user nova-compute[74247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)
Oct 16 18:43:00 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb2da42-3e57-4191-a5af-ce258eebd662]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iBFLJvYf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Acquiring lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG nova.objects.instance [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lazy-loading 'flavor' on Instance uuid 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Acquiring lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:43:00 user nova-compute[74247]: INFO nova.compute.manager [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Attaching volume 047743e3-3172-45c4-b51f-3b1ed54d9f4b to /dev/vdb
Oct 16 18:43:00 user nova-compute[74247]: DEBUG os_brick.utils [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ae7129-5075-4ad5-aa06-1f8d4503ffb5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[385629b2-f791-4a08-85af-a1ca85f23fe9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f44a9fb-be9f-4993-921b-496f32a10700]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ea4910-7571-43b1-a964-b021856d3930]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:43:00 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 18:43:00 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[caefa51c-cb26-410d-832f-b2108f29940f]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:01 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 18:43:01 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 18:43:01 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 18:43:01 user nova-compute[74247]: DEBUG os_brick.utils [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:43:01 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Updating existing volume attachment record: 726623eb-9f3e-4c64-8b92-fb07b56199ca {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 18:43:01 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:43:01 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23364333231666630', 'path': '/dev/sdb'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:43:01 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364333231666630', 'path': '/dev/sdb'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:43:01 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:42:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-580863586',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-580863586',id=32,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bce6164a392e4cc2a027d12c49145e6d',ramdisk_id='',reservation_id='r-gsrsluny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-656520712',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:42:23Z,user_data=None,user_id='b01d3e5d2fcb40bc92c3d2fe1236d509',uuid=25d69a8d-98d5-4044-987a-f376aedfbe2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e2af952-39b5-4add-9542-925c9babc88c", "address": "fa:16:3e:32:37:ce", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2af952-39", "ovs_interfaceid": "1e2af952-39b5-4add-9542-925c9babc88c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:43:01 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Converting VIF {"id": "1e2af952-39b5-4add-9542-925c9babc88c", "address": "fa:16:3e:32:37:ce", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2af952-39", "ovs_interfaceid": "1e2af952-39b5-4add-9542-925c9babc88c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:43:01 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:37:ce,bridge_name='br-int',has_traffic_filtering=True,id=1e2af952-39b5-4add-9542-925c9babc88c,network=Network(2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e2af952-39') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:43:01 user nova-compute[74247]: DEBUG nova.objects.instance [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lazy-loading 'pci_devices' on Instance uuid 25d69a8d-98d5-4044-987a-f376aedfbe2a {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:43:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:01 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:43:01 user nova-compute[74247]:   <uuid>25d69a8d-98d5-4044-987a-f376aedfbe2a</uuid>
Oct 16 18:43:01 user nova-compute[74247]:   <name>instance-00000020</name>
Oct 16 18:43:01 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:43:01 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:43:01 user nova-compute[74247]:   <metadata>
Oct 16 18:43:01 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:43:01 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:43:01 user nova-compute[74247]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-580863586</nova:name>
Oct 16 18:43:01 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:42:59</nova:creationTime>
Oct 16 18:43:01 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:43:01 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:43:01 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:43:01 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:43:01 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:43:01 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:43:01 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:43:01 user nova-compute[74247]:       <nova:owner>
Oct 16 18:43:01 user nova-compute[74247]:         <nova:user uuid="b01d3e5d2fcb40bc92c3d2fe1236d509">tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member</nova:user>
Oct 16 18:43:01 user nova-compute[74247]:         <nova:project uuid="bce6164a392e4cc2a027d12c49145e6d">tempest-ServerBootFromVolumeStableRescueTest-656520712</nova:project>
Oct 16 18:43:01 user nova-compute[74247]:       </nova:owner>
Oct 16 18:43:01 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:43:01 user nova-compute[74247]:       <nova:ports>
Oct 16 18:43:01 user nova-compute[74247]:         <nova:port uuid="1e2af952-39b5-4add-9542-925c9babc88c">
Oct 16 18:43:01 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 16 18:43:01 user nova-compute[74247]:         </nova:port>
Oct 16 18:43:01 user nova-compute[74247]:       </nova:ports>
Oct 16 18:43:01 user nova-compute[74247]:     </nova:instance>
Oct 16 18:43:01 user nova-compute[74247]:   </metadata>
Oct 16 18:43:01 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:43:01 user nova-compute[74247]:     <system>
Oct 16 18:43:01 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:43:01 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:43:01 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:43:01 user nova-compute[74247]:       <entry name="serial">25d69a8d-98d5-4044-987a-f376aedfbe2a</entry>
Oct 16 18:43:01 user nova-compute[74247]:       <entry name="uuid">25d69a8d-98d5-4044-987a-f376aedfbe2a</entry>
Oct 16 18:43:01 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:43:01 user nova-compute[74247]:     </system>
Oct 16 18:43:01 user nova-compute[74247]:   </sysinfo>
Oct 16 18:43:01 user nova-compute[74247]:   <os>
Oct 16 18:43:01 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:43:01 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:43:01 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:43:01 user nova-compute[74247]:   </os>
Oct 16 18:43:01 user nova-compute[74247]:   <features>
Oct 16 18:43:01 user nova-compute[74247]:     <acpi/>
Oct 16 18:43:01 user nova-compute[74247]:     <apic/>
Oct 16 18:43:01 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:43:01 user nova-compute[74247]:   </features>
Oct 16 18:43:01 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:43:01 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:43:01 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:43:01 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:43:01 user nova-compute[74247]:   </clock>
Oct 16 18:43:01 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:43:01 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:43:01 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:43:01 user nova-compute[74247]:   </cpu>
Oct 16 18:43:01 user nova-compute[74247]:   <devices>
Oct 16 18:43:01 user nova-compute[74247]:     <disk type="block" device="disk">
Oct 16 18:43:01 user nova-compute[74247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:43:01 user nova-compute[74247]:       <source dev="/dev/sdb"/>
Oct 16 18:43:01 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:43:01 user nova-compute[74247]:       <serial>a5cf78da-abe8-4880-bed2-72611b707a27</serial>
Oct 16 18:43:01 user nova-compute[74247]:     </disk>
Oct 16 18:43:01 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:43:01 user nova-compute[74247]:       <mac address="fa:16:3e:32:37:ce"/>
Oct 16 18:43:01 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:43:01 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:43:01 user nova-compute[74247]:       <target dev="tap1e2af952-39"/>
Oct 16 18:43:01 user nova-compute[74247]:     </interface>
Oct 16 18:43:01 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:43:01 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/25d69a8d-98d5-4044-987a-f376aedfbe2a/console.log" append="off"/>
Oct 16 18:43:01 user nova-compute[74247]:     </serial>
Oct 16 18:43:01 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:43:01 user nova-compute[74247]:     <video>
Oct 16 18:43:01 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:43:01 user nova-compute[74247]:     </video>
Oct 16 18:43:01 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:43:01 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:43:01 user nova-compute[74247]:     </rng>
Oct 16 18:43:01 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:43:01 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:43:01 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:43:01 user nova-compute[74247]:     </memballoon>
Oct 16 18:43:01 user nova-compute[74247]:   </devices>
Oct 16 18:43:01 user nova-compute[74247]: </domain>
Oct 16 18:43:01 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:43:01 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:42:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-580863586',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-580863586',id=32,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bce6164a392e4cc2a027d12c49145e6d',ramdisk_id='',reservation_id='r-gsrsluny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-656520712',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:42:23Z,user_data=None,user_id='b01d3e5d2fcb40bc92c3d2fe1236d509',uuid=25d69a8d-98d5-4044-987a-f376aedfbe2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e2af952-39b5-4add-9542-925c9babc88c", "address": "fa:16:3e:32:37:ce", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2af952-39", "ovs_interfaceid": "1e2af952-39b5-4add-9542-925c9babc88c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:43:01 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Converting VIF {"id": "1e2af952-39b5-4add-9542-925c9babc88c", "address": "fa:16:3e:32:37:ce", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2af952-39", "ovs_interfaceid": "1e2af952-39b5-4add-9542-925c9babc88c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:43:01 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:37:ce,bridge_name='br-int',has_traffic_filtering=True,id=1e2af952-39b5-4add-9542-925c9babc88c,network=Network(2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e2af952-39') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:43:01 user nova-compute[74247]: DEBUG os_vif [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:37:ce,bridge_name='br-int',has_traffic_filtering=True,id=1e2af952-39b5-4add-9542-925c9babc88c,network=Network(2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e2af952-39') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:43:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:43:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:43:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '53228b47-e8c2-51bc-8864-e3efb75c219d', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:43:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:43:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e2af952-39, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:43:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1e2af952-39, col_values=(('qos', UUID('61e1edbf-fe33-4aa5-81d7-03fd1f5cd391')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:43:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1e2af952-39, col_values=(('external_ids', {'iface-id': '1e2af952-39b5-4add-9542-925c9babc88c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:37:ce', 'vm-uuid': '25d69a8d-98d5-4044-987a-f376aedfbe2a'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:43:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:43:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:01 user nova-compute[74247]: INFO os_vif [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:37:ce,bridge_name='br-int',has_traffic_filtering=True,id=1e2af952-39b5-4add-9542-925c9babc88c,network=Network(2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e2af952-39')
Oct 16 18:43:01 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:43:01 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] No VIF found with MAC fa:16:3e:32:37:ce, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:43:02 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:02 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:02 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:02 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:02 user nova-compute[74247]: DEBUG nova.compute.manager [req-e8e7acca-d939-4661-b811-80acea1274bc req-2ad5d4f8-a81d-44f4-a063-1a94d2371994 service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Received event network-vif-plugged-1e2af952-39b5-4add-9542-925c9babc88c {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:43:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e8e7acca-d939-4661-b811-80acea1274bc req-2ad5d4f8-a81d-44f4-a063-1a94d2371994 service nova] Acquiring lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:43:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e8e7acca-d939-4661-b811-80acea1274bc req-2ad5d4f8-a81d-44f4-a063-1a94d2371994 service nova] Lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:43:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e8e7acca-d939-4661-b811-80acea1274bc req-2ad5d4f8-a81d-44f4-a063-1a94d2371994 service nova] Lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:43:02 user nova-compute[74247]: DEBUG nova.compute.manager [req-e8e7acca-d939-4661-b811-80acea1274bc req-2ad5d4f8-a81d-44f4-a063-1a94d2371994 service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] No waiting events found dispatching network-vif-plugged-1e2af952-39b5-4add-9542-925c9babc88c {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:43:02 user nova-compute[74247]: WARNING nova.compute.manager [req-e8e7acca-d939-4661-b811-80acea1274bc req-2ad5d4f8-a81d-44f4-a063-1a94d2371994 service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Received unexpected event network-vif-plugged-1e2af952-39b5-4add-9542-925c9babc88c for instance with vm_state building and task_state spawning.
Oct 16 18:43:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-bc72593a-ae53-4ebe-a4c3-adafbcb84793 req-e8f8790f-fd5d-41ca-b05a-e707f058332f service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Received event network-vif-plugged-1e2af952-39b5-4add-9542-925c9babc88c {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:43:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-bc72593a-ae53-4ebe-a4c3-adafbcb84793 req-e8f8790f-fd5d-41ca-b05a-e707f058332f service nova] Acquiring lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:43:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-bc72593a-ae53-4ebe-a4c3-adafbcb84793 req-e8f8790f-fd5d-41ca-b05a-e707f058332f service nova] Lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:43:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-bc72593a-ae53-4ebe-a4c3-adafbcb84793 req-e8f8790f-fd5d-41ca-b05a-e707f058332f service nova] Lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:43:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-bc72593a-ae53-4ebe-a4c3-adafbcb84793 req-e8f8790f-fd5d-41ca-b05a-e707f058332f service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] No waiting events found dispatching network-vif-plugged-1e2af952-39b5-4add-9542-925c9babc88c {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:43:05 user nova-compute[74247]: WARNING nova.compute.manager [req-bc72593a-ae53-4ebe-a4c3-adafbcb84793 req-e8f8790f-fd5d-41ca-b05a-e707f058332f service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Received unexpected event network-vif-plugged-1e2af952-39b5-4add-9542-925c9babc88c for instance with vm_state building and task_state spawning.
Oct 16 18:43:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f6f5f6bd-768a-4e15-93c9-67d183e045fd tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquiring lock "cbdb3c4c-7a6f-4966-bc13-049efe0cded2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:43:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f6f5f6bd-768a-4e15-93c9-67d183e045fd tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "cbdb3c4c-7a6f-4966-bc13-049efe0cded2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:43:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f6f5f6bd-768a-4e15-93c9-67d183e045fd tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquiring lock "cbdb3c4c-7a6f-4966-bc13-049efe0cded2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:43:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f6f5f6bd-768a-4e15-93c9-67d183e045fd tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "cbdb3c4c-7a6f-4966-bc13-049efe0cded2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:43:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f6f5f6bd-768a-4e15-93c9-67d183e045fd tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "cbdb3c4c-7a6f-4966-bc13-049efe0cded2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:43:05 user nova-compute[74247]: INFO nova.compute.manager [None req-f6f5f6bd-768a-4e15-93c9-67d183e045fd tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Terminating instance
Oct 16 18:43:05 user nova-compute[74247]: DEBUG nova.compute.manager [None req-f6f5f6bd-768a-4e15-93c9-67d183e045fd tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 18:43:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:05 user nova-compute[74247]: DEBUG nova.compute.manager [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:43:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:43:05 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Instance spawned successfully.
Oct 16 18:43:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 18:43:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:43:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:43:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:43:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:43:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:43:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:43:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:05 user nova-compute[74247]: INFO nova.compute.manager [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Took 5.42 seconds to spawn the instance on the hypervisor.
Oct 16 18:43:05 user nova-compute[74247]: DEBUG nova.compute.manager [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:43:05 user nova-compute[74247]: INFO nova.compute.manager [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Took 42.89 seconds to build instance.
Oct 16 18:43:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-9b36184d-a5b4-4849-b500-971024e45b10 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "25d69a8d-98d5-4044-987a-f376aedfbe2a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 42.993s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:43:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:05 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Instance destroyed successfully.
Oct 16 18:43:05 user nova-compute[74247]: DEBUG nova.objects.instance [None req-f6f5f6bd-768a-4e15-93c9-67d183e045fd tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lazy-loading 'resources' on Instance uuid cbdb3c4c-7a6f-4966-bc13-049efe0cded2 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:43:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-f6f5f6bd-768a-4e15-93c9-67d183e045fd tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T18:36:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-803649508',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-803649508',id=25,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPt8RnxxjMin5ow9n0gYco5PnH7fBvzjVT+zJBAuIfIL73SFyQOt4/yFyMr89xqJ/fI+kazkxk5AA5YPdknlG4FiNoYepFgnFcnJNQU4P+bwfVCqmJXmT/tM+RcLA45aFQ==',key_name='tempest-keypair-1823297427',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:40:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5204c1aec5764c298a206429645eb268',ramdisk_id='',reservation_id='r-cnkbq1wz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-537076068',owner_user_name='tempest-AttachVolumeShelveTestJSON-537076068-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:40:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bda4c43b45347be96b152caba47b07d',uuid=cbdb3c4c-7a6f-4966-bc13-049efe0cded2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "867368eb-89d8-4de5-a8cd-9a1435b624fb", "address": "fa:16:3e:61:36:9f", "network": {"id": "88a1b265-5360-4362-90bc-3506f805688f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-620663417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5204c1aec5764c298a206429645eb268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867368eb-89", "ovs_interfaceid": "867368eb-89d8-4de5-a8cd-9a1435b624fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:43:05 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-f6f5f6bd-768a-4e15-93c9-67d183e045fd tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Converting VIF {"id": "867368eb-89d8-4de5-a8cd-9a1435b624fb", "address": "fa:16:3e:61:36:9f", "network": {"id": "88a1b265-5360-4362-90bc-3506f805688f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-620663417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5204c1aec5764c298a206429645eb268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867368eb-89", "ovs_interfaceid": "867368eb-89d8-4de5-a8cd-9a1435b624fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:43:05 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-f6f5f6bd-768a-4e15-93c9-67d183e045fd tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:36:9f,bridge_name='br-int',has_traffic_filtering=True,id=867368eb-89d8-4de5-a8cd-9a1435b624fb,network=Network(88a1b265-5360-4362-90bc-3506f805688f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867368eb-89') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:43:05 user nova-compute[74247]: DEBUG os_vif [None req-f6f5f6bd-768a-4e15-93c9-67d183e045fd tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:36:9f,bridge_name='br-int',has_traffic_filtering=True,id=867368eb-89d8-4de5-a8cd-9a1435b624fb,network=Network(88a1b265-5360-4362-90bc-3506f805688f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867368eb-89') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:43:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap867368eb-89, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:43:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=33844961-bd7b-47e0-a3e9-a5e2a1159e24) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:43:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:43:05 user nova-compute[74247]: INFO os_vif [None req-f6f5f6bd-768a-4e15-93c9-67d183e045fd tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:36:9f,bridge_name='br-int',has_traffic_filtering=True,id=867368eb-89d8-4de5-a8cd-9a1435b624fb,network=Network(88a1b265-5360-4362-90bc-3506f805688f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867368eb-89')
Oct 16 18:43:05 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-f6f5f6bd-768a-4e15-93c9-67d183e045fd tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Deleting instance files /opt/stack/data/nova/instances/cbdb3c4c-7a6f-4966-bc13-049efe0cded2_del
Oct 16 18:43:05 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-f6f5f6bd-768a-4e15-93c9-67d183e045fd tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Deletion of /opt/stack/data/nova/instances/cbdb3c4c-7a6f-4966-bc13-049efe0cded2_del complete
Oct 16 18:43:06 user nova-compute[74247]: INFO nova.compute.manager [None req-f6f5f6bd-768a-4e15-93c9-67d183e045fd tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Took 0.97 seconds to destroy the instance on the hypervisor.
Oct 16 18:43:06 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-f6f5f6bd-768a-4e15-93c9-67d183e045fd tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 18:43:06 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 18:43:06 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 18:43:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:06 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:43:06 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:43:06 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 18:43:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "refresh_cache-cddf4842-1c25-4cc8-914e-af30849e4d6c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:43:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquired lock "refresh_cache-cddf4842-1c25-4cc8-914e-af30849e4d6c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:43:06 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Forcefully refreshing network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 18:43:07 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:43:07 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Took 0.99 seconds to deallocate network for instance.
Oct 16 18:43:07 user nova-compute[74247]: DEBUG nova.compute.manager [req-86f6c1a1-b8a7-4342-8569-9fe82a28d26a req-fb06e7f8-a3e3-42fc-81e5-def2ab251aae service nova] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Received event network-vif-unplugged-867368eb-89d8-4de5-a8cd-9a1435b624fb {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:43:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-86f6c1a1-b8a7-4342-8569-9fe82a28d26a req-fb06e7f8-a3e3-42fc-81e5-def2ab251aae service nova] Acquiring lock "cbdb3c4c-7a6f-4966-bc13-049efe0cded2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:43:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-86f6c1a1-b8a7-4342-8569-9fe82a28d26a req-fb06e7f8-a3e3-42fc-81e5-def2ab251aae service nova] Lock "cbdb3c4c-7a6f-4966-bc13-049efe0cded2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:43:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-86f6c1a1-b8a7-4342-8569-9fe82a28d26a req-fb06e7f8-a3e3-42fc-81e5-def2ab251aae service nova] Lock "cbdb3c4c-7a6f-4966-bc13-049efe0cded2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:43:07 user nova-compute[74247]: DEBUG nova.compute.manager [req-86f6c1a1-b8a7-4342-8569-9fe82a28d26a req-fb06e7f8-a3e3-42fc-81e5-def2ab251aae service nova] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] No waiting events found dispatching network-vif-unplugged-867368eb-89d8-4de5-a8cd-9a1435b624fb {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:43:07 user nova-compute[74247]: DEBUG nova.compute.manager [req-86f6c1a1-b8a7-4342-8569-9fe82a28d26a req-fb06e7f8-a3e3-42fc-81e5-def2ab251aae service nova] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Received event network-vif-unplugged-867368eb-89d8-4de5-a8cd-9a1435b624fb for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:43:07 user nova-compute[74247]: DEBUG nova.compute.manager [req-86f6c1a1-b8a7-4342-8569-9fe82a28d26a req-fb06e7f8-a3e3-42fc-81e5-def2ab251aae service nova] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Received event network-vif-plugged-867368eb-89d8-4de5-a8cd-9a1435b624fb {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:43:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-86f6c1a1-b8a7-4342-8569-9fe82a28d26a req-fb06e7f8-a3e3-42fc-81e5-def2ab251aae service nova] Acquiring lock "cbdb3c4c-7a6f-4966-bc13-049efe0cded2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:43:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-86f6c1a1-b8a7-4342-8569-9fe82a28d26a req-fb06e7f8-a3e3-42fc-81e5-def2ab251aae service nova] Lock "cbdb3c4c-7a6f-4966-bc13-049efe0cded2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:43:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-86f6c1a1-b8a7-4342-8569-9fe82a28d26a req-fb06e7f8-a3e3-42fc-81e5-def2ab251aae service nova] Lock "cbdb3c4c-7a6f-4966-bc13-049efe0cded2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:43:07 user nova-compute[74247]: DEBUG nova.compute.manager [req-86f6c1a1-b8a7-4342-8569-9fe82a28d26a req-fb06e7f8-a3e3-42fc-81e5-def2ab251aae service nova] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] No waiting events found dispatching network-vif-plugged-867368eb-89d8-4de5-a8cd-9a1435b624fb {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:43:07 user nova-compute[74247]: WARNING nova.compute.manager [req-86f6c1a1-b8a7-4342-8569-9fe82a28d26a req-fb06e7f8-a3e3-42fc-81e5-def2ab251aae service nova] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Received unexpected event network-vif-plugged-867368eb-89d8-4de5-a8cd-9a1435b624fb for instance with vm_state active and task_state deleting.
Oct 16 18:43:07 user nova-compute[74247]: DEBUG nova.compute.manager [req-86f6c1a1-b8a7-4342-8569-9fe82a28d26a req-fb06e7f8-a3e3-42fc-81e5-def2ab251aae service nova] [instance: cbdb3c4c-7a6f-4966-bc13-049efe0cded2] Received event network-vif-deleted-867368eb-89d8-4de5-a8cd-9a1435b624fb {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:43:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f6f5f6bd-768a-4e15-93c9-67d183e045fd tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:43:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f6f5f6bd-768a-4e15-93c9-67d183e045fd tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:43:07 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Updating instance_info_cache with network_info: [{"id": "badc9f06-cef7-46bf-8b74-5d53401021f5", "address": "fa:16:3e:c8:ea:de", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbadc9f06-ce", "ovs_interfaceid": "badc9f06-cef7-46bf-8b74-5d53401021f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:43:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Releasing lock "refresh_cache-cddf4842-1c25-4cc8-914e-af30849e4d6c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:43:07 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Updated the network info_cache for instance {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 18:43:07 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:43:07 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-f6f5f6bd-768a-4e15-93c9-67d183e045fd tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:43:07 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-f6f5f6bd-768a-4e15-93c9-67d183e045fd tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:43:07 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:43:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f6f5f6bd-768a-4e15-93c9-67d183e045fd tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.502s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:43:07 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-f6f5f6bd-768a-4e15-93c9-67d183e045fd tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Deleted allocations for instance cbdb3c4c-7a6f-4966-bc13-049efe0cded2
Oct 16 18:43:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f6f5f6bd-768a-4e15-93c9-67d183e045fd tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "cbdb3c4c-7a6f-4966-bc13-049efe0cded2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.686s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:43:08 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:43:09 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:43:10 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:43:10 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:43:10 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:43:10 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:43:10 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 18:43:10 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:10 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:11 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:43:11 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:43:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:12 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:43:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:12 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:43:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sixbaqgy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:43:12 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:43:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:43:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:43:12 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:43:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:43:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:43:12 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:43:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:12 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa5e73b-be36-4a8d-8910-001cff5c61d6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 18:43:12 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:43:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:12 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[237fa4ff-8022-491c-ac3b-1eb8e7ac2733]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f] added
Oct 16 18:43:12 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:43:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:12 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d34ea15-1e3a-47d4-8e42-7ee6db05dd50]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:43:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.039s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:12 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[884a87cc-eeb7-4968-aa74-ef33d434157f]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:43:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sixbaqgy {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sixbaqgy" returned: 0 in 0.026s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:12 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d717c4-50df-4181-86d2-3878623d86b6]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sixbaqgy'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:43:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:12 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f151855-b218-4313-9947-fdfd3fe8ecfc]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:43:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:12 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5045ee9-34f9-4a96-b0df-2fbbea38b29e]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:43:12 user nova-compute[74247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)
Oct 16 18:43:12 user nova-compute[74247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)
Oct 16 18:43:12 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:43:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:43:12 user nova-compute[74247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)
Oct 16 18:43:12 user nova-compute[74247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)
Oct 16 18:43:12 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:43:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:13 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97be5f3-653e-47ce-96bb-38aad26d0341]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f, portal: 172.16.0.220,3260]
Oct 16 18:43:13 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f, portal: 172.16.0.220,3260] successful.
Oct 16 18:43:13 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:43:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:13 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cdb4de0-7881-4497-988f-ceb18e2ac3cf]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:43:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:13 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae89aae-03b1-4194-9d1f-92d5e210353c]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:43:13 user nova-compute[74247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)
Oct 16 18:43:13 user nova-compute[74247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)
Oct 16 18:43:13 user nova-compute[74247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)
Oct 16 18:43:13 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:43:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:43:13 user nova-compute[74247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)
Oct 16 18:43:13 user nova-compute[74247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)
Oct 16 18:43:13 user nova-compute[74247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)
Oct 16 18:43:13 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:43:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:43:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:43:13 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:43:13 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:43:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:13 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[660af11f-704b-4d77-8c31-6b97fce21590]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:13 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: None {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:43:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61819735-95a5-4543-915d-bd50c671002b/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61819735-95a5-4543-915d-bd50c671002b/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61819735-95a5-4543-915d-bd50c671002b/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:14 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:43:14 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sixbaqgy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:43:14 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.422s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:43:14 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] <== connect_volume: return (1424ms) {'type': 'block', 'scsi_wwn': '23731646163623561', 'path': '/dev/sde'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:43:14 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731646163623561', 'path': '/dev/sde'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:43:14 user nova-compute[74247]: DEBUG nova.objects.instance [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lazy-loading 'flavor' on Instance uuid 3dfec5ff-83b2-442e-af36-d17e959bf316 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:43:14 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 18:43:14 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:43:14 user nova-compute[74247]:   <source dev="/dev/sde"/>
Oct 16 18:43:14 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:43:14 user nova-compute[74247]:   <serial>c5377b24-e3c8-4620-9d52-23efadf4dc6f</serial>
Oct 16 18:43:14 user nova-compute[74247]: </disk>
Oct 16 18:43:14 user nova-compute[74247]:  {{(pid=74247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 18:43:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61819735-95a5-4543-915d-bd50c671002b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:15 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:43:15 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:43:15 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=7765MB free_disk=24.894580841064453GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 18:43:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:43:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:43:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:43:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:43:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] No VIF found with MAC fa:16:3e:12:f3:44, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:43:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1c9452d2-c4fd-4cfb-aa7a-0a92329a88de tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "3dfec5ff-83b2-442e-af36-d17e959bf316" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.499s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:43:15 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance e37fbc27-3404-479a-be08-4d590391cf30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:43:15 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance cddf4842-1c25-4cc8-914e-af30849e4d6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:43:15 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 958af87e-69d0-4da1-8fcf-90e0f275d62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:43:15 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance d775101d-53a1-48c7-af24-91480be6af61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:43:15 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 7dcc08e9-7439-436b-8d9f-facaf04e22c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:43:15 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:43:15 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 88ea9961-7a1d-4193-b72f-63e398752141 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:43:15 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 220798e9-aea4-4c79-9737-175ab0598e7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:43:15 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 3dfec5ff-83b2-442e-af36-d17e959bf316 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:43:15 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 61819735-95a5-4543-915d-bd50c671002b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:43:15 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 25d69a8d-98d5-4044-987a-f376aedfbe2a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:43:15 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 18:43:15 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 18:43:15 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:43:15 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:43:15 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 18:43:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.541s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:43:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:16 user nova-compute[74247]: INFO nova.compute.manager [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Rescuing
Oct 16 18:43:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquiring lock "refresh_cache-3dfec5ff-83b2-442e-af36-d17e959bf316" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:43:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquired lock "refresh_cache-3dfec5ff-83b2-442e-af36-d17e959bf316" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:43:16 user nova-compute[74247]: DEBUG nova.network.neutron [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:43:16 user nova-compute[74247]: DEBUG nova.network.neutron [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Updating instance_info_cache with network_info: [{"id": "2ebee28a-6811-4631-a379-665b2ac7c97b", "address": "fa:16:3e:12:f3:44", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebee28a-68", "ovs_interfaceid": "2ebee28a-6811-4631-a379-665b2ac7c97b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:43:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Releasing lock "refresh_cache-3dfec5ff-83b2-442e-af36-d17e959bf316" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:43:16 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:43:16 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:43:16 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 18:43:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:17 user nova-compute[74247]: DEBUG nova.compute.manager [req-885cefb4-eb31-4017-9060-344c4bc2ea40 req-687afc72-b787-4088-86be-b1babc8e9a1c service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Received event network-vif-unplugged-2ebee28a-6811-4631-a379-665b2ac7c97b {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:43:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-885cefb4-eb31-4017-9060-344c4bc2ea40 req-687afc72-b787-4088-86be-b1babc8e9a1c service nova] Acquiring lock "3dfec5ff-83b2-442e-af36-d17e959bf316-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:43:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-885cefb4-eb31-4017-9060-344c4bc2ea40 req-687afc72-b787-4088-86be-b1babc8e9a1c service nova] Lock "3dfec5ff-83b2-442e-af36-d17e959bf316-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:43:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-885cefb4-eb31-4017-9060-344c4bc2ea40 req-687afc72-b787-4088-86be-b1babc8e9a1c service nova] Lock "3dfec5ff-83b2-442e-af36-d17e959bf316-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:43:17 user nova-compute[74247]: DEBUG nova.compute.manager [req-885cefb4-eb31-4017-9060-344c4bc2ea40 req-687afc72-b787-4088-86be-b1babc8e9a1c service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] No waiting events found dispatching network-vif-unplugged-2ebee28a-6811-4631-a379-665b2ac7c97b {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:43:17 user nova-compute[74247]: WARNING nova.compute.manager [req-885cefb4-eb31-4017-9060-344c4bc2ea40 req-687afc72-b787-4088-86be-b1babc8e9a1c service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Received unexpected event network-vif-unplugged-2ebee28a-6811-4631-a379-665b2ac7c97b for instance with vm_state active and task_state rescuing.
Oct 16 18:43:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:17 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Instance destroyed successfully.
Oct 16 18:43:17 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Attempting rescue
Oct 16 18:43:17 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74247) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 16 18:43:17 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Instance directory exists: not creating {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 16 18:43:17 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Creating image(s)
Oct 16 18:43:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquiring lock "/opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:43:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "/opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:43:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "/opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:43:17 user nova-compute[74247]: DEBUG nova.objects.instance [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3dfec5ff-83b2-442e-af36-d17e959bf316 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:43:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquiring lock "37399febbd18f60b85fd0f833558f6a3539ab231" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:43:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:43:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.174s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/disk.rescue {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/disk.rescue" returned: 0 in 0.050s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:43:17 user nova-compute[74247]: DEBUG nova.objects.instance [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lazy-loading 'migration_context' on Instance uuid 3dfec5ff-83b2-442e-af36-d17e959bf316 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:43:17 user nova-compute[74247]: DEBUG nova.objects.base [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Object Instance<3dfec5ff-83b2-442e-af36-d17e959bf316> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:43:17 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 18:43:17 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Start _get_guest_xml network_info=[{"id": "2ebee28a-6811-4631-a379-665b2ac7c97b", "address": "fa:16:3e:12:f3:44", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "vif_mac": "fa:16:3e:12:f3:44"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebee28a-68", "ovs_interfaceid": "2ebee28a-6811-4631-a379-665b2ac7c97b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '83126bb1-29f5-42fe-8620-72ab0797f776', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:43:17 user nova-compute[74247]: DEBUG nova.objects.instance [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lazy-loading 'resources' on Instance uuid 3dfec5ff-83b2-442e-af36-d17e959bf316 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:43:17 user nova-compute[74247]: DEBUG nova.objects.base [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Object Instance<3dfec5ff-83b2-442e-af36-d17e959bf316> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:43:17 user nova-compute[74247]: DEBUG nova.objects.instance [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lazy-loading 'numa_topology' on Instance uuid 3dfec5ff-83b2-442e-af36-d17e959bf316 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:43:17 user nova-compute[74247]: DEBUG nova.objects.base [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Object Instance<3dfec5ff-83b2-442e-af36-d17e959bf316> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:43:17 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:43:17 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:43:17 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:43:17 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:43:17 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:43:17 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:43:17 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:43:17 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:43:17 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:43:17 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:43:17 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:43:17 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:43:17 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:43:17 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:43:17 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:43:17 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:43:17 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:43:17 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:43:17 user nova-compute[74247]: DEBUG nova.objects.instance [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3dfec5ff-83b2-442e-af36-d17e959bf316 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:43:17 user nova-compute[74247]: DEBUG nova.objects.base [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Object Instance<3dfec5ff-83b2-442e-af36-d17e959bf316> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:43:17 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:41:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1641247620',display_name='tempest-ServerRescueNegativeTestJSON-server-1641247620',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1641247620',id=30,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPsDWRwLQfsC0Y7dw9Z15xe1y5GC7wHRETqUhbz5J1D6I9OPjIxouEGDX+yZjSp+CFSUIs9c1ficEwzIGhYvXQr7II5hyw6ajkuKxYHIVRNPTwDYN/rcvL+tVrC3iDbD+Q==',key_name='tempest-keypair-1614073413',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:41:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16160dad45544c6e8d9758e883089822',ramdisk_id='',reservation_id='r-61vw28hu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2007731322',owner_user_name='tempest-ServerRescueNegativeTestJSON-2007731322-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:41:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51026968ba1f49eaa8e0cc27a81855db',uuid=3dfec5ff-83b2-442e-af36-d17e959bf316,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ebee28a-6811-4631-a379-665b2ac7c97b", "address": "fa:16:3e:12:f3:44", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "vif_mac": "fa:16:3e:12:f3:44"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebee28a-68", "ovs_interfaceid": "2ebee28a-6811-4631-a379-665b2ac7c97b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:43:17 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Converting VIF {"id": "2ebee28a-6811-4631-a379-665b2ac7c97b", "address": "fa:16:3e:12:f3:44", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "vif_mac": "fa:16:3e:12:f3:44"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebee28a-68", "ovs_interfaceid": "2ebee28a-6811-4631-a379-665b2ac7c97b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:43:17 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:f3:44,bridge_name='br-int',has_traffic_filtering=True,id=2ebee28a-6811-4631-a379-665b2ac7c97b,network=Network(57ee1ccc-d7df-4a86-9234-c3c5f447e051),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ebee28a-68') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:43:17 user nova-compute[74247]: DEBUG nova.objects.instance [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lazy-loading 'pci_devices' on Instance uuid 3dfec5ff-83b2-442e-af36-d17e959bf316 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:43:18 user nova-compute[74247]: DEBUG nova.objects.base [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Object Instance<3dfec5ff-83b2-442e-af36-d17e959bf316> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:43:18 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:43:18 user nova-compute[74247]:   <uuid>3dfec5ff-83b2-442e-af36-d17e959bf316</uuid>
Oct 16 18:43:18 user nova-compute[74247]:   <name>instance-0000001e</name>
Oct 16 18:43:18 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:43:18 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:43:18 user nova-compute[74247]:   <metadata>
Oct 16 18:43:18 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:43:18 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:43:18 user nova-compute[74247]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1641247620</nova:name>
Oct 16 18:43:18 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:43:17</nova:creationTime>
Oct 16 18:43:18 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:43:18 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:43:18 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:43:18 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:43:18 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:43:18 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:43:18 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:43:18 user nova-compute[74247]:       <nova:owner>
Oct 16 18:43:18 user nova-compute[74247]:         <nova:user uuid="51026968ba1f49eaa8e0cc27a81855db">tempest-ServerRescueNegativeTestJSON-2007731322-project-member</nova:user>
Oct 16 18:43:18 user nova-compute[74247]:         <nova:project uuid="16160dad45544c6e8d9758e883089822">tempest-ServerRescueNegativeTestJSON-2007731322</nova:project>
Oct 16 18:43:18 user nova-compute[74247]:       </nova:owner>
Oct 16 18:43:18 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:43:18 user nova-compute[74247]:       <nova:ports>
Oct 16 18:43:18 user nova-compute[74247]:         <nova:port uuid="2ebee28a-6811-4631-a379-665b2ac7c97b">
Oct 16 18:43:18 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 16 18:43:18 user nova-compute[74247]:         </nova:port>
Oct 16 18:43:18 user nova-compute[74247]:       </nova:ports>
Oct 16 18:43:18 user nova-compute[74247]:     </nova:instance>
Oct 16 18:43:18 user nova-compute[74247]:   </metadata>
Oct 16 18:43:18 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:43:18 user nova-compute[74247]:     <system>
Oct 16 18:43:18 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:43:18 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:43:18 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:43:18 user nova-compute[74247]:       <entry name="serial">3dfec5ff-83b2-442e-af36-d17e959bf316</entry>
Oct 16 18:43:18 user nova-compute[74247]:       <entry name="uuid">3dfec5ff-83b2-442e-af36-d17e959bf316</entry>
Oct 16 18:43:18 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:43:18 user nova-compute[74247]:     </system>
Oct 16 18:43:18 user nova-compute[74247]:   </sysinfo>
Oct 16 18:43:18 user nova-compute[74247]:   <os>
Oct 16 18:43:18 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:43:18 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:43:18 user nova-compute[74247]:   </os>
Oct 16 18:43:18 user nova-compute[74247]:   <features>
Oct 16 18:43:18 user nova-compute[74247]:     <acpi/>
Oct 16 18:43:18 user nova-compute[74247]:     <apic/>
Oct 16 18:43:18 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:43:18 user nova-compute[74247]:   </features>
Oct 16 18:43:18 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:43:18 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:43:18 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:43:18 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:43:18 user nova-compute[74247]:   </clock>
Oct 16 18:43:18 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:43:18 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:43:18 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:43:18 user nova-compute[74247]:   </cpu>
Oct 16 18:43:18 user nova-compute[74247]:   <devices>
Oct 16 18:43:18 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:43:18 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:43:18 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/disk.rescue"/>
Oct 16 18:43:18 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:43:18 user nova-compute[74247]:     </disk>
Oct 16 18:43:18 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:43:18 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:43:18 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/disk"/>
Oct 16 18:43:18 user nova-compute[74247]:       <target dev="vdb" bus="virtio"/>
Oct 16 18:43:18 user nova-compute[74247]:     </disk>
Oct 16 18:43:18 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:43:18 user nova-compute[74247]:       <mac address="fa:16:3e:12:f3:44"/>
Oct 16 18:43:18 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:43:18 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:43:18 user nova-compute[74247]:       <target dev="tap2ebee28a-68"/>
Oct 16 18:43:18 user nova-compute[74247]:     </interface>
Oct 16 18:43:18 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:43:18 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/console.log" append="off"/>
Oct 16 18:43:18 user nova-compute[74247]:     </serial>
Oct 16 18:43:18 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:43:18 user nova-compute[74247]:     <video>
Oct 16 18:43:18 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:43:18 user nova-compute[74247]:     </video>
Oct 16 18:43:18 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:43:18 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:43:18 user nova-compute[74247]:     </rng>
Oct 16 18:43:18 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:43:18 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:43:18 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:43:18 user nova-compute[74247]:     </memballoon>
Oct 16 18:43:18 user nova-compute[74247]:   </devices>
Oct 16 18:43:18 user nova-compute[74247]: </domain>
Oct 16 18:43:18 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:43:18 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Instance destroyed successfully.
Oct 16 18:43:18 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:43:18 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:43:18 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] No VIF found with MAC fa:16:3e:12:f3:44, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:43:19 user nova-compute[74247]: DEBUG nova.compute.manager [req-229e1268-76c4-462c-a798-3d75eff40a72 req-5e437a1c-a251-4516-8caf-d8ab1d16862f service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Received event network-vif-plugged-2ebee28a-6811-4631-a379-665b2ac7c97b {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:43:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-229e1268-76c4-462c-a798-3d75eff40a72 req-5e437a1c-a251-4516-8caf-d8ab1d16862f service nova] Acquiring lock "3dfec5ff-83b2-442e-af36-d17e959bf316-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:43:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-229e1268-76c4-462c-a798-3d75eff40a72 req-5e437a1c-a251-4516-8caf-d8ab1d16862f service nova] Lock "3dfec5ff-83b2-442e-af36-d17e959bf316-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:43:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-229e1268-76c4-462c-a798-3d75eff40a72 req-5e437a1c-a251-4516-8caf-d8ab1d16862f service nova] Lock "3dfec5ff-83b2-442e-af36-d17e959bf316-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:43:19 user nova-compute[74247]: DEBUG nova.compute.manager [req-229e1268-76c4-462c-a798-3d75eff40a72 req-5e437a1c-a251-4516-8caf-d8ab1d16862f service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] No waiting events found dispatching network-vif-plugged-2ebee28a-6811-4631-a379-665b2ac7c97b {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:43:19 user nova-compute[74247]: WARNING nova.compute.manager [req-229e1268-76c4-462c-a798-3d75eff40a72 req-5e437a1c-a251-4516-8caf-d8ab1d16862f service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Received unexpected event network-vif-plugged-2ebee28a-6811-4631-a379-665b2ac7c97b for instance with vm_state active and task_state rescuing.
Oct 16 18:43:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:19 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:43:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JUIbfctP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:43:19 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:43:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:43:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:43:19 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:43:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:43:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:43:19 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:43:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:19 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c95854e-cf93-4a94-bf0e-752e44c9aa10]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 18:43:19 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:43:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:19 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d3dc6b-4205-44e0-9abf-0ac56433969e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b] added
Oct 16 18:43:19 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:43:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:19 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[974fdce1-6201-42e5-98c6-7784962a11fa]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:43:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:19 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e124649-9fff-4c2b-a0f6-cc8d8438418a]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:43:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JUIbfctP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JUIbfctP" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:19 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f937a59-179a-47c2-8195-8dba71ad21bc]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JUIbfctP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:43:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:19 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f15195-120c-4be3-80e1-ba2b96053853]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:43:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:19 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[68405d4a-9374-4f6b-8fde-22315fea49ea]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:43:19 user nova-compute[74247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)
Oct 16 18:43:19 user nova-compute[74247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)
Oct 16 18:43:19 user nova-compute[74247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)
Oct 16 18:43:19 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:43:19 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:43:19 user nova-compute[74247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)
Oct 16 18:43:19 user nova-compute[74247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)
Oct 16 18:43:19 user nova-compute[74247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)
Oct 16 18:43:19 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:43:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:20 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca91140-0244-4b98-8c1b-38f2c181c224]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b, portal: 172.16.0.220,3260]
Oct 16 18:43:20 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b, portal: 172.16.0.220,3260] successful.
Oct 16 18:43:20 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:43:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:20 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5666662-a6d1-4e54-baa0-81d72b0669ca]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:43:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:20 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df387b7-9335-4cc6-9e3f-286f09d42091]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:43:20 user nova-compute[74247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)
Oct 16 18:43:20 user nova-compute[74247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)
Oct 16 18:43:20 user nova-compute[74247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)
Oct 16 18:43:20 user nova-compute[74247]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b (non-flash)
Oct 16 18:43:20 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:43:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:43:20 user nova-compute[74247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)
Oct 16 18:43:20 user nova-compute[74247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)
Oct 16 18:43:20 user nova-compute[74247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)
Oct 16 18:43:20 user nova-compute[74247]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b (non-flash)
Oct 16 18:43:20 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:43:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:43:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:43:20 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] HCTL ('37', '-', '-', 0) found on session 33 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:43:20 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:43:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:20 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19e5d0a-7417-49e0-8d23-fafd7040a375]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:20 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Searching for a device in session 33 and hctl ['37', '*', '*', 0] yield: None {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:43:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:21 user nova-compute[74247]: DEBUG nova.compute.manager [req-4c6ba28a-bc46-46cc-8962-f3101e7bb074 req-2f476e67-f074-48aa-8c1e-af1ef9c17671 service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Received event network-vif-plugged-2ebee28a-6811-4631-a379-665b2ac7c97b {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:43:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4c6ba28a-bc46-46cc-8962-f3101e7bb074 req-2f476e67-f074-48aa-8c1e-af1ef9c17671 service nova] Acquiring lock "3dfec5ff-83b2-442e-af36-d17e959bf316-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:43:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4c6ba28a-bc46-46cc-8962-f3101e7bb074 req-2f476e67-f074-48aa-8c1e-af1ef9c17671 service nova] Lock "3dfec5ff-83b2-442e-af36-d17e959bf316-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:43:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4c6ba28a-bc46-46cc-8962-f3101e7bb074 req-2f476e67-f074-48aa-8c1e-af1ef9c17671 service nova] Lock "3dfec5ff-83b2-442e-af36-d17e959bf316-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:43:21 user nova-compute[74247]: DEBUG nova.compute.manager [req-4c6ba28a-bc46-46cc-8962-f3101e7bb074 req-2f476e67-f074-48aa-8c1e-af1ef9c17671 service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] No waiting events found dispatching network-vif-plugged-2ebee28a-6811-4631-a379-665b2ac7c97b {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:43:21 user nova-compute[74247]: WARNING nova.compute.manager [req-4c6ba28a-bc46-46cc-8962-f3101e7bb074 req-2f476e67-f074-48aa-8c1e-af1ef9c17671 service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Received unexpected event network-vif-plugged-2ebee28a-6811-4631-a379-665b2ac7c97b for instance with vm_state active and task_state rescuing.
Oct 16 18:43:21 user nova-compute[74247]: DEBUG nova.compute.manager [req-4c6ba28a-bc46-46cc-8962-f3101e7bb074 req-2f476e67-f074-48aa-8c1e-af1ef9c17671 service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Received event network-vif-plugged-2ebee28a-6811-4631-a379-665b2ac7c97b {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:43:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4c6ba28a-bc46-46cc-8962-f3101e7bb074 req-2f476e67-f074-48aa-8c1e-af1ef9c17671 service nova] Acquiring lock "3dfec5ff-83b2-442e-af36-d17e959bf316-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:43:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4c6ba28a-bc46-46cc-8962-f3101e7bb074 req-2f476e67-f074-48aa-8c1e-af1ef9c17671 service nova] Lock "3dfec5ff-83b2-442e-af36-d17e959bf316-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:43:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4c6ba28a-bc46-46cc-8962-f3101e7bb074 req-2f476e67-f074-48aa-8c1e-af1ef9c17671 service nova] Lock "3dfec5ff-83b2-442e-af36-d17e959bf316-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:43:21 user nova-compute[74247]: DEBUG nova.compute.manager [req-4c6ba28a-bc46-46cc-8962-f3101e7bb074 req-2f476e67-f074-48aa-8c1e-af1ef9c17671 service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] No waiting events found dispatching network-vif-plugged-2ebee28a-6811-4631-a379-665b2ac7c97b {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:43:21 user nova-compute[74247]: WARNING nova.compute.manager [req-4c6ba28a-bc46-46cc-8962-f3101e7bb074 req-2f476e67-f074-48aa-8c1e-af1ef9c17671 service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Received unexpected event network-vif-plugged-2ebee28a-6811-4631-a379-665b2ac7c97b for instance with vm_state active and task_state rescuing.
Oct 16 18:43:21 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Searching for a device in session 33 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:43:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JUIbfctP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:43:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:43:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23634383336353435', 'path': '/dev/sdf'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:43:21 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634383336353435', 'path': '/dev/sdf'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:43:21 user nova-compute[74247]: DEBUG nova.objects.instance [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lazy-loading 'flavor' on Instance uuid 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:43:21 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 18:43:21 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:43:21 user nova-compute[74247]:   <source dev="/dev/sdf"/>
Oct 16 18:43:21 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:43:21 user nova-compute[74247]:   <serial>047743e3-3172-45c4-b51f-3b1ed54d9f4b</serial>
Oct 16 18:43:21 user nova-compute[74247]: </disk>
Oct 16 18:43:21 user nova-compute[74247]:  {{(pid=74247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 18:43:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:21 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:43:21 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:43:21 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] No VIF found with MAC fa:16:3e:d7:26:52, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:43:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c587324e-670e-414c-9e7a-e924a68053eb tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.946s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:43:21 user nova-compute[74247]: DEBUG nova.compute.manager [None req-1377883f-36e2-46b8-9beb-2fa6693d0a41 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:43:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-509fcfc0-ada9-4484-b911-3cd4db65856b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Acquiring lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:43:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-509fcfc0-ada9-4484-b911-3cd4db65856b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:43:24 user nova-compute[74247]: INFO nova.compute.manager [None req-509fcfc0-ada9-4484-b911-3cd4db65856b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Detaching volume 047743e3-3172-45c4-b51f-3b1ed54d9f4b
Oct 16 18:43:24 user nova-compute[74247]: INFO nova.virt.block_device [None req-509fcfc0-ada9-4484-b911-3cd4db65856b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Attempting to driver detach volume 047743e3-3172-45c4-b51f-3b1ed54d9f4b from mountpoint /dev/vdb
Oct 16 18:43:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-509fcfc0-ada9-4484-b911-3cd4db65856b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Attempting to detach device vdb from instance 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 from the persistent domain config. {{(pid=74247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 18:43:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-509fcfc0-ada9-4484-b911-3cd4db65856b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 18:43:24 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:43:24 user nova-compute[74247]:   <source dev="/dev/sdf"/>
Oct 16 18:43:24 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:43:24 user nova-compute[74247]:   <serial>047743e3-3172-45c4-b51f-3b1ed54d9f4b</serial>
Oct 16 18:43:24 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 18:43:24 user nova-compute[74247]: </disk>
Oct 16 18:43:24 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:43:24 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-509fcfc0-ada9-4484-b911-3cd4db65856b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Successfully detached device vdb from instance 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 from the persistent domain config.
Oct 16 18:43:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-509fcfc0-ada9-4484-b911-3cd4db65856b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 from the live domain config. {{(pid=74247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 18:43:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-509fcfc0-ada9-4484-b911-3cd4db65856b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 18:43:24 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:43:24 user nova-compute[74247]:   <source dev="/dev/sdf"/>
Oct 16 18:43:24 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:43:24 user nova-compute[74247]:   <serial>047743e3-3172-45c4-b51f-3b1ed54d9f4b</serial>
Oct 16 18:43:24 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 18:43:24 user nova-compute[74247]: </disk>
Oct 16 18:43:24 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:43:25 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-509fcfc0-ada9-4484-b911-3cd4db65856b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 {{(pid=74247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 18:43:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:35 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "88ea9961-7a1d-4193-b72f-63e398752141" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:43:35 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "88ea9961-7a1d-4193-b72f-63e398752141" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:43:35 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "88ea9961-7a1d-4193-b72f-63e398752141-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:43:35 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "88ea9961-7a1d-4193-b72f-63e398752141-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:43:35 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "88ea9961-7a1d-4193-b72f-63e398752141-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:43:35 user nova-compute[74247]: INFO nova.compute.manager [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Terminating instance
Oct 16 18:43:35 user nova-compute[74247]: DEBUG nova.compute.manager [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 18:43:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:36 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Instance destroyed successfully.
Oct 16 18:43:36 user nova-compute[74247]: DEBUG nova.objects.instance [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lazy-loading 'resources' on Instance uuid 88ea9961-7a1d-4193-b72f-63e398752141 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1833793690',display_name='tempest-ServerActionsTestOtherA-server-1833793690',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1833793690',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/sQ/2CMkopvPZot1Iryii0p1Iq3sQgAbR+a1zff3LwsTrC97Bkir58aQPXckuRP2Pk52sgcmyihyOLiY8s4svRhqknfDOoanrdDaAunocHU/6uHElK38rY7fNKG4cJVA==',key_name='tempest-keypair-869426560',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:39:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42bd3eb752f04fd48dfe0623fdf2fe9f',ramdisk_id='',reservation_id='r-b3ywbhfa',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-291765974',owner_user_name='tempest-ServerActionsTestOtherA-291765974-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:40:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3635a30f06234f0d9a8e0604c25f1208',uuid=88ea9961-7a1d-4193-b72f-63e398752141,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5845781-33be-4018-bc2c-72bb980ad8c8", "address": "fa:16:3e:92:70:e9", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5845781-33", "ovs_interfaceid": "f5845781-33be-4018-bc2c-72bb980ad8c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Converting VIF {"id": "f5845781-33be-4018-bc2c-72bb980ad8c8", "address": "fa:16:3e:92:70:e9", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5845781-33", "ovs_interfaceid": "f5845781-33be-4018-bc2c-72bb980ad8c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:70:e9,bridge_name='br-int',has_traffic_filtering=True,id=f5845781-33be-4018-bc2c-72bb980ad8c8,network=Network(0a61bae1-2607-4e42-b573-e74ac3edf09a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5845781-33') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG os_vif [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:70:e9,bridge_name='br-int',has_traffic_filtering=True,id=f5845781-33be-4018-bc2c-72bb980ad8c8,network=Network(0a61bae1-2607-4e42-b573-e74ac3edf09a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5845781-33') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5845781-33, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2e7cd2aa-f091-430c-849e-8b3ba20fb548) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:43:36 user nova-compute[74247]: INFO os_vif [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:70:e9,bridge_name='br-int',has_traffic_filtering=True,id=f5845781-33be-4018-bc2c-72bb980ad8c8,network=Network(0a61bae1-2607-4e42-b573-e74ac3edf09a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5845781-33')
Oct 16 18:43:36 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wXPfgxSi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:43:36 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:43:36 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1795c2-94d8-46ee-8671-93630016c0cf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 18:43:36 user nova-compute[74247]: No targets found.
Oct 16 18:43:36 user nova-compute[74247]: iSNS:
Oct 16 18:43:36 user nova-compute[74247]: No targets found.
Oct 16 18:43:36 user nova-compute[74247]: STATIC:
Oct 16 18:43:36 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27
Oct 16 18:43:36 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:43:36 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:43:36 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa
Oct 16 18:43:36 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:43:36 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:43:36 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b
Oct 16 18:43:36 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:43:36 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:43:36 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc
Oct 16 18:43:36 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:43:36 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:43:36 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f
Oct 16 18:43:36 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:43:36 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:43:36 user nova-compute[74247]: FIRMWARE:
Oct 16 18:43:36 user nova-compute[74247]: No targets found.
Oct 16 18:43:36 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 18:43:36 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 18:43:36 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[afde4823-e16b-482d-8fb8-9cb4590cc1b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c152316a-83fb-446a-be28-de837fdd9ae2]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:43:36 user nova-compute[74247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)
Oct 16 18:43:36 user nova-compute[74247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)
Oct 16 18:43:36 user nova-compute[74247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)
Oct 16 18:43:36 user nova-compute[74247]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b (non-flash)
Oct 16 18:43:36 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:43:36 user nova-compute[74247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa (non-flash)
Oct 16 18:43:36 user nova-compute[74247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)
Oct 16 18:43:36 user nova-compute[74247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)
Oct 16 18:43:36 user nova-compute[74247]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b (non-flash)
Oct 16 18:43:36 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe068211630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa'): ({'sdd'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Removing single pathed devices sdd {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fa69f4-4be4-4cf3-8f3d-063667818e86]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[070e2db6-e6ac-4d55-95e3-746375df0c80]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Flushing IO for device /dev/sdd {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10570df-5bf7-47ed-8044-2ac25c8f494e]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[72edf2ed-a054-4cd2-83e2-6d1552f9fbea]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] SCSI volumes sdd have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_f0fedbe',) {{(pid=85128) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebb9e94-9e4a-44cc-b77a-0deacf0f65de]: (4, None) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 18:43:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:37 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[307aa4d7-34f4-48e2-84e6-1df4d51cc544]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:43:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:37 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[649dd28d-aa2d-4916-9cb1-5190287d1c66]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa, portal: 172.16.0.220,3260]
Oct 16 18:43:37 user nova-compute[74247]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa, portal: 172.16.0.220,3260] successful.
Oct 16 18:43:37 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:43:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fe688e0-e202-4c50-9a51-1fe480c399fa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:37 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb873a75-d952-4e32-b851-65a26db76b6f]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:43:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:43:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] <== disconnect_volume: return (345ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:43:37 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 18:43:37 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Deleting instance files /opt/stack/data/nova/instances/88ea9961-7a1d-4193-b72f-63e398752141_del
Oct 16 18:43:37 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Deletion of /opt/stack/data/nova/instances/88ea9961-7a1d-4193-b72f-63e398752141_del complete
Oct 16 18:43:37 user nova-compute[74247]: DEBUG nova.compute.manager [req-838a0b1e-7c14-425b-9d1c-7bf8ddfa8de5 req-64119ce7-e3e4-4841-a2f8-8582f78273fc service nova] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Received event network-vif-unplugged-f5845781-33be-4018-bc2c-72bb980ad8c8 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:43:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-838a0b1e-7c14-425b-9d1c-7bf8ddfa8de5 req-64119ce7-e3e4-4841-a2f8-8582f78273fc service nova] Acquiring lock "88ea9961-7a1d-4193-b72f-63e398752141-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:43:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-838a0b1e-7c14-425b-9d1c-7bf8ddfa8de5 req-64119ce7-e3e4-4841-a2f8-8582f78273fc service nova] Lock "88ea9961-7a1d-4193-b72f-63e398752141-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:43:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-838a0b1e-7c14-425b-9d1c-7bf8ddfa8de5 req-64119ce7-e3e4-4841-a2f8-8582f78273fc service nova] Lock "88ea9961-7a1d-4193-b72f-63e398752141-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:43:37 user nova-compute[74247]: DEBUG nova.compute.manager [req-838a0b1e-7c14-425b-9d1c-7bf8ddfa8de5 req-64119ce7-e3e4-4841-a2f8-8582f78273fc service nova] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] No waiting events found dispatching network-vif-unplugged-f5845781-33be-4018-bc2c-72bb980ad8c8 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:43:37 user nova-compute[74247]: DEBUG nova.compute.manager [req-838a0b1e-7c14-425b-9d1c-7bf8ddfa8de5 req-64119ce7-e3e4-4841-a2f8-8582f78273fc service nova] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Received event network-vif-unplugged-f5845781-33be-4018-bc2c-72bb980ad8c8 for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:43:37 user nova-compute[74247]: INFO nova.compute.manager [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Took 1.41 seconds to destroy the instance on the hypervisor.
Oct 16 18:43:37 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 18:43:37 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 18:43:37 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 18:43:37 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:43:37 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Took 0.74 seconds to deallocate network for instance.
Oct 16 18:43:37 user nova-compute[74247]: DEBUG nova.compute.manager [req-42681ade-e181-4aed-91cc-8ac824f74ea3 req-ab679a46-4bcd-45cb-b59c-bd39793bc804 service nova] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Received event network-vif-deleted-f5845781-33be-4018-bc2c-72bb980ad8c8 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:43:37 user nova-compute[74247]: INFO nova.compute.manager [req-42681ade-e181-4aed-91cc-8ac824f74ea3 req-ab679a46-4bcd-45cb-b59c-bd39793bc804 service nova] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Neutron deleted interface f5845781-33be-4018-bc2c-72bb980ad8c8; detaching it from the instance and deleting it from the info cache
Oct 16 18:43:37 user nova-compute[74247]: DEBUG nova.network.neutron [req-42681ade-e181-4aed-91cc-8ac824f74ea3 req-ab679a46-4bcd-45cb-b59c-bd39793bc804 service nova] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:43:37 user nova-compute[74247]: DEBUG nova.compute.manager [req-42681ade-e181-4aed-91cc-8ac824f74ea3 req-ab679a46-4bcd-45cb-b59c-bd39793bc804 service nova] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Detach interface failed, port_id=f5845781-33be-4018-bc2c-72bb980ad8c8, reason: Instance 88ea9961-7a1d-4193-b72f-63e398752141 could not be found. {{(pid=74247) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 18:43:38 user nova-compute[74247]: INFO nova.compute.manager [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Took 0.92 seconds to detach 1 volumes for instance.
Oct 16 18:43:38 user nova-compute[74247]: DEBUG nova.compute.manager [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Deleting volume: 6fe688e0-e202-4c50-9a51-1fe480c399fa {{(pid=74247) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 16 18:43:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:43:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:43:39 user nova-compute[74247]: DEBUG nova.compute.manager [req-7102d217-80a9-48d4-b1bf-0970fd23bb9b req-77f73030-f861-4aaf-8eea-7f61d155b7bd service nova] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Received event network-vif-plugged-f5845781-33be-4018-bc2c-72bb980ad8c8 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:43:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7102d217-80a9-48d4-b1bf-0970fd23bb9b req-77f73030-f861-4aaf-8eea-7f61d155b7bd service nova] Acquiring lock "88ea9961-7a1d-4193-b72f-63e398752141-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:43:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7102d217-80a9-48d4-b1bf-0970fd23bb9b req-77f73030-f861-4aaf-8eea-7f61d155b7bd service nova] Lock "88ea9961-7a1d-4193-b72f-63e398752141-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:43:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7102d217-80a9-48d4-b1bf-0970fd23bb9b req-77f73030-f861-4aaf-8eea-7f61d155b7bd service nova] Lock "88ea9961-7a1d-4193-b72f-63e398752141-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:43:39 user nova-compute[74247]: DEBUG nova.compute.manager [req-7102d217-80a9-48d4-b1bf-0970fd23bb9b req-77f73030-f861-4aaf-8eea-7f61d155b7bd service nova] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] No waiting events found dispatching network-vif-plugged-f5845781-33be-4018-bc2c-72bb980ad8c8 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:43:39 user nova-compute[74247]: WARNING nova.compute.manager [req-7102d217-80a9-48d4-b1bf-0970fd23bb9b req-77f73030-f861-4aaf-8eea-7f61d155b7bd service nova] [instance: 88ea9961-7a1d-4193-b72f-63e398752141] Received unexpected event network-vif-plugged-f5845781-33be-4018-bc2c-72bb980ad8c8 for instance with vm_state deleted and task_state None.
Oct 16 18:43:39 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:43:39 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:43:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:43:39 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Deleted allocations for instance 88ea9961-7a1d-4193-b72f-63e398752141
Oct 16 18:43:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c0df5e50-d315-4442-8542-658432bee3e3 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "88ea9961-7a1d-4193-b72f-63e398752141" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.677s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:43:40 user nova-compute[74247]: DEBUG nova.compute.manager [req-0b970448-f8c5-4792-8559-30d0a69ebd49 req-66fa26c0-3b82-4f39-8f05-c98b49a7590d service nova] [instance: 61819735-95a5-4543-915d-bd50c671002b] Received event network-changed-02f2319c-e3f4-48f2-98e7-0b97b42da9c0 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:43:40 user nova-compute[74247]: DEBUG nova.compute.manager [req-0b970448-f8c5-4792-8559-30d0a69ebd49 req-66fa26c0-3b82-4f39-8f05-c98b49a7590d service nova] [instance: 61819735-95a5-4543-915d-bd50c671002b] Refreshing instance network info cache due to event network-changed-02f2319c-e3f4-48f2-98e7-0b97b42da9c0. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:43:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0b970448-f8c5-4792-8559-30d0a69ebd49 req-66fa26c0-3b82-4f39-8f05-c98b49a7590d service nova] Acquiring lock "refresh_cache-61819735-95a5-4543-915d-bd50c671002b" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:43:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0b970448-f8c5-4792-8559-30d0a69ebd49 req-66fa26c0-3b82-4f39-8f05-c98b49a7590d service nova] Acquired lock "refresh_cache-61819735-95a5-4543-915d-bd50c671002b" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:43:40 user nova-compute[74247]: DEBUG nova.network.neutron [req-0b970448-f8c5-4792-8559-30d0a69ebd49 req-66fa26c0-3b82-4f39-8f05-c98b49a7590d service nova] [instance: 61819735-95a5-4543-915d-bd50c671002b] Refreshing network info cache for port 02f2319c-e3f4-48f2-98e7-0b97b42da9c0 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:43:40 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:40 user nova-compute[74247]: DEBUG nova.network.neutron [req-0b970448-f8c5-4792-8559-30d0a69ebd49 req-66fa26c0-3b82-4f39-8f05-c98b49a7590d service nova] [instance: 61819735-95a5-4543-915d-bd50c671002b] Updated VIF entry in instance network info cache for port 02f2319c-e3f4-48f2-98e7-0b97b42da9c0. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:43:40 user nova-compute[74247]: DEBUG nova.network.neutron [req-0b970448-f8c5-4792-8559-30d0a69ebd49 req-66fa26c0-3b82-4f39-8f05-c98b49a7590d service nova] [instance: 61819735-95a5-4543-915d-bd50c671002b] Updating instance_info_cache with network_info: [{"id": "02f2319c-e3f4-48f2-98e7-0b97b42da9c0", "address": "fa:16:3e:c0:62:93", "network": {"id": "fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1988491128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96ced9d4c0c474fbc7edeed6f73324a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02f2319c-e3", "ovs_interfaceid": "02f2319c-e3f4-48f2-98e7-0b97b42da9c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:43:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0b970448-f8c5-4792-8559-30d0a69ebd49 req-66fa26c0-3b82-4f39-8f05-c98b49a7590d service nova] Releasing lock "refresh_cache-61819735-95a5-4543-915d-bd50c671002b" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:43:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:43 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:45 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-509fcfc0-ada9-4484-b911-3cd4db65856b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 is timed out.
Oct 16 18:43:45 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-509fcfc0-ada9-4484-b911-3cd4db65856b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Successfully detached device vdb from instance 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 from the live domain config.
Oct 16 18:43:45 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-509fcfc0-ada9-4484-b911-3cd4db65856b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-509fcfc0-ada9-4484-b911-3cd4db65856b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JUIbfctP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:43:45 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-509fcfc0-ada9-4484-b911-3cd4db65856b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:43:45 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-509fcfc0-ada9-4484-b911-3cd4db65856b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-509fcfc0-ada9-4484-b911-3cd4db65856b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3790b702-4305-463f-9588-c70085bed1fd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-509fcfc0-ada9-4484-b911-3cd4db65856b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 18:43:45 user nova-compute[74247]: No targets found.
Oct 16 18:43:45 user nova-compute[74247]: iSNS:
Oct 16 18:43:45 user nova-compute[74247]: No targets found.
Oct 16 18:43:45 user nova-compute[74247]: STATIC:
Oct 16 18:43:45 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27
Oct 16 18:43:45 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:43:45 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:43:45 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b
Oct 16 18:43:45 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:43:45 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:43:45 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc
Oct 16 18:43:45 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:43:45 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:43:45 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f
Oct 16 18:43:45 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:43:45 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:43:45 user nova-compute[74247]: FIRMWARE:
Oct 16 18:43:45 user nova-compute[74247]: No targets found.
Oct 16 18:43:45 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-509fcfc0-ada9-4484-b911-3cd4db65856b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 18:43:45 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 18:43:45 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-509fcfc0-ada9-4484-b911-3cd4db65856b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2faf23-8b28-41dc-8f55-0f6e36aa206b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e7b094-c424-42f7-a86d-de9de8b79c3f]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-509fcfc0-ada9-4484-b911-3cd4db65856b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:43:45 user nova-compute[74247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)
Oct 16 18:43:45 user nova-compute[74247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)
Oct 16 18:43:45 user nova-compute[74247]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b (non-flash)
Oct 16 18:43:45 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-509fcfc0-ada9-4484-b911-3cd4db65856b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:43:45 user nova-compute[74247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)
Oct 16 18:43:45 user nova-compute[74247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)
Oct 16 18:43:45 user nova-compute[74247]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b (non-flash)
Oct 16 18:43:45 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-509fcfc0-ada9-4484-b911-3cd4db65856b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe048471480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b'): ({'sdf'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-509fcfc0-ada9-4484-b911-3cd4db65856b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Removing single pathed devices sdf {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[34782154-d4b3-4e1b-b006-f3d901bffb66]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ace457e-15ea-4118-a0b3-432a99743366]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-509fcfc0-ada9-4484-b911-3cd4db65856b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Flushing IO for device /dev/sdf {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0af39e-b839-406c-a65e-a52bc720733d]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-509fcfc0-ada9-4484-b911-3cd4db65856b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ad61c8-b5a5-472a-8d5d-b92378e5c591]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-509fcfc0-ada9-4484-b911-3cd4db65856b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-509fcfc0-ada9-4484-b911-3cd4db65856b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] SCSI volumes sdf have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-509fcfc0-ada9-4484-b911-3cd4db65856b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "61819735-95a5-4543-915d-bd50c671002b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "61819735-95a5-4543-915d-bd50c671002b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04309d8-df17-465c-966e-20c77b3635ef]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-509fcfc0-ada9-4484-b911-3cd4db65856b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG nova.objects.instance [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lazy-loading 'flavor' on Instance uuid 61819735-95a5-4543-915d-bd50c671002b {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "61819735-95a5-4543-915d-bd50c671002b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[692ccc27-26ad-4a26-9b2a-b6f9e3ff6e47]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-509fcfc0-ada9-4484-b911-3cd4db65856b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b, portal: 172.16.0.220,3260]
Oct 16 18:43:45 user nova-compute[74247]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b, portal: 172.16.0.220,3260] successful.
Oct 16 18:43:45 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:047743e3-3172-45c4-b51f-3b1ed54d9f4b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9622c569-069d-4b76-b518-c7240b32a9d5]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-509fcfc0-ada9-4484-b911-3cd4db65856b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-509fcfc0-ada9-4484-b911-3cd4db65856b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-509fcfc0-ada9-4484-b911-3cd4db65856b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] <== disconnect_volume: return (356ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-509fcfc0-ada9-4484-b911-3cd4db65856b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "61819735-95a5-4543-915d-bd50c671002b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "61819735-95a5-4543-915d-bd50c671002b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:43:45 user nova-compute[74247]: INFO nova.compute.manager [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: 61819735-95a5-4543-915d-bd50c671002b] Attaching volume 3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1 to /dev/vdb
Oct 16 18:43:45 user nova-compute[74247]: DEBUG os_brick.utils [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0bdea6-dd14-455c-853a-accf693c440e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b107acf6-a49f-4a4f-aa92-006057b32c93]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8960c8-a9c8-4706-9bbd-979154f24a55]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc7cf10-f522-46fc-a7f8-5279d4e7bad2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:43:45 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 18:43:45 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[54db2712-b40c-42e0-8b03-ccfbd2187957]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG os_brick.utils [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:43:45 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: 61819735-95a5-4543-915d-bd50c671002b] Updating existing volume attachment record: b3eaf21f-e737-4abf-a7b0-f73708c55b71 {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 18:43:46 user nova-compute[74247]: DEBUG nova.objects.instance [None req-509fcfc0-ada9-4484-b911-3cd4db65856b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lazy-loading 'flavor' on Instance uuid 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:43:46 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-509fcfc0-ada9-4484-b911-3cd4db65856b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.878s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:43:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Acquiring lock "0dfd28a0-528c-434a-8850-aa7d29c1e738" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:43:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Lock "0dfd28a0-528c-434a-8850-aa7d29c1e738" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:43:46 user nova-compute[74247]: DEBUG nova.compute.manager [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 18:43:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:43:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:43:46 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:43:46 user nova-compute[74247]: INFO nova.compute.claims [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Claim successful on node user
Oct 16 18:43:46 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:47 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:43:47 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:43:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.438s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:43:47 user nova-compute[74247]: DEBUG nova.compute.manager [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 18:43:47 user nova-compute[74247]: DEBUG nova.compute.manager [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 18:43:47 user nova-compute[74247]: DEBUG nova.network.neutron [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 18:43:47 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 18:43:47 user nova-compute[74247]: DEBUG nova.compute.manager [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 18:43:47 user nova-compute[74247]: DEBUG nova.policy [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e493a201e17747cc907b2cdb0d22246f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e98ba2d44d0c401cb6a51f3d7ea3db59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 18:43:47 user nova-compute[74247]: DEBUG nova.compute.manager [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 18:43:47 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:43:47 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Creating image(s)
Oct 16 18:43:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Acquiring lock "/opt/stack/data/nova/instances/0dfd28a0-528c-434a-8850-aa7d29c1e738/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:43:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Lock "/opt/stack/data/nova/instances/0dfd28a0-528c-434a-8850-aa7d29c1e738/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:43:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Lock "/opt/stack/data/nova/instances/0dfd28a0-528c-434a-8850-aa7d29c1e738/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:43:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.176s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Acquiring lock "37399febbd18f60b85fd0f833558f6a3539ab231" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:43:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:43:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.221s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/0dfd28a0-528c-434a-8850-aa7d29c1e738/disk 1073741824 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/0dfd28a0-528c-434a-8850-aa7d29c1e738/disk 1073741824" returned: 0 in 0.047s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:43:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:48 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.172s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:48 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0dfd28a0-528c-434a-8850-aa7d29c1e738/disk. size=1073741824 {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 18:43:48 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfd28a0-528c-434a-8850-aa7d29c1e738/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:43:48 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfd28a0-528c-434a-8850-aa7d29c1e738/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:43:48 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Cannot resize image /opt/stack/data/nova/instances/0dfd28a0-528c-434a-8850-aa7d29c1e738/disk to a smaller size. {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 18:43:48 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 18:43:48 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Ensure instance console log exists: /opt/stack/data/nova/instances/0dfd28a0-528c-434a-8850-aa7d29c1e738/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:43:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:43:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:43:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:43:48 user nova-compute[74247]: DEBUG nova.network.neutron [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Successfully created port: 88e3804c-7596-4dd5-b478-fda70e1f9ebb {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG nova.network.neutron [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Successfully updated port: 88e3804c-7596-4dd5-b478-fda70e1f9ebb {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Acquiring lock "refresh_cache-0dfd28a0-528c-434a-8850-aa7d29c1e738" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Acquired lock "refresh_cache-0dfd28a0-528c-434a-8850-aa7d29c1e738" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG nova.network.neutron [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG nova.compute.manager [req-48af51a4-aca4-4f59-a5dd-862c9396cf6c req-8172860f-9eda-465a-b0c7-7d7396fb0c16 service nova] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Received event network-changed-88e3804c-7596-4dd5-b478-fda70e1f9ebb {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG nova.compute.manager [req-48af51a4-aca4-4f59-a5dd-862c9396cf6c req-8172860f-9eda-465a-b0c7-7d7396fb0c16 service nova] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Refreshing instance network info cache due to event network-changed-88e3804c-7596-4dd5-b478-fda70e1f9ebb. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-48af51a4-aca4-4f59-a5dd-862c9396cf6c req-8172860f-9eda-465a-b0c7-7d7396fb0c16 service nova] Acquiring lock "refresh_cache-0dfd28a0-528c-434a-8850-aa7d29c1e738" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG nova.network.neutron [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG nova.network.neutron [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Updating instance_info_cache with network_info: [{"id": "88e3804c-7596-4dd5-b478-fda70e1f9ebb", "address": "fa:16:3e:cd:31:0f", "network": {"id": "12aae3c0-8171-4d91-a65c-d823d49c6d8c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1631066218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e98ba2d44d0c401cb6a51f3d7ea3db59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88e3804c-75", "ovs_interfaceid": "88e3804c-7596-4dd5-b478-fda70e1f9ebb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Releasing lock "refresh_cache-0dfd28a0-528c-434a-8850-aa7d29c1e738" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG nova.compute.manager [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Instance network_info: |[{"id": "88e3804c-7596-4dd5-b478-fda70e1f9ebb", "address": "fa:16:3e:cd:31:0f", "network": {"id": "12aae3c0-8171-4d91-a65c-d823d49c6d8c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1631066218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e98ba2d44d0c401cb6a51f3d7ea3db59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88e3804c-75", "ovs_interfaceid": "88e3804c-7596-4dd5-b478-fda70e1f9ebb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-48af51a4-aca4-4f59-a5dd-862c9396cf6c req-8172860f-9eda-465a-b0c7-7d7396fb0c16 service nova] Acquired lock "refresh_cache-0dfd28a0-528c-434a-8850-aa7d29c1e738" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG nova.network.neutron [req-48af51a4-aca4-4f59-a5dd-862c9396cf6c req-8172860f-9eda-465a-b0c7-7d7396fb0c16 service nova] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Refreshing network info cache for port 88e3804c-7596-4dd5-b478-fda70e1f9ebb {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Start _get_guest_xml network_info=[{"id": "88e3804c-7596-4dd5-b478-fda70e1f9ebb", "address": "fa:16:3e:cd:31:0f", "network": {"id": "12aae3c0-8171-4d91-a65c-d823d49c6d8c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1631066218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e98ba2d44d0c401cb6a51f3d7ea3db59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88e3804c-75", "ovs_interfaceid": "88e3804c-7596-4dd5-b478-fda70e1f9ebb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': '83126bb1-29f5-42fe-8620-72ab0797f776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:43:49 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:43:49 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:43:49 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:43:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-792500812',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-792500812',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7925008',id=33,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlV1V84aagvEuTKJxNl6gNXm4LitBUnA/wcqb2iO6VgGSsXwsK48WqLiwEUw7iYWDgfusstJQ3SE6X9RMvxc++BDSZlOto/yGhT9dG7qUxCWbJdM0dZUlba2uaGqrP0bQ==',key_name='tempest-keypair-1460952140',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e98ba2d44d0c401cb6a51f3d7ea3db59',ramdisk_id='',reservation_id='r-86q4j8o1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-535182982',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:43:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e493a201e17747cc907b2cdb0d22246f',uuid=0dfd28a0-528c-434a-8850-aa7d29c1e738,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88e3804c-7596-4dd5-b478-fda70e1f9ebb", "address": "fa:16:3e:cd:31:0f", "network": {"id": "12aae3c0-8171-4d91-a65c-d823d49c6d8c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1631066218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e98ba2d44d0c401cb6a51f3d7ea3db59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88e3804c-75", "ovs_interfaceid": "88e3804c-7596-4dd5-b478-fda70e1f9ebb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Converting VIF {"id": "88e3804c-7596-4dd5-b478-fda70e1f9ebb", "address": "fa:16:3e:cd:31:0f", "network": {"id": "12aae3c0-8171-4d91-a65c-d823d49c6d8c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1631066218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e98ba2d44d0c401cb6a51f3d7ea3db59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88e3804c-75", "ovs_interfaceid": "88e3804c-7596-4dd5-b478-fda70e1f9ebb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:31:0f,bridge_name='br-int',has_traffic_filtering=True,id=88e3804c-7596-4dd5-b478-fda70e1f9ebb,network=Network(12aae3c0-8171-4d91-a65c-d823d49c6d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88e3804c-75') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG nova.objects.instance [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Lazy-loading 'pci_devices' on Instance uuid 0dfd28a0-528c-434a-8850-aa7d29c1e738 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:43:49 user nova-compute[74247]:   <uuid>0dfd28a0-528c-434a-8850-aa7d29c1e738</uuid>
Oct 16 18:43:49 user nova-compute[74247]:   <name>instance-00000021</name>
Oct 16 18:43:49 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:43:49 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:43:49 user nova-compute[74247]:   <metadata>
Oct 16 18:43:49 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:43:49 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:43:49 user nova-compute[74247]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-792500812</nova:name>
Oct 16 18:43:49 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:43:49</nova:creationTime>
Oct 16 18:43:49 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:43:49 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:43:49 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:43:49 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:43:49 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:43:49 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:43:49 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:43:49 user nova-compute[74247]:       <nova:owner>
Oct 16 18:43:49 user nova-compute[74247]:         <nova:user uuid="e493a201e17747cc907b2cdb0d22246f">tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member</nova:user>
Oct 16 18:43:49 user nova-compute[74247]:         <nova:project uuid="e98ba2d44d0c401cb6a51f3d7ea3db59">tempest-TestServerVolumeAttachScenarioOldVersion-535182982</nova:project>
Oct 16 18:43:49 user nova-compute[74247]:       </nova:owner>
Oct 16 18:43:49 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:43:49 user nova-compute[74247]:       <nova:ports>
Oct 16 18:43:49 user nova-compute[74247]:         <nova:port uuid="88e3804c-7596-4dd5-b478-fda70e1f9ebb">
Oct 16 18:43:49 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 16 18:43:49 user nova-compute[74247]:         </nova:port>
Oct 16 18:43:49 user nova-compute[74247]:       </nova:ports>
Oct 16 18:43:49 user nova-compute[74247]:     </nova:instance>
Oct 16 18:43:49 user nova-compute[74247]:   </metadata>
Oct 16 18:43:49 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:43:49 user nova-compute[74247]:     <system>
Oct 16 18:43:49 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:43:49 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:43:49 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:43:49 user nova-compute[74247]:       <entry name="serial">0dfd28a0-528c-434a-8850-aa7d29c1e738</entry>
Oct 16 18:43:49 user nova-compute[74247]:       <entry name="uuid">0dfd28a0-528c-434a-8850-aa7d29c1e738</entry>
Oct 16 18:43:49 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:43:49 user nova-compute[74247]:     </system>
Oct 16 18:43:49 user nova-compute[74247]:   </sysinfo>
Oct 16 18:43:49 user nova-compute[74247]:   <os>
Oct 16 18:43:49 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:43:49 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:43:49 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:43:49 user nova-compute[74247]:   </os>
Oct 16 18:43:49 user nova-compute[74247]:   <features>
Oct 16 18:43:49 user nova-compute[74247]:     <acpi/>
Oct 16 18:43:49 user nova-compute[74247]:     <apic/>
Oct 16 18:43:49 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:43:49 user nova-compute[74247]:   </features>
Oct 16 18:43:49 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:43:49 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:43:49 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:43:49 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:43:49 user nova-compute[74247]:   </clock>
Oct 16 18:43:49 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:43:49 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:43:49 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:43:49 user nova-compute[74247]:   </cpu>
Oct 16 18:43:49 user nova-compute[74247]:   <devices>
Oct 16 18:43:49 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:43:49 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:43:49 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/0dfd28a0-528c-434a-8850-aa7d29c1e738/disk"/>
Oct 16 18:43:49 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:43:49 user nova-compute[74247]:     </disk>
Oct 16 18:43:49 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:43:49 user nova-compute[74247]:       <mac address="fa:16:3e:cd:31:0f"/>
Oct 16 18:43:49 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:43:49 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:43:49 user nova-compute[74247]:       <target dev="tap88e3804c-75"/>
Oct 16 18:43:49 user nova-compute[74247]:     </interface>
Oct 16 18:43:49 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:43:49 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/0dfd28a0-528c-434a-8850-aa7d29c1e738/console.log" append="off"/>
Oct 16 18:43:49 user nova-compute[74247]:     </serial>
Oct 16 18:43:49 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:43:49 user nova-compute[74247]:     <video>
Oct 16 18:43:49 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:43:49 user nova-compute[74247]:     </video>
Oct 16 18:43:49 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:43:49 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:43:49 user nova-compute[74247]:     </rng>
Oct 16 18:43:49 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:43:49 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:43:49 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:43:49 user nova-compute[74247]:     </memballoon>
Oct 16 18:43:49 user nova-compute[74247]:   </devices>
Oct 16 18:43:49 user nova-compute[74247]: </domain>
Oct 16 18:43:49 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:43:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-792500812',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-792500812',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7925008',id=33,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlV1V84aagvEuTKJxNl6gNXm4LitBUnA/wcqb2iO6VgGSsXwsK48WqLiwEUw7iYWDgfusstJQ3SE6X9RMvxc++BDSZlOto/yGhT9dG7qUxCWbJdM0dZUlba2uaGqrP0bQ==',key_name='tempest-keypair-1460952140',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e98ba2d44d0c401cb6a51f3d7ea3db59',ramdisk_id='',reservation_id='r-86q4j8o1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-535182982',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:43:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e493a201e17747cc907b2cdb0d22246f',uuid=0dfd28a0-528c-434a-8850-aa7d29c1e738,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88e3804c-7596-4dd5-b478-fda70e1f9ebb", "address": "fa:16:3e:cd:31:0f", "network": {"id": "12aae3c0-8171-4d91-a65c-d823d49c6d8c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1631066218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e98ba2d44d0c401cb6a51f3d7ea3db59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88e3804c-75", "ovs_interfaceid": "88e3804c-7596-4dd5-b478-fda70e1f9ebb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Converting VIF {"id": "88e3804c-7596-4dd5-b478-fda70e1f9ebb", "address": "fa:16:3e:cd:31:0f", "network": {"id": "12aae3c0-8171-4d91-a65c-d823d49c6d8c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1631066218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e98ba2d44d0c401cb6a51f3d7ea3db59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88e3804c-75", "ovs_interfaceid": "88e3804c-7596-4dd5-b478-fda70e1f9ebb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:31:0f,bridge_name='br-int',has_traffic_filtering=True,id=88e3804c-7596-4dd5-b478-fda70e1f9ebb,network=Network(12aae3c0-8171-4d91-a65c-d823d49c6d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88e3804c-75') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG os_vif [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:31:0f,bridge_name='br-int',has_traffic_filtering=True,id=88e3804c-7596-4dd5-b478-fda70e1f9ebb,network=Network(12aae3c0-8171-4d91-a65c-d823d49c6d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88e3804c-75') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '55f05740-8450-59c0-a024-0c7fe83759a7', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap88e3804c-75, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap88e3804c-75, col_values=(('qos', UUID('f2ea8b54-c4e1-4290-a3b7-b80f6b15a0a5')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap88e3804c-75, col_values=(('external_ids', {'iface-id': '88e3804c-7596-4dd5-b478-fda70e1f9ebb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:31:0f', 'vm-uuid': '0dfd28a0-528c-434a-8850-aa7d29c1e738'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:49 user nova-compute[74247]: INFO os_vif [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:31:0f,bridge_name='br-int',has_traffic_filtering=True,id=88e3804c-7596-4dd5-b478-fda70e1f9ebb,network=Network(12aae3c0-8171-4d91-a65c-d823d49c6d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88e3804c-75')
Oct 16 18:43:49 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] No VIF found with MAC fa:16:3e:cd:31:0f, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG nova.network.neutron [req-48af51a4-aca4-4f59-a5dd-862c9396cf6c req-8172860f-9eda-465a-b0c7-7d7396fb0c16 service nova] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Updated VIF entry in instance network info cache for port 88e3804c-7596-4dd5-b478-fda70e1f9ebb. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:43:49 user nova-compute[74247]: DEBUG nova.network.neutron [req-48af51a4-aca4-4f59-a5dd-862c9396cf6c req-8172860f-9eda-465a-b0c7-7d7396fb0c16 service nova] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Updating instance_info_cache with network_info: [{"id": "88e3804c-7596-4dd5-b478-fda70e1f9ebb", "address": "fa:16:3e:cd:31:0f", "network": {"id": "12aae3c0-8171-4d91-a65c-d823d49c6d8c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1631066218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e98ba2d44d0c401cb6a51f3d7ea3db59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88e3804c-75", "ovs_interfaceid": "88e3804c-7596-4dd5-b478-fda70e1f9ebb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:43:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-48af51a4-aca4-4f59-a5dd-862c9396cf6c req-8172860f-9eda-465a-b0c7-7d7396fb0c16 service nova] Releasing lock "refresh_cache-0dfd28a0-528c-434a-8850-aa7d29c1e738" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:43:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:51 user nova-compute[74247]: DEBUG nova.compute.manager [req-e2669e78-92e5-4b64-b451-bf52ac256b1f req-fcbde828-41b0-4adc-a871-097bb27c5150 service nova] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Received event network-vif-plugged-88e3804c-7596-4dd5-b478-fda70e1f9ebb {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:43:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e2669e78-92e5-4b64-b451-bf52ac256b1f req-fcbde828-41b0-4adc-a871-097bb27c5150 service nova] Acquiring lock "0dfd28a0-528c-434a-8850-aa7d29c1e738-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:43:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e2669e78-92e5-4b64-b451-bf52ac256b1f req-fcbde828-41b0-4adc-a871-097bb27c5150 service nova] Lock "0dfd28a0-528c-434a-8850-aa7d29c1e738-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:43:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e2669e78-92e5-4b64-b451-bf52ac256b1f req-fcbde828-41b0-4adc-a871-097bb27c5150 service nova] Lock "0dfd28a0-528c-434a-8850-aa7d29c1e738-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:43:51 user nova-compute[74247]: DEBUG nova.compute.manager [req-e2669e78-92e5-4b64-b451-bf52ac256b1f req-fcbde828-41b0-4adc-a871-097bb27c5150 service nova] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] No waiting events found dispatching network-vif-plugged-88e3804c-7596-4dd5-b478-fda70e1f9ebb {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:43:51 user nova-compute[74247]: WARNING nova.compute.manager [req-e2669e78-92e5-4b64-b451-bf52ac256b1f req-fcbde828-41b0-4adc-a871-097bb27c5150 service nova] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Received unexpected event network-vif-plugged-88e3804c-7596-4dd5-b478-fda70e1f9ebb for instance with vm_state building and task_state spawning.
Oct 16 18:43:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:53 user nova-compute[74247]: DEBUG nova.compute.manager [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:43:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:43:53 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Instance spawned successfully.
Oct 16 18:43:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 18:43:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:43:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:43:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:43:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:43:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:43:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:43:53 user nova-compute[74247]: DEBUG nova.compute.manager [req-268e469d-ca99-4a8c-8718-beae0a43e49b req-f3d378df-5612-443a-ab81-f2daeb8decee service nova] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Received event network-vif-plugged-88e3804c-7596-4dd5-b478-fda70e1f9ebb {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:43:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-268e469d-ca99-4a8c-8718-beae0a43e49b req-f3d378df-5612-443a-ab81-f2daeb8decee service nova] Acquiring lock "0dfd28a0-528c-434a-8850-aa7d29c1e738-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:43:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-268e469d-ca99-4a8c-8718-beae0a43e49b req-f3d378df-5612-443a-ab81-f2daeb8decee service nova] Lock "0dfd28a0-528c-434a-8850-aa7d29c1e738-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:43:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-268e469d-ca99-4a8c-8718-beae0a43e49b req-f3d378df-5612-443a-ab81-f2daeb8decee service nova] Lock "0dfd28a0-528c-434a-8850-aa7d29c1e738-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:43:53 user nova-compute[74247]: DEBUG nova.compute.manager [req-268e469d-ca99-4a8c-8718-beae0a43e49b req-f3d378df-5612-443a-ab81-f2daeb8decee service nova] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] No waiting events found dispatching network-vif-plugged-88e3804c-7596-4dd5-b478-fda70e1f9ebb {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:43:53 user nova-compute[74247]: WARNING nova.compute.manager [req-268e469d-ca99-4a8c-8718-beae0a43e49b req-f3d378df-5612-443a-ab81-f2daeb8decee service nova] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Received unexpected event network-vif-plugged-88e3804c-7596-4dd5-b478-fda70e1f9ebb for instance with vm_state building and task_state spawning.
Oct 16 18:43:53 user nova-compute[74247]: INFO nova.compute.manager [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Took 5.89 seconds to spawn the instance on the hypervisor.
Oct 16 18:43:53 user nova-compute[74247]: DEBUG nova.compute.manager [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:43:53 user nova-compute[74247]: INFO nova.compute.manager [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Took 6.68 seconds to build instance.
Oct 16 18:43:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c0a5f49b-546e-489b-b439-fefa17cd4eca tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Lock "0dfd28a0-528c-434a-8850-aa7d29c1e738" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.796s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:43:54 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquiring lock "075e943e-8f32-4be9-8d02-30584668c34b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:43:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "075e943e-8f32-4be9-8d02-30584668c34b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:43:59 user nova-compute[74247]: DEBUG nova.compute.manager [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 18:43:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:43:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:43:59 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:43:59 user nova-compute[74247]: INFO nova.compute.claims [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Claim successful on node user
Oct 16 18:43:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:43:59 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:43:59 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:43:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.456s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:43:59 user nova-compute[74247]: DEBUG nova.compute.manager [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 18:44:00 user nova-compute[74247]: DEBUG nova.compute.manager [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 18:44:00 user nova-compute[74247]: DEBUG nova.network.neutron [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 18:44:00 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 18:44:00 user nova-compute[74247]: DEBUG nova.compute.manager [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 18:44:00 user nova-compute[74247]: DEBUG nova.policy [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2bda4c43b45347be96b152caba47b07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5204c1aec5764c298a206429645eb268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 18:44:00 user nova-compute[74247]: DEBUG nova.compute.manager [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 18:44:00 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:44:00 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Creating image(s)
Oct 16 18:44:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquiring lock "/opt/stack/data/nova/instances/075e943e-8f32-4be9-8d02-30584668c34b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:44:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "/opt/stack/data/nova/instances/075e943e-8f32-4be9-8d02-30584668c34b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:44:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "/opt/stack/data/nova/instances/075e943e-8f32-4be9-8d02-30584668c34b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:44:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.176s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquiring lock "37399febbd18f60b85fd0f833558f6a3539ab231" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:44:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:44:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.182s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/075e943e-8f32-4be9-8d02-30584668c34b/disk 1073741824 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/075e943e-8f32-4be9-8d02-30584668c34b/disk 1073741824" returned: 0 in 0.047s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:44:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:00 user nova-compute[74247]: DEBUG nova.network.neutron [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Successfully created port: 5297bf76-2e6f-4240-819b-12b1594b0fe2 {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:44:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.185s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:00 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Checking if we can resize image /opt/stack/data/nova/instances/075e943e-8f32-4be9-8d02-30584668c34b/disk. size=1073741824 {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 18:44:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075e943e-8f32-4be9-8d02-30584668c34b/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075e943e-8f32-4be9-8d02-30584668c34b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:00 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Cannot resize image /opt/stack/data/nova/instances/075e943e-8f32-4be9-8d02-30584668c34b/disk to a smaller size. {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 18:44:00 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 18:44:00 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Ensure instance console log exists: /opt/stack/data/nova/instances/075e943e-8f32-4be9-8d02-30584668c34b/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:44:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:44:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:44:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG nova.network.neutron [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Successfully updated port: 5297bf76-2e6f-4240-819b-12b1594b0fe2 {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquiring lock "refresh_cache-075e943e-8f32-4be9-8d02-30584668c34b" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquired lock "refresh_cache-075e943e-8f32-4be9-8d02-30584668c34b" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG nova.network.neutron [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG nova.compute.manager [req-4af437eb-216c-4457-be82-966b198731e5 req-354fd9ac-2d93-43a0-a844-4d8c8a5826b6 service nova] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Received event network-changed-5297bf76-2e6f-4240-819b-12b1594b0fe2 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG nova.compute.manager [req-4af437eb-216c-4457-be82-966b198731e5 req-354fd9ac-2d93-43a0-a844-4d8c8a5826b6 service nova] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Refreshing instance network info cache due to event network-changed-5297bf76-2e6f-4240-819b-12b1594b0fe2. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4af437eb-216c-4457-be82-966b198731e5 req-354fd9ac-2d93-43a0-a844-4d8c8a5826b6 service nova] Acquiring lock "refresh_cache-075e943e-8f32-4be9-8d02-30584668c34b" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG nova.network.neutron [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG nova.network.neutron [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Updating instance_info_cache with network_info: [{"id": "5297bf76-2e6f-4240-819b-12b1594b0fe2", "address": "fa:16:3e:fd:a6:1e", "network": {"id": "88a1b265-5360-4362-90bc-3506f805688f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-620663417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5204c1aec5764c298a206429645eb268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5297bf76-2e", "ovs_interfaceid": "5297bf76-2e6f-4240-819b-12b1594b0fe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Releasing lock "refresh_cache-075e943e-8f32-4be9-8d02-30584668c34b" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG nova.compute.manager [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Instance network_info: |[{"id": "5297bf76-2e6f-4240-819b-12b1594b0fe2", "address": "fa:16:3e:fd:a6:1e", "network": {"id": "88a1b265-5360-4362-90bc-3506f805688f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-620663417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5204c1aec5764c298a206429645eb268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5297bf76-2e", "ovs_interfaceid": "5297bf76-2e6f-4240-819b-12b1594b0fe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4af437eb-216c-4457-be82-966b198731e5 req-354fd9ac-2d93-43a0-a844-4d8c8a5826b6 service nova] Acquired lock "refresh_cache-075e943e-8f32-4be9-8d02-30584668c34b" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG nova.network.neutron [req-4af437eb-216c-4457-be82-966b198731e5 req-354fd9ac-2d93-43a0-a844-4d8c8a5826b6 service nova] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Refreshing network info cache for port 5297bf76-2e6f-4240-819b-12b1594b0fe2 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Start _get_guest_xml network_info=[{"id": "5297bf76-2e6f-4240-819b-12b1594b0fe2", "address": "fa:16:3e:fd:a6:1e", "network": {"id": "88a1b265-5360-4362-90bc-3506f805688f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-620663417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5204c1aec5764c298a206429645eb268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5297bf76-2e", "ovs_interfaceid": "5297bf76-2e6f-4240-819b-12b1594b0fe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': '83126bb1-29f5-42fe-8620-72ab0797f776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:44:01 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:44:01 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:44:01 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:43:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-246997190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-246997190',id=34,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIhrr+elGpfgxpvDxCYEg3TwFRm9479AxAze0wrEYlT36ZJD5juZ2Mgda1vXnfPW9D0eHXznG5lqW6nzlxRtDM9vSOVC+rVIUMbi26juPUHNHhtCjNg+9DevghtLuUxhQ==',key_name='tempest-keypair-873631301',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5204c1aec5764c298a206429645eb268',ramdisk_id='',reservation_id='r-7whme9zu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-537076068',owner_user_name='tempest-AttachVolumeShelveTestJSON-537076068-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:44:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bda4c43b45347be96b152caba47b07d',uuid=075e943e-8f32-4be9-8d02-30584668c34b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5297bf76-2e6f-4240-819b-12b1594b0fe2", "address": "fa:16:3e:fd:a6:1e", "network": {"id": "88a1b265-5360-4362-90bc-3506f805688f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-620663417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5204c1aec5764c298a206429645eb268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5297bf76-2e", "ovs_interfaceid": "5297bf76-2e6f-4240-819b-12b1594b0fe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Converting VIF {"id": "5297bf76-2e6f-4240-819b-12b1594b0fe2", "address": "fa:16:3e:fd:a6:1e", "network": {"id": "88a1b265-5360-4362-90bc-3506f805688f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-620663417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5204c1aec5764c298a206429645eb268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5297bf76-2e", "ovs_interfaceid": "5297bf76-2e6f-4240-819b-12b1594b0fe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:a6:1e,bridge_name='br-int',has_traffic_filtering=True,id=5297bf76-2e6f-4240-819b-12b1594b0fe2,network=Network(88a1b265-5360-4362-90bc-3506f805688f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5297bf76-2e') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG nova.objects.instance [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lazy-loading 'pci_devices' on Instance uuid 075e943e-8f32-4be9-8d02-30584668c34b {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:44:01 user nova-compute[74247]:   <uuid>075e943e-8f32-4be9-8d02-30584668c34b</uuid>
Oct 16 18:44:01 user nova-compute[74247]:   <name>instance-00000022</name>
Oct 16 18:44:01 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:44:01 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:44:01 user nova-compute[74247]:   <metadata>
Oct 16 18:44:01 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:44:01 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:44:01 user nova-compute[74247]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-246997190</nova:name>
Oct 16 18:44:01 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:44:01</nova:creationTime>
Oct 16 18:44:01 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:44:01 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:44:01 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:44:01 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:44:01 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:44:01 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:44:01 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:44:01 user nova-compute[74247]:       <nova:owner>
Oct 16 18:44:01 user nova-compute[74247]:         <nova:user uuid="2bda4c43b45347be96b152caba47b07d">tempest-AttachVolumeShelveTestJSON-537076068-project-member</nova:user>
Oct 16 18:44:01 user nova-compute[74247]:         <nova:project uuid="5204c1aec5764c298a206429645eb268">tempest-AttachVolumeShelveTestJSON-537076068</nova:project>
Oct 16 18:44:01 user nova-compute[74247]:       </nova:owner>
Oct 16 18:44:01 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:44:01 user nova-compute[74247]:       <nova:ports>
Oct 16 18:44:01 user nova-compute[74247]:         <nova:port uuid="5297bf76-2e6f-4240-819b-12b1594b0fe2">
Oct 16 18:44:01 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 16 18:44:01 user nova-compute[74247]:         </nova:port>
Oct 16 18:44:01 user nova-compute[74247]:       </nova:ports>
Oct 16 18:44:01 user nova-compute[74247]:     </nova:instance>
Oct 16 18:44:01 user nova-compute[74247]:   </metadata>
Oct 16 18:44:01 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:44:01 user nova-compute[74247]:     <system>
Oct 16 18:44:01 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:44:01 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:44:01 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:44:01 user nova-compute[74247]:       <entry name="serial">075e943e-8f32-4be9-8d02-30584668c34b</entry>
Oct 16 18:44:01 user nova-compute[74247]:       <entry name="uuid">075e943e-8f32-4be9-8d02-30584668c34b</entry>
Oct 16 18:44:01 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:44:01 user nova-compute[74247]:     </system>
Oct 16 18:44:01 user nova-compute[74247]:   </sysinfo>
Oct 16 18:44:01 user nova-compute[74247]:   <os>
Oct 16 18:44:01 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:44:01 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:44:01 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:44:01 user nova-compute[74247]:   </os>
Oct 16 18:44:01 user nova-compute[74247]:   <features>
Oct 16 18:44:01 user nova-compute[74247]:     <acpi/>
Oct 16 18:44:01 user nova-compute[74247]:     <apic/>
Oct 16 18:44:01 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:44:01 user nova-compute[74247]:   </features>
Oct 16 18:44:01 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:44:01 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:44:01 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:44:01 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:44:01 user nova-compute[74247]:   </clock>
Oct 16 18:44:01 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:44:01 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:44:01 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:44:01 user nova-compute[74247]:   </cpu>
Oct 16 18:44:01 user nova-compute[74247]:   <devices>
Oct 16 18:44:01 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:44:01 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:44:01 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/075e943e-8f32-4be9-8d02-30584668c34b/disk"/>
Oct 16 18:44:01 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:44:01 user nova-compute[74247]:     </disk>
Oct 16 18:44:01 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:44:01 user nova-compute[74247]:       <mac address="fa:16:3e:fd:a6:1e"/>
Oct 16 18:44:01 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:44:01 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:44:01 user nova-compute[74247]:       <target dev="tap5297bf76-2e"/>
Oct 16 18:44:01 user nova-compute[74247]:     </interface>
Oct 16 18:44:01 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:44:01 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/075e943e-8f32-4be9-8d02-30584668c34b/console.log" append="off"/>
Oct 16 18:44:01 user nova-compute[74247]:     </serial>
Oct 16 18:44:01 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:44:01 user nova-compute[74247]:     <video>
Oct 16 18:44:01 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:44:01 user nova-compute[74247]:     </video>
Oct 16 18:44:01 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:44:01 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:44:01 user nova-compute[74247]:     </rng>
Oct 16 18:44:01 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:44:01 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:44:01 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:44:01 user nova-compute[74247]:     </memballoon>
Oct 16 18:44:01 user nova-compute[74247]:   </devices>
Oct 16 18:44:01 user nova-compute[74247]: </domain>
Oct 16 18:44:01 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:43:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-246997190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-246997190',id=34,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIhrr+elGpfgxpvDxCYEg3TwFRm9479AxAze0wrEYlT36ZJD5juZ2Mgda1vXnfPW9D0eHXznG5lqW6nzlxRtDM9vSOVC+rVIUMbi26juPUHNHhtCjNg+9DevghtLuUxhQ==',key_name='tempest-keypair-873631301',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5204c1aec5764c298a206429645eb268',ramdisk_id='',reservation_id='r-7whme9zu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-537076068',owner_user_name='tempest-AttachVolumeShelveTestJSON-537076068-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:44:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bda4c43b45347be96b152caba47b07d',uuid=075e943e-8f32-4be9-8d02-30584668c34b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5297bf76-2e6f-4240-819b-12b1594b0fe2", "address": "fa:16:3e:fd:a6:1e", "network": {"id": "88a1b265-5360-4362-90bc-3506f805688f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-620663417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5204c1aec5764c298a206429645eb268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5297bf76-2e", "ovs_interfaceid": "5297bf76-2e6f-4240-819b-12b1594b0fe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Converting VIF {"id": "5297bf76-2e6f-4240-819b-12b1594b0fe2", "address": "fa:16:3e:fd:a6:1e", "network": {"id": "88a1b265-5360-4362-90bc-3506f805688f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-620663417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5204c1aec5764c298a206429645eb268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5297bf76-2e", "ovs_interfaceid": "5297bf76-2e6f-4240-819b-12b1594b0fe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:a6:1e,bridge_name='br-int',has_traffic_filtering=True,id=5297bf76-2e6f-4240-819b-12b1594b0fe2,network=Network(88a1b265-5360-4362-90bc-3506f805688f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5297bf76-2e') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG os_vif [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:a6:1e,bridge_name='br-int',has_traffic_filtering=True,id=5297bf76-2e6f-4240-819b-12b1594b0fe2,network=Network(88a1b265-5360-4362-90bc-3506f805688f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5297bf76-2e') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '035f809c-280f-53e4-909a-434e0f824284', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5297bf76-2e, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5297bf76-2e, col_values=(('qos', UUID('380a5c0e-ba61-475c-b0f5-7480a10c187b')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5297bf76-2e, col_values=(('external_ids', {'iface-id': '5297bf76-2e6f-4240-819b-12b1594b0fe2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:a6:1e', 'vm-uuid': '075e943e-8f32-4be9-8d02-30584668c34b'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:01 user nova-compute[74247]: INFO os_vif [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:a6:1e,bridge_name='br-int',has_traffic_filtering=True,id=5297bf76-2e6f-4240-819b-12b1594b0fe2,network=Network(88a1b265-5360-4362-90bc-3506f805688f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5297bf76-2e')
Oct 16 18:44:01 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:44:01 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] No VIF found with MAC fa:16:3e:fd:a6:1e, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:44:02 user nova-compute[74247]: DEBUG nova.network.neutron [req-4af437eb-216c-4457-be82-966b198731e5 req-354fd9ac-2d93-43a0-a844-4d8c8a5826b6 service nova] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Updated VIF entry in instance network info cache for port 5297bf76-2e6f-4240-819b-12b1594b0fe2. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:44:02 user nova-compute[74247]: DEBUG nova.network.neutron [req-4af437eb-216c-4457-be82-966b198731e5 req-354fd9ac-2d93-43a0-a844-4d8c8a5826b6 service nova] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Updating instance_info_cache with network_info: [{"id": "5297bf76-2e6f-4240-819b-12b1594b0fe2", "address": "fa:16:3e:fd:a6:1e", "network": {"id": "88a1b265-5360-4362-90bc-3506f805688f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-620663417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5204c1aec5764c298a206429645eb268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5297bf76-2e", "ovs_interfaceid": "5297bf76-2e6f-4240-819b-12b1594b0fe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:44:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4af437eb-216c-4457-be82-966b198731e5 req-354fd9ac-2d93-43a0-a844-4d8c8a5826b6 service nova] Releasing lock "refresh_cache-075e943e-8f32-4be9-8d02-30584668c34b" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:44:02 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: 61819735-95a5-4543-915d-bd50c671002b] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:44:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DfLHimQY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:44:02 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:44:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:44:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:44:02 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:44:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:44:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:44:02 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:44:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1 -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[251ebe10-e473-4618-8d2b-d26ced8a793e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:44:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 18:44:02 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:44:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc93a89-8f1a-4e49-81d3-951120377723]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:44:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1] added
Oct 16 18:44:02 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:44:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb63c1d-d625-461c-ad4a-0f1dd07117bf]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:44:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:44:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39aa40c-0c22-4956-8eb9-56d8b955d00c]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:44:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:44:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DfLHimQY {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DfLHimQY" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[977595d2-13fc-4fcd-aa52-923c181baf43]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:44:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DfLHimQY'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:44:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7530bc49-12b3-4a26-973a-47458b33c394]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:44:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:44:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae34e56-ee36-4f6c-bc26-11eb2bc9dc94]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:44:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:44:03 user nova-compute[74247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)
Oct 16 18:44:03 user nova-compute[74247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)
Oct 16 18:44:03 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:44:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:44:03 user nova-compute[74247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)
Oct 16 18:44:03 user nova-compute[74247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)
Oct 16 18:44:03 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:44:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1 -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f8d9fc-48c3-44f2-a56d-09cf3c8e7ab4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:44:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1, portal: 172.16.0.220,3260]
Oct 16 18:44:03 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1, portal: 172.16.0.220,3260] successful.
Oct 16 18:44:03 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:44:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7192d06c-3c9a-491b-a8a7-e5012dc33091]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:44:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:44:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca66da79-895d-47a0-9c5a-bdf0ff9b5f6f]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:44:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:44:03 user nova-compute[74247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)
Oct 16 18:44:03 user nova-compute[74247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)
Oct 16 18:44:03 user nova-compute[74247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1 (non-flash)
Oct 16 18:44:03 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:44:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:44:03 user nova-compute[74247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)
Oct 16 18:44:03 user nova-compute[74247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)
Oct 16 18:44:03 user nova-compute[74247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1 (non-flash)
Oct 16 18:44:03 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:44:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:44:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:44:03 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:44:03 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:44:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b109fef7-7494-42be-b50d-d8e9509044f6]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:44:03 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: None {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:44:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:03 user nova-compute[74247]: DEBUG nova.compute.manager [req-9394dc29-3aa9-408f-b31d-371e0f0897f7 req-77d0a88e-f867-46e0-b5fc-36a9d7390b16 service nova] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Received event network-vif-plugged-5297bf76-2e6f-4240-819b-12b1594b0fe2 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:44:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9394dc29-3aa9-408f-b31d-371e0f0897f7 req-77d0a88e-f867-46e0-b5fc-36a9d7390b16 service nova] Acquiring lock "075e943e-8f32-4be9-8d02-30584668c34b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:44:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9394dc29-3aa9-408f-b31d-371e0f0897f7 req-77d0a88e-f867-46e0-b5fc-36a9d7390b16 service nova] Lock "075e943e-8f32-4be9-8d02-30584668c34b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:44:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9394dc29-3aa9-408f-b31d-371e0f0897f7 req-77d0a88e-f867-46e0-b5fc-36a9d7390b16 service nova] Lock "075e943e-8f32-4be9-8d02-30584668c34b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:44:03 user nova-compute[74247]: DEBUG nova.compute.manager [req-9394dc29-3aa9-408f-b31d-371e0f0897f7 req-77d0a88e-f867-46e0-b5fc-36a9d7390b16 service nova] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] No waiting events found dispatching network-vif-plugged-5297bf76-2e6f-4240-819b-12b1594b0fe2 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:44:03 user nova-compute[74247]: WARNING nova.compute.manager [req-9394dc29-3aa9-408f-b31d-371e0f0897f7 req-77d0a88e-f867-46e0-b5fc-36a9d7390b16 service nova] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Received unexpected event network-vif-plugged-5297bf76-2e6f-4240-819b-12b1594b0fe2 for instance with vm_state building and task_state spawning.
Oct 16 18:44:03 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:44:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:04 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:44:04 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DfLHimQY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:44:04 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:44:04 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '23864646630626365', 'path': '/dev/sdd'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:44:04 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: 61819735-95a5-4543-915d-bd50c671002b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864646630626365', 'path': '/dev/sdd'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:44:04 user nova-compute[74247]: DEBUG nova.objects.instance [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lazy-loading 'flavor' on Instance uuid 61819735-95a5-4543-915d-bd50c671002b {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:44:04 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 18:44:04 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:44:04 user nova-compute[74247]:   <source dev="/dev/sdd"/>
Oct 16 18:44:04 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:44:04 user nova-compute[74247]:   <serial>3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1</serial>
Oct 16 18:44:04 user nova-compute[74247]: </disk>
Oct 16 18:44:04 user nova-compute[74247]:  {{(pid=74247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 18:44:04 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:44:04 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:44:04 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] No VIF found with MAC fa:16:3e:c0:62:93, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:44:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-71e721ac-e1fd-497b-be9d-32ce00ba312c tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "61819735-95a5-4543-915d-bd50c671002b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.402s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:44:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-94945ca5-cfdc-46dc-ae3e-ca05db5983bd req-20c5745c-3fff-4250-b9fe-f00037df98a9 service nova] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Received event network-vif-plugged-5297bf76-2e6f-4240-819b-12b1594b0fe2 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:44:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-94945ca5-cfdc-46dc-ae3e-ca05db5983bd req-20c5745c-3fff-4250-b9fe-f00037df98a9 service nova] Acquiring lock "075e943e-8f32-4be9-8d02-30584668c34b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:44:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-94945ca5-cfdc-46dc-ae3e-ca05db5983bd req-20c5745c-3fff-4250-b9fe-f00037df98a9 service nova] Lock "075e943e-8f32-4be9-8d02-30584668c34b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:44:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-94945ca5-cfdc-46dc-ae3e-ca05db5983bd req-20c5745c-3fff-4250-b9fe-f00037df98a9 service nova] Lock "075e943e-8f32-4be9-8d02-30584668c34b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:44:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-94945ca5-cfdc-46dc-ae3e-ca05db5983bd req-20c5745c-3fff-4250-b9fe-f00037df98a9 service nova] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] No waiting events found dispatching network-vif-plugged-5297bf76-2e6f-4240-819b-12b1594b0fe2 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:44:05 user nova-compute[74247]: WARNING nova.compute.manager [req-94945ca5-cfdc-46dc-ae3e-ca05db5983bd req-20c5745c-3fff-4250-b9fe-f00037df98a9 service nova] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Received unexpected event network-vif-plugged-5297bf76-2e6f-4240-819b-12b1594b0fe2 for instance with vm_state building and task_state spawning.
Oct 16 18:44:05 user nova-compute[74247]: DEBUG nova.compute.manager [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:44:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:44:05 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Instance spawned successfully.
Oct 16 18:44:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 18:44:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:44:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:44:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:44:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:44:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:44:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:44:06 user nova-compute[74247]: INFO nova.compute.manager [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Took 5.96 seconds to spawn the instance on the hypervisor.
Oct 16 18:44:06 user nova-compute[74247]: DEBUG nova.compute.manager [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:44:06 user nova-compute[74247]: INFO nova.compute.manager [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Took 6.74 seconds to build instance.
Oct 16 18:44:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-572579bc-5961-4874-b208-0a47291d69f8 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "075e943e-8f32-4be9-8d02-30584668c34b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.845s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:44:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-eca5f0ec-7aaa-49a6-9ce2-49db49d741d2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "61819735-95a5-4543-915d-bd50c671002b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:44:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-eca5f0ec-7aaa-49a6-9ce2-49db49d741d2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "61819735-95a5-4543-915d-bd50c671002b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:44:06 user nova-compute[74247]: INFO nova.compute.manager [None req-eca5f0ec-7aaa-49a6-9ce2-49db49d741d2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: 61819735-95a5-4543-915d-bd50c671002b] Detaching volume 3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1
Oct 16 18:44:06 user nova-compute[74247]: INFO nova.virt.block_device [None req-eca5f0ec-7aaa-49a6-9ce2-49db49d741d2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: 61819735-95a5-4543-915d-bd50c671002b] Attempting to driver detach volume 3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1 from mountpoint /dev/vdb
Oct 16 18:44:06 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:44:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-eca5f0ec-7aaa-49a6-9ce2-49db49d741d2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Attempting to detach device vdb from instance 61819735-95a5-4543-915d-bd50c671002b from the persistent domain config. {{(pid=74247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 18:44:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-eca5f0ec-7aaa-49a6-9ce2-49db49d741d2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 18:44:06 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:44:06 user nova-compute[74247]:   <source dev="/dev/sdd"/>
Oct 16 18:44:06 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:44:06 user nova-compute[74247]:   <serial>3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1</serial>
Oct 16 18:44:06 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 18:44:06 user nova-compute[74247]: </disk>
Oct 16 18:44:06 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:44:06 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-eca5f0ec-7aaa-49a6-9ce2-49db49d741d2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Successfully detached device vdb from instance 61819735-95a5-4543-915d-bd50c671002b from the persistent domain config.
Oct 16 18:44:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-eca5f0ec-7aaa-49a6-9ce2-49db49d741d2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 61819735-95a5-4543-915d-bd50c671002b from the live domain config. {{(pid=74247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 18:44:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-eca5f0ec-7aaa-49a6-9ce2-49db49d741d2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 18:44:06 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:44:06 user nova-compute[74247]:   <source dev="/dev/sdd"/>
Oct 16 18:44:06 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:44:06 user nova-compute[74247]:   <serial>3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1</serial>
Oct 16 18:44:06 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 18:44:06 user nova-compute[74247]: </disk>
Oct 16 18:44:06 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:44:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:07 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-eca5f0ec-7aaa-49a6-9ce2-49db49d741d2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 61819735-95a5-4543-915d-bd50c671002b {{(pid=74247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 18:44:08 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:44:08 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:44:08 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 18:44:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "refresh_cache-958af87e-69d0-4da1-8fcf-90e0f275d62e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:44:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquired lock "refresh_cache-958af87e-69d0-4da1-8fcf-90e0f275d62e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:44:08 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Forcefully refreshing network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 18:44:09 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Updating instance_info_cache with network_info: [{"id": "4457ec1e-80ee-4038-9838-3af879097230", "address": "fa:16:3e:fb:7d:a8", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4457ec1e-80", "ovs_interfaceid": "4457ec1e-80ee-4038-9838-3af879097230", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:44:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Releasing lock "refresh_cache-958af87e-69d0-4da1-8fcf-90e0f275d62e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:44:09 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Updated the network info_cache for instance {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 18:44:09 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:44:09 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:44:09 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:44:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:11 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:44:11 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:44:11 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:44:11 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:44:11 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 18:44:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:12 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:44:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json" returned: 0 in 0.247s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:13 user nova-compute[74247]: INFO nova.compute.manager [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Rescuing
Oct 16 18:44:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "refresh_cache-25d69a8d-98d5-4044-987a-f376aedfbe2a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:44:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquired lock "refresh_cache-25d69a8d-98d5-4044-987a-f376aedfbe2a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:44:13 user nova-compute[74247]: DEBUG nova.network.neutron [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:44:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:44:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/disk.rescue --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/disk.rescue --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/disk (vdb) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:44:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:13 user nova-compute[74247]: DEBUG nova.network.neutron [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Updating instance_info_cache with network_info: [{"id": "1e2af952-39b5-4add-9542-925c9babc88c", "address": "fa:16:3e:32:37:ce", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2af952-39", "ovs_interfaceid": "1e2af952-39b5-4add-9542-925c9babc88c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:44:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Releasing lock "refresh_cache-25d69a8d-98d5-4044-987a-f376aedfbe2a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:44:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:14 user nova-compute[74247]: DEBUG nova.compute.manager [req-de983d8b-7234-47f8-a024-5b85d0f92ae0 req-cc8a9324-09e4-4b8f-8d56-91eeb9db36de service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Received event network-vif-unplugged-1e2af952-39b5-4add-9542-925c9babc88c {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:44:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-de983d8b-7234-47f8-a024-5b85d0f92ae0 req-cc8a9324-09e4-4b8f-8d56-91eeb9db36de service nova] Acquiring lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:44:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-de983d8b-7234-47f8-a024-5b85d0f92ae0 req-cc8a9324-09e4-4b8f-8d56-91eeb9db36de service nova] Lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:44:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-de983d8b-7234-47f8-a024-5b85d0f92ae0 req-cc8a9324-09e4-4b8f-8d56-91eeb9db36de service nova] Lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:44:14 user nova-compute[74247]: DEBUG nova.compute.manager [req-de983d8b-7234-47f8-a024-5b85d0f92ae0 req-cc8a9324-09e4-4b8f-8d56-91eeb9db36de service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] No waiting events found dispatching network-vif-unplugged-1e2af952-39b5-4add-9542-925c9babc88c {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:44:14 user nova-compute[74247]: WARNING nova.compute.manager [req-de983d8b-7234-47f8-a024-5b85d0f92ae0 req-cc8a9324-09e4-4b8f-8d56-91eeb9db36de service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Received unexpected event network-vif-unplugged-1e2af952-39b5-4add-9542-925c9babc88c for instance with vm_state active and task_state rescuing.
Oct 16 18:44:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61819735-95a5-4543-915d-bd50c671002b/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:14 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Instance destroyed successfully.
Oct 16 18:44:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61819735-95a5-4543-915d-bd50c671002b/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61819735-95a5-4543-915d-bd50c671002b/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:14 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Attempting a stable device rescue
Oct 16 18:44:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:14 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74247) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 16 18:44:14 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Instance directory exists: not creating {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 16 18:44:14 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Creating image(s)
Oct 16 18:44:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "/opt/stack/data/nova/instances/25d69a8d-98d5-4044-987a-f376aedfbe2a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:44:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "/opt/stack/data/nova/instances/25d69a8d-98d5-4044-987a-f376aedfbe2a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:44:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "/opt/stack/data/nova/instances/25d69a8d-98d5-4044-987a-f376aedfbe2a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:44:14 user nova-compute[74247]: DEBUG nova.objects.instance [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lazy-loading 'trusted_certs' on Instance uuid 25d69a8d-98d5-4044-987a-f376aedfbe2a {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:44:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "549a5a2e227ed3b16aa088b87fe231d162d8dbeb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:44:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "549a5a2e227ed3b16aa088b87fe231d162d8dbeb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:44:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/549a5a2e227ed3b16aa088b87fe231d162d8dbeb.part --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61819735-95a5-4543-915d-bd50c671002b/disk --force-share --output=json" returned: 0 in 1.180s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfd28a0-528c-434a-8850-aa7d29c1e738/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/549a5a2e227ed3b16aa088b87fe231d162d8dbeb.part --force-share --output=json" returned: 0 in 0.186s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG nova.virt.images [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] b7048abd-63cd-4ee1-b691-14c807484e8e was qcow2, converting to raw {{(pid=74247) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG nova.privsep.utils [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74247) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/549a5a2e227ed3b16aa088b87fe231d162d8dbeb.part /opt/stack/data/nova/instances/_base/549a5a2e227ed3b16aa088b87fe231d162d8dbeb.converted {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfd28a0-528c-434a-8850-aa7d29c1e738/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfd28a0-528c-434a-8850-aa7d29c1e738/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG nova.compute.manager [req-d993449c-efa8-4aa7-b04b-377d6e2c3e91 req-7c380e40-6c32-4c1a-b553-beb07bfff36d service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Received event network-vif-plugged-1e2af952-39b5-4add-9542-925c9babc88c {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d993449c-efa8-4aa7-b04b-377d6e2c3e91 req-7c380e40-6c32-4c1a-b553-beb07bfff36d service nova] Acquiring lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d993449c-efa8-4aa7-b04b-377d6e2c3e91 req-7c380e40-6c32-4c1a-b553-beb07bfff36d service nova] Lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d993449c-efa8-4aa7-b04b-377d6e2c3e91 req-7c380e40-6c32-4c1a-b553-beb07bfff36d service nova] Lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG nova.compute.manager [req-d993449c-efa8-4aa7-b04b-377d6e2c3e91 req-7c380e40-6c32-4c1a-b553-beb07bfff36d service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] No waiting events found dispatching network-vif-plugged-1e2af952-39b5-4add-9542-925c9babc88c {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:44:16 user nova-compute[74247]: WARNING nova.compute.manager [req-d993449c-efa8-4aa7-b04b-377d6e2c3e91 req-7c380e40-6c32-4c1a-b553-beb07bfff36d service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Received unexpected event network-vif-plugged-1e2af952-39b5-4add-9542-925c9babc88c for instance with vm_state active and task_state rescuing.
Oct 16 18:44:16 user nova-compute[74247]: DEBUG nova.compute.manager [req-d993449c-efa8-4aa7-b04b-377d6e2c3e91 req-7c380e40-6c32-4c1a-b553-beb07bfff36d service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Received event network-vif-plugged-1e2af952-39b5-4add-9542-925c9babc88c {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d993449c-efa8-4aa7-b04b-377d6e2c3e91 req-7c380e40-6c32-4c1a-b553-beb07bfff36d service nova] Acquiring lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d993449c-efa8-4aa7-b04b-377d6e2c3e91 req-7c380e40-6c32-4c1a-b553-beb07bfff36d service nova] Lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d993449c-efa8-4aa7-b04b-377d6e2c3e91 req-7c380e40-6c32-4c1a-b553-beb07bfff36d service nova] Lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG nova.compute.manager [req-d993449c-efa8-4aa7-b04b-377d6e2c3e91 req-7c380e40-6c32-4c1a-b553-beb07bfff36d service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] No waiting events found dispatching network-vif-plugged-1e2af952-39b5-4add-9542-925c9babc88c {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:44:16 user nova-compute[74247]: WARNING nova.compute.manager [req-d993449c-efa8-4aa7-b04b-377d6e2c3e91 req-7c380e40-6c32-4c1a-b553-beb07bfff36d service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Received unexpected event network-vif-plugged-1e2af952-39b5-4add-9542-925c9babc88c for instance with vm_state active and task_state rescuing.
Oct 16 18:44:16 user nova-compute[74247]: DEBUG nova.compute.manager [req-d993449c-efa8-4aa7-b04b-377d6e2c3e91 req-7c380e40-6c32-4c1a-b553-beb07bfff36d service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Received event network-vif-plugged-1e2af952-39b5-4add-9542-925c9babc88c {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d993449c-efa8-4aa7-b04b-377d6e2c3e91 req-7c380e40-6c32-4c1a-b553-beb07bfff36d service nova] Acquiring lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d993449c-efa8-4aa7-b04b-377d6e2c3e91 req-7c380e40-6c32-4c1a-b553-beb07bfff36d service nova] Lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d993449c-efa8-4aa7-b04b-377d6e2c3e91 req-7c380e40-6c32-4c1a-b553-beb07bfff36d service nova] Lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG nova.compute.manager [req-d993449c-efa8-4aa7-b04b-377d6e2c3e91 req-7c380e40-6c32-4c1a-b553-beb07bfff36d service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] No waiting events found dispatching network-vif-plugged-1e2af952-39b5-4add-9542-925c9babc88c {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:44:16 user nova-compute[74247]: WARNING nova.compute.manager [req-d993449c-efa8-4aa7-b04b-377d6e2c3e91 req-7c380e40-6c32-4c1a-b553-beb07bfff36d service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Received unexpected event network-vif-plugged-1e2af952-39b5-4add-9542-925c9babc88c for instance with vm_state active and task_state rescuing.
Oct 16 18:44:16 user nova-compute[74247]: DEBUG nova.compute.manager [req-d993449c-efa8-4aa7-b04b-377d6e2c3e91 req-7c380e40-6c32-4c1a-b553-beb07bfff36d service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Received event network-vif-unplugged-1e2af952-39b5-4add-9542-925c9babc88c {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d993449c-efa8-4aa7-b04b-377d6e2c3e91 req-7c380e40-6c32-4c1a-b553-beb07bfff36d service nova] Acquiring lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d993449c-efa8-4aa7-b04b-377d6e2c3e91 req-7c380e40-6c32-4c1a-b553-beb07bfff36d service nova] Lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d993449c-efa8-4aa7-b04b-377d6e2c3e91 req-7c380e40-6c32-4c1a-b553-beb07bfff36d service nova] Lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG nova.compute.manager [req-d993449c-efa8-4aa7-b04b-377d6e2c3e91 req-7c380e40-6c32-4c1a-b553-beb07bfff36d service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] No waiting events found dispatching network-vif-unplugged-1e2af952-39b5-4add-9542-925c9babc88c {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:44:16 user nova-compute[74247]: WARNING nova.compute.manager [req-d993449c-efa8-4aa7-b04b-377d6e2c3e91 req-7c380e40-6c32-4c1a-b553-beb07bfff36d service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Received unexpected event network-vif-unplugged-1e2af952-39b5-4add-9542-925c9babc88c for instance with vm_state active and task_state rescuing.
Oct 16 18:44:16 user nova-compute[74247]: DEBUG nova.compute.manager [req-d993449c-efa8-4aa7-b04b-377d6e2c3e91 req-7c380e40-6c32-4c1a-b553-beb07bfff36d service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Received event network-vif-plugged-1e2af952-39b5-4add-9542-925c9babc88c {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d993449c-efa8-4aa7-b04b-377d6e2c3e91 req-7c380e40-6c32-4c1a-b553-beb07bfff36d service nova] Acquiring lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d993449c-efa8-4aa7-b04b-377d6e2c3e91 req-7c380e40-6c32-4c1a-b553-beb07bfff36d service nova] Lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d993449c-efa8-4aa7-b04b-377d6e2c3e91 req-7c380e40-6c32-4c1a-b553-beb07bfff36d service nova] Lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG nova.compute.manager [req-d993449c-efa8-4aa7-b04b-377d6e2c3e91 req-7c380e40-6c32-4c1a-b553-beb07bfff36d service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] No waiting events found dispatching network-vif-plugged-1e2af952-39b5-4add-9542-925c9babc88c {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:44:16 user nova-compute[74247]: WARNING nova.compute.manager [req-d993449c-efa8-4aa7-b04b-377d6e2c3e91 req-7c380e40-6c32-4c1a-b553-beb07bfff36d service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Received unexpected event network-vif-plugged-1e2af952-39b5-4add-9542-925c9babc88c for instance with vm_state active and task_state rescuing.
Oct 16 18:44:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/549a5a2e227ed3b16aa088b87fe231d162d8dbeb.part /opt/stack/data/nova/instances/_base/549a5a2e227ed3b16aa088b87fe231d162d8dbeb.converted" returned: 0 in 0.247s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/549a5a2e227ed3b16aa088b87fe231d162d8dbeb.converted --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfd28a0-528c-434a-8850-aa7d29c1e738/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/549a5a2e227ed3b16aa088b87fe231d162d8dbeb.converted --force-share --output=json" returned: 0 in 0.182s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "549a5a2e227ed3b16aa088b87fe231d162d8dbeb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.619s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "549a5a2e227ed3b16aa088b87fe231d162d8dbeb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "549a5a2e227ed3b16aa088b87fe231d162d8dbeb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/549a5a2e227ed3b16aa088b87fe231d162d8dbeb --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/549a5a2e227ed3b16aa088b87fe231d162d8dbeb --force-share --output=json" returned: 0 in 0.166s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/549a5a2e227ed3b16aa088b87fe231d162d8dbeb,backing_fmt=raw /opt/stack/data/nova/instances/25d69a8d-98d5-4044-987a-f376aedfbe2a/disk.rescue {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/549a5a2e227ed3b16aa088b87fe231d162d8dbeb,backing_fmt=raw /opt/stack/data/nova/instances/25d69a8d-98d5-4044-987a-f376aedfbe2a/disk.rescue" returned: 0 in 0.054s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "549a5a2e227ed3b16aa088b87fe231d162d8dbeb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG nova.objects.instance [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lazy-loading 'migration_context' on Instance uuid 25d69a8d-98d5-4044-987a-f376aedfbe2a {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG nova.objects.base [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Object Instance<25d69a8d-98d5-4044-987a-f376aedfbe2a> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Start _get_guest_xml network_info=[{"id": "1e2af952-39b5-4add-9542-925c9babc88c", "address": "fa:16:3e:32:37:ce", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "vif_mac": "fa:16:3e:32:37:ce"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2af952-39", "ovs_interfaceid": "1e2af952-39b5-4add-9542-925c9babc88c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b7048abd-63cd-4ee1-b691-14c807484e8e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iBFLJvYf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '25d69a8d-98d5-4044-987a-f376aedfbe2a', 'attached_at': '', 'detached_at': '', 'volume_id': 'a5cf78da-abe8-4880-bed2-72611b707a27', 'serial': 'a5cf78da-abe8-4880-bed2-72611b707a27'}, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '85f26a53-7367-45fb-91a4-3c84f5fd42aa', 'guest_format': None, 'volume_type': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG nova.objects.instance [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lazy-loading 'resources' on Instance uuid 25d69a8d-98d5-4044-987a-f376aedfbe2a {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075e943e-8f32-4be9-8d02-30584668c34b/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG nova.objects.base [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Object Instance<25d69a8d-98d5-4044-987a-f376aedfbe2a> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG nova.objects.instance [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lazy-loading 'numa_topology' on Instance uuid 25d69a8d-98d5-4044-987a-f376aedfbe2a {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG nova.objects.base [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Object Instance<25d69a8d-98d5-4044-987a-f376aedfbe2a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:44:16 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:44:16 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:44:16 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:44:16 user nova-compute[74247]: DEBUG nova.objects.instance [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lazy-loading 'vcpu_model' on Instance uuid 25d69a8d-98d5-4044-987a-f376aedfbe2a {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG nova.objects.base [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Object Instance<25d69a8d-98d5-4044-987a-f376aedfbe2a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iBFLJvYf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:44:17 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:44:17 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:44:17 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:44:17 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:44:17 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:44:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcdbfce-1042-43d9-9a2f-e312c4e99e9e]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = iBFLJvYf\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 16 18:44:17 user nova-compute[74247]: node.name = iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27
Oct 16 18:44:17 user nova-compute[74247]: node.tpgt = -1
Oct 16 18:44:17 user nova-compute[74247]: node.startup = automatic
Oct 16 18:44:17 user nova-compute[74247]: node.leading_login = No
Oct 16 18:44:17 user nova-compute[74247]: iface.iscsi_ifacename = default
Oct 16 18:44:17 user nova-compute[74247]: iface.net_ifacename = <empty>
Oct 16 18:44:17 user nova-compute[74247]: iface.ipaddress = <empty>
Oct 16 18:44:17 user nova-compute[74247]: iface.prefix_len = 0
Oct 16 18:44:17 user nova-compute[74247]: iface.hwaddress = <empty>
Oct 16 18:44:17 user nova-compute[74247]: iface.transport_name = tcp
Oct 16 18:44:17 user nova-compute[74247]: iface.initiatorname = <empty>
Oct 16 18:44:17 user nova-compute[74247]: iface.state = <empty>
Oct 16 18:44:17 user nova-compute[74247]: iface.vlan_id = 0
Oct 16 18:44:17 user nova-compute[74247]: iface.vlan_priority = 0
Oct 16 18:44:17 user nova-compute[74247]: iface.vlan_state = <empty>
Oct 16 18:44:17 user nova-compute[74247]: iface.iface_num = 0
Oct 16 18:44:17 user nova-compute[74247]: iface.mtu = 0
Oct 16 18:44:17 user nova-compute[74247]: iface.port = 0
Oct 16 18:44:17 user nova-compute[74247]: iface.bootproto = <empty>
Oct 16 18:44:17 user nova-compute[74247]: iface.subnet_mask = <empty>
Oct 16 18:44:17 user nova-compute[74247]: iface.gateway = <empty>
Oct 16 18:44:17 user nova-compute[74247]: iface.dhcp_alt_client_id_state = <empty>
Oct 16 18:44:17 user nova-compute[74247]: iface.dhcp_alt_client_id = <empty>
Oct 16 18:44:17 user nova-compute[74247]: iface.dhcp_dns = <empty>
Oct 16 18:44:17 user nova-compute[74247]: iface.dhcp_learn_iqn = <empty>
Oct 16 18:44:17 user nova-compute[74247]: iface.dhcp_req_vendor_id_state = <empty>
Oct 16 18:44:17 user nova-compute[74247]: iface.dhcp_vendor_id_state = <empty>
Oct 16 18:44:17 user nova-compute[74247]: iface.dhcp_vendor_id = <empty>
Oct 16 18:44:17 user nova-compute[74247]: iface.dhcp_slp_da = <empty>
Oct 16 18:44:17 user nova-compute[74247]: iface.fragmentation = <empty>
Oct 16 18:44:17 user nova-compute[74247]: iface.gratuitous_arp = <empty>
Oct 16 18:44:17 user nova-compute[74247]: iface.incoming_forwarding = <empty>
Oct 16 18:44:17 user nova-compute[74247]: iface.tos_state = <empty>
Oct 16 18:44:17 user nova-compute[74247]: iface.tos = 0
Oct 16 18:44:17 user nova-compute[74247]: iface.ttl = 0
Oct 16 18:44:17 user nova-compute[74247]: iface.delayed_ack = <empty>
Oct 16 18:44:17 user nova-compute[74247]: iface.tcp_nagle = <empty>
Oct 16 18:44:17 user nova-compute[74247]: iface.tcp_wsf_state = <empty>
Oct 16 18:44:17 user nova-compute[74247]: iface.tcp_wsf = 0
Oct 16 18:44:17 user nova-compute[74247]: iface.tcp_timer_scale = 0
Oct 16 18:44:17 user nova-compute[74247]: iface.tcp_timestamp = <empty>
Oct 16 18:44:17 user nova-compute[74247]: iface.redirect = <empty>
Oct 16 18:44:17 user nova-compute[74247]: iface.def_task_mgmt_timeout = 0
Oct 16 18:44:17 user nova-compute[74247]: iface.header_digest = <empty>
Oct 16 18:44:17 user nova-compute[74247]: iface.data_digest = <empty>
Oct 16 18:44:17 user nova-compute[74247]: iface.immediate_data = <empty>
Oct 16 18:44:17 user nova-compute[74247]: iface.initial_r2t = <empty>
Oct 16 18:44:17 user nova-compute[74247]: iface.data_seq_inorder = <empty>
Oct 16 18:44:17 user nova-compute[74247]: iface.data_pdu_inorder = <empty>
Oct 16 18:44:17 user nova-compute[74247]: iface.erl = 0
Oct 16 18:44:17 user nova-compute[74247]: iface.max_receive_data_len = 0
Oct 16 18:44:17 user nova-compute[74247]: iface.first_burst_len = 0
Oct 16 18:44:17 user nova-compute[74247]: iface.max_outstanding_r2t = 0
Oct 16 18:44:17 user nova-compute[74247]: iface.max_burst_len = 0
Oct 16 18:44:17 user nova-compute[74247]: iface.chap_auth = <empty>
Oct 16 18:44:17 user nova-compute[74247]: iface.bidi_chap = <empty>
Oct 16 18:44:17 user nova-compute[74247]: iface.strict_login_compliance = <empty>
Oct 16 18:44:17 user nova-compute[74247]: iface.discovery_auth = <empty>
Oct 16 18:44:17 user nova-compute[74247]: iface.discovery_logout = <empty>
Oct 16 18:44:17 user nova-compute[74247]: node.discovery_address = <empty>
Oct 16 18:44:17 user nova-compute[74247]: node.discovery_port = 0
Oct 16 18:44:17 user nova-compute[74247]: node.discovery_type = static
Oct 16 18:44:17 user nova-compute[74247]: node.session.initial_cmdsn = 0
Oct 16 18:44:17 user nova-compute[74247]: node.session.initial_login_retry_max = 8
Oct 16 18:44:17 user nova-compute[74247]: node.session.xmit_thread_priority = -20
Oct 16 18:44:17 user nova-compute[74247]: node.session.cmds_max = 128
Oct 16 18:44:17 user nova-compute[74247]: node.session.queue_depth = 32
Oct 16 18:44:17 user nova-compute[74247]: node.session.nr_sessions = 1
Oct 16 18:44:17 user nova-compute[74247]: node.session.auth.authmethod = CHAP
Oct 16 18:44:17 user nova-compute[74247]: node.session.auth.username = iBFLJvYf
Oct 16 18:44:17 user nova-compute[74247]: node.session.auth.password = ***
Oct 16 18:44:17 user nova-compute[74247]: node.session.auth.username_in = <empty>
Oct 16 18:44:17 user nova-compute[74247]: node.session.auth.password_in = <empty>
Oct 16 18:44:17 user nova-compute[74247]: node.session.auth.chap_algs = MD5
Oct 16 18:44:17 user nova-compute[74247]: node.session.timeo.replacement_timeout = 120
Oct 16 18:44:17 user nova-compute[74247]: node.session.err_timeo.abort_timeout = 15
Oct 16 18:44:17 user nova-compute[74247]: node.session.err_timeo.lu_reset_timeout = 30
Oct 16 18:44:17 user nova-compute[74247]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 16 18:44:17 user nova-compute[74247]: node.session.err_timeo.host_reset_timeout = 60
Oct 16 18:44:17 user nova-compute[74247]: node.session.iscsi.FastAbort = Yes
Oct 16 18:44:17 user nova-compute[74247]: node.session.iscsi.InitialR2T = No
Oct 16 18:44:17 user nova-compute[74247]: node.session.iscsi.ImmediateData = Yes
Oct 16 18:44:17 user nova-compute[74247]: node.session.iscsi.FirstBurstLength = 262144
Oct 16 18:44:17 user nova-compute[74247]: node.session.iscsi.MaxBurstLength = 16776192
Oct 16 18:44:17 user nova-compute[74247]: node.session.iscsi.DefaultTime2Retain = 0
Oct 16 18:44:17 user nova-compute[74247]: node.session.iscsi.DefaultTime2Wait = 2
Oct 16 18:44:17 user nova-compute[74247]: node.session.iscsi.MaxConnections = 1
Oct 16 18:44:17 user nova-compute[74247]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 16 18:44:17 user nova-compute[74247]: node.session.iscsi.ERL = 0
Oct 16 18:44:17 user nova-compute[74247]: node.session.scan = manual
Oct 16 18:44:17 user nova-compute[74247]: node.session.reopen_max = 0
Oct 16 18:44:17 user nova-compute[74247]: node.conn[0].address = 172.16.0.220
Oct 16 18:44:17 user nova-compute[74247]: node.conn[0].port = 3260
Oct 16 18:44:17 user nova-compute[74247]: node.conn[0].startup = manual
Oct 16 18:44:17 user nova-compute[74247]: node.conn[0].tcp.window_size = 524288
Oct 16 18:44:17 user nova-compute[74247]: node.conn[0].tcp.type_of_service = 0
Oct 16 18:44:17 user nova-compute[74247]: node.conn[0].timeo.logout_timeout = 15
Oct 16 18:44:17 user nova-compute[74247]: node.conn[0].timeo.login_timeout = 15
Oct 16 18:44:17 user nova-compute[74247]: node.conn[0].timeo.auth_timeout = 45
Oct 16 18:44:17 user nova-compute[74247]: node.conn[0].timeo.noop_out_interval = 5
Oct 16 18:44:17 user nova-compute[74247]: node.conn[0].timeo.noop_out_timeout = 5
Oct 16 18:44:17 user nova-compute[74247]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 16 18:44:17 user nova-compute[74247]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 16 18:44:17 user nova-compute[74247]: node.conn[0].iscsi.HeaderDigest = None
Oct 16 18:44:17 user nova-compute[74247]: node.conn[0].iscsi.DataDigest = None
Oct 16 18:44:17 user nova-compute[74247]: node.conn[0].iscsi.IFMarker = No
Oct 16 18:44:17 user nova-compute[74247]: node.conn[0].iscsi.OFMarker = No
Oct 16 18:44:17 user nova-compute[74247]: # END RECORD
Oct 16 18:44:17 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075e943e-8f32-4be9-8d02-30584668c34b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075e943e-8f32-4be9-8d02-30584668c34b/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[015035b4-f27f-4d7a-a7ea-875dd9f220ed]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d89b8d8-db7b-466c-a0d5-dce45f15fa77]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iBFLJvYf {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iBFLJvYf" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9888d44e-bc79-435f-87b1-292609a61802]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iBFLJvYf'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[70df615b-2228-47ce-87cf-a2e9dd0be1af]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[811622a8-092c-485e-ad63-9afa20afbca0]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:44:17 user nova-compute[74247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)
Oct 16 18:44:17 user nova-compute[74247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)
Oct 16 18:44:17 user nova-compute[74247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1 (non-flash)
Oct 16 18:44:17 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:44:17 user nova-compute[74247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)
Oct 16 18:44:17 user nova-compute[74247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)
Oct 16 18:44:17 user nova-compute[74247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1 (non-flash)
Oct 16 18:44:17 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.228s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] HCTL ('33', '0', '0', 0) found on session 31 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[62527690-9c72-4ca4-b21b-e7f9b97bbecd]: (4, ('0 0 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Searching for a device in session 31 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iBFLJvYf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.253s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] <== connect_volume: return (254ms) {'type': 'block', 'scsi_wwn': '23364333231666630', 'path': '/dev/sdb'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364333231666630', 'path': '/dev/sdb'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075e943e-8f32-4be9-8d02-30584668c34b/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:42:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-580863586',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-580863586',id=32,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:43:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bce6164a392e4cc2a027d12c49145e6d',ramdisk_id='',reservation_id='r-gsrsluny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-656520712',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:43:05Z,user_data=None,user_id='b01d3e5d2fcb40bc92c3d2fe1236d509',uuid=25d69a8d-98d5-4044-987a-f376aedfbe2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e2af952-39b5-4add-9542-925c9babc88c", "address": "fa:16:3e:32:37:ce", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "vif_mac": "fa:16:3e:32:37:ce"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2af952-39", "ovs_interfaceid": "1e2af952-39b5-4add-9542-925c9babc88c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Converting VIF {"id": "1e2af952-39b5-4add-9542-925c9babc88c", "address": "fa:16:3e:32:37:ce", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "vif_mac": "fa:16:3e:32:37:ce"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2af952-39", "ovs_interfaceid": "1e2af952-39b5-4add-9542-925c9babc88c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:37:ce,bridge_name='br-int',has_traffic_filtering=True,id=1e2af952-39b5-4add-9542-925c9babc88c,network=Network(2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e2af952-39') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG nova.objects.instance [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lazy-loading 'pci_devices' on Instance uuid 25d69a8d-98d5-4044-987a-f376aedfbe2a {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG nova.objects.base [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Object Instance<25d69a8d-98d5-4044-987a-f376aedfbe2a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:44:17 user nova-compute[74247]:   <uuid>25d69a8d-98d5-4044-987a-f376aedfbe2a</uuid>
Oct 16 18:44:17 user nova-compute[74247]:   <name>instance-00000020</name>
Oct 16 18:44:17 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:44:17 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:44:17 user nova-compute[74247]:   <metadata>
Oct 16 18:44:17 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:44:17 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:44:17 user nova-compute[74247]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-580863586</nova:name>
Oct 16 18:44:17 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:44:16</nova:creationTime>
Oct 16 18:44:17 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:44:17 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:44:17 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:44:17 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:44:17 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:44:17 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:44:17 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:44:17 user nova-compute[74247]:       <nova:owner>
Oct 16 18:44:17 user nova-compute[74247]:         <nova:user uuid="b01d3e5d2fcb40bc92c3d2fe1236d509">tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member</nova:user>
Oct 16 18:44:17 user nova-compute[74247]:         <nova:project uuid="bce6164a392e4cc2a027d12c49145e6d">tempest-ServerBootFromVolumeStableRescueTest-656520712</nova:project>
Oct 16 18:44:17 user nova-compute[74247]:       </nova:owner>
Oct 16 18:44:17 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:44:17 user nova-compute[74247]:       <nova:ports>
Oct 16 18:44:17 user nova-compute[74247]:         <nova:port uuid="1e2af952-39b5-4add-9542-925c9babc88c">
Oct 16 18:44:17 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 16 18:44:17 user nova-compute[74247]:         </nova:port>
Oct 16 18:44:17 user nova-compute[74247]:       </nova:ports>
Oct 16 18:44:17 user nova-compute[74247]:     </nova:instance>
Oct 16 18:44:17 user nova-compute[74247]:   </metadata>
Oct 16 18:44:17 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:44:17 user nova-compute[74247]:     <system>
Oct 16 18:44:17 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:44:17 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:44:17 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:44:17 user nova-compute[74247]:       <entry name="serial">25d69a8d-98d5-4044-987a-f376aedfbe2a</entry>
Oct 16 18:44:17 user nova-compute[74247]:       <entry name="uuid">25d69a8d-98d5-4044-987a-f376aedfbe2a</entry>
Oct 16 18:44:17 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:44:17 user nova-compute[74247]:     </system>
Oct 16 18:44:17 user nova-compute[74247]:   </sysinfo>
Oct 16 18:44:17 user nova-compute[74247]:   <os>
Oct 16 18:44:17 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:44:17 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:44:17 user nova-compute[74247]:   </os>
Oct 16 18:44:17 user nova-compute[74247]:   <features>
Oct 16 18:44:17 user nova-compute[74247]:     <acpi/>
Oct 16 18:44:17 user nova-compute[74247]:     <apic/>
Oct 16 18:44:17 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:44:17 user nova-compute[74247]:   </features>
Oct 16 18:44:17 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:44:17 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:44:17 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:44:17 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:44:17 user nova-compute[74247]:   </clock>
Oct 16 18:44:17 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:44:17 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:44:17 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:44:17 user nova-compute[74247]:   </cpu>
Oct 16 18:44:17 user nova-compute[74247]:   <devices>
Oct 16 18:44:17 user nova-compute[74247]:     <disk type="block" device="disk">
Oct 16 18:44:17 user nova-compute[74247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:44:17 user nova-compute[74247]:       <source dev="/dev/sdb"/>
Oct 16 18:44:17 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:44:17 user nova-compute[74247]:       <serial>a5cf78da-abe8-4880-bed2-72611b707a27</serial>
Oct 16 18:44:17 user nova-compute[74247]:     </disk>
Oct 16 18:44:17 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:44:17 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:44:17 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/25d69a8d-98d5-4044-987a-f376aedfbe2a/disk.rescue"/>
Oct 16 18:44:17 user nova-compute[74247]:       <target dev="vdb" bus="virtio"/>
Oct 16 18:44:17 user nova-compute[74247]:       <boot order="1"/>
Oct 16 18:44:17 user nova-compute[74247]:     </disk>
Oct 16 18:44:17 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:44:17 user nova-compute[74247]:       <mac address="fa:16:3e:32:37:ce"/>
Oct 16 18:44:17 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:44:17 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:44:17 user nova-compute[74247]:       <target dev="tap1e2af952-39"/>
Oct 16 18:44:17 user nova-compute[74247]:     </interface>
Oct 16 18:44:17 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:44:17 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/25d69a8d-98d5-4044-987a-f376aedfbe2a/console.log" append="off"/>
Oct 16 18:44:17 user nova-compute[74247]:     </serial>
Oct 16 18:44:17 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:44:17 user nova-compute[74247]:     <video>
Oct 16 18:44:17 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:44:17 user nova-compute[74247]:     </video>
Oct 16 18:44:17 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:44:17 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:44:17 user nova-compute[74247]:     </rng>
Oct 16 18:44:17 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:44:17 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:44:17 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:44:17 user nova-compute[74247]:     </memballoon>
Oct 16 18:44:17 user nova-compute[74247]:   </devices>
Oct 16 18:44:17 user nova-compute[74247]: </domain>
Oct 16 18:44:17 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:44:17 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:44:17 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:44:17 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=7561MB free_disk=24.861507415771484GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:44:17 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Instance destroyed successfully.
Oct 16 18:44:17 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] No VIF found with MAC fa:16:3e:32:37:ce, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance e37fbc27-3404-479a-be08-4d590391cf30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance cddf4842-1c25-4cc8-914e-af30849e4d6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 958af87e-69d0-4da1-8fcf-90e0f275d62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance d775101d-53a1-48c7-af24-91480be6af61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 7dcc08e9-7439-436b-8d9f-facaf04e22c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 220798e9-aea4-4c79-9737-175ab0598e7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 3dfec5ff-83b2-442e-af36-d17e959bf316 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 61819735-95a5-4543-915d-bd50c671002b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 25d69a8d-98d5-4044-987a-f376aedfbe2a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 0dfd28a0-528c-434a-8850-aa7d29c1e738 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 075e943e-8f32-4be9-8d02-30584668c34b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 18:44:17 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 18:44:18 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:44:18 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:44:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 18:44:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.522s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:44:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:19 user nova-compute[74247]: DEBUG nova.compute.manager [req-e781ca87-6cec-4285-b7b1-a4ba7ada68be req-531cdb39-0698-4043-8031-9816df6ef9db service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Received event network-vif-plugged-1e2af952-39b5-4add-9542-925c9babc88c {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:44:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e781ca87-6cec-4285-b7b1-a4ba7ada68be req-531cdb39-0698-4043-8031-9816df6ef9db service nova] Acquiring lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:44:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e781ca87-6cec-4285-b7b1-a4ba7ada68be req-531cdb39-0698-4043-8031-9816df6ef9db service nova] Lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:44:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e781ca87-6cec-4285-b7b1-a4ba7ada68be req-531cdb39-0698-4043-8031-9816df6ef9db service nova] Lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:44:19 user nova-compute[74247]: DEBUG nova.compute.manager [req-e781ca87-6cec-4285-b7b1-a4ba7ada68be req-531cdb39-0698-4043-8031-9816df6ef9db service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] No waiting events found dispatching network-vif-plugged-1e2af952-39b5-4add-9542-925c9babc88c {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:44:19 user nova-compute[74247]: WARNING nova.compute.manager [req-e781ca87-6cec-4285-b7b1-a4ba7ada68be req-531cdb39-0698-4043-8031-9816df6ef9db service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Received unexpected event network-vif-plugged-1e2af952-39b5-4add-9542-925c9babc88c for instance with vm_state active and task_state rescuing.
Oct 16 18:44:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Acquiring lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:44:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:44:19 user nova-compute[74247]: DEBUG nova.objects.instance [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lazy-loading 'flavor' on Instance uuid 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:44:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:44:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Acquiring lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:44:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:44:20 user nova-compute[74247]: INFO nova.compute.manager [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Attaching volume b10a9068-67e0-40bf-bc3f-d77b2c17ea54 to /dev/vdb
Oct 16 18:44:20 user nova-compute[74247]: DEBUG os_brick.utils [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:44:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:20 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4aec1a3-f169-4472-b20e-1ecbfada7ac9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:44:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:20 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb400ab7-01e0-462e-9655-e4180317c4b2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:44:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:20 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a75094-12e3-4f8f-86df-850e0fc21852]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:44:20 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbbb5dca-bb93-4d48-befa-37bc4dcc1796]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:44:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:44:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 18:44:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:44:20 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 18:44:20 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3deead04-a1f1-4486-844c-c685284a4491]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:44:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 18:44:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 18:44:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 18:44:20 user nova-compute[74247]: DEBUG os_brick.utils [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:44:20 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Updating existing volume attachment record: 16b631fb-6ae4-4da7-8679-aafd1b70b664 {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 18:44:20 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:44:20 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:44:20 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 18:44:21 user nova-compute[74247]: DEBUG nova.compute.manager [req-c2d151e0-1c1b-4304-9be5-a75b0f713791 req-490bf378-4eab-4f55-8865-d8a7f89ba70f service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Received event network-vif-plugged-1e2af952-39b5-4add-9542-925c9babc88c {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:44:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c2d151e0-1c1b-4304-9be5-a75b0f713791 req-490bf378-4eab-4f55-8865-d8a7f89ba70f service nova] Acquiring lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:44:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c2d151e0-1c1b-4304-9be5-a75b0f713791 req-490bf378-4eab-4f55-8865-d8a7f89ba70f service nova] Lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:44:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c2d151e0-1c1b-4304-9be5-a75b0f713791 req-490bf378-4eab-4f55-8865-d8a7f89ba70f service nova] Lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:44:21 user nova-compute[74247]: DEBUG nova.compute.manager [req-c2d151e0-1c1b-4304-9be5-a75b0f713791 req-490bf378-4eab-4f55-8865-d8a7f89ba70f service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] No waiting events found dispatching network-vif-plugged-1e2af952-39b5-4add-9542-925c9babc88c {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:44:21 user nova-compute[74247]: WARNING nova.compute.manager [req-c2d151e0-1c1b-4304-9be5-a75b0f713791 req-490bf378-4eab-4f55-8865-d8a7f89ba70f service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Received unexpected event network-vif-plugged-1e2af952-39b5-4add-9542-925c9babc88c for instance with vm_state active and task_state rescuing.
Oct 16 18:44:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:21 user nova-compute[74247]: DEBUG nova.compute.manager [None req-ebe895bb-1028-40be-b787-0dc9b9c385fb tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:44:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:27 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-eca5f0ec-7aaa-49a6-9ce2-49db49d741d2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 61819735-95a5-4543-915d-bd50c671002b is timed out.
Oct 16 18:44:27 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-eca5f0ec-7aaa-49a6-9ce2-49db49d741d2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Successfully detached device vdb from instance 61819735-95a5-4543-915d-bd50c671002b from the live domain config.
Oct 16 18:44:27 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eca5f0ec-7aaa-49a6-9ce2-49db49d741d2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: 61819735-95a5-4543-915d-bd50c671002b] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f0ec-7aaa-49a6-9ce2-49db49d741d2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DfLHimQY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:44:27 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-eca5f0ec-7aaa-49a6-9ce2-49db49d741d2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:44:27 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-eca5f0ec-7aaa-49a6-9ce2-49db49d741d2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-eca5f0ec-7aaa-49a6-9ce2-49db49d741d2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f71c257-e7bf-4865-815c-b6ef4fdca3dc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f0ec-7aaa-49a6-9ce2-49db49d741d2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 18:44:27 user nova-compute[74247]: No targets found.
Oct 16 18:44:27 user nova-compute[74247]: iSNS:
Oct 16 18:44:27 user nova-compute[74247]: No targets found.
Oct 16 18:44:27 user nova-compute[74247]: STATIC:
Oct 16 18:44:27 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27
Oct 16 18:44:27 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:44:27 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:44:27 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1
Oct 16 18:44:27 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:44:27 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:44:27 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc
Oct 16 18:44:27 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:44:27 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:44:27 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f
Oct 16 18:44:27 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:44:27 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:44:27 user nova-compute[74247]: FIRMWARE:
Oct 16 18:44:27 user nova-compute[74247]: No targets found.
Oct 16 18:44:27 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f0ec-7aaa-49a6-9ce2-49db49d741d2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 18:44:27 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 18:44:27 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f0ec-7aaa-49a6-9ce2-49db49d741d2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3a6564-03bf-4755-a7b9-68f3b45d2194]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed87c00-bf37-4ae1-a8a2-1f9cda1aee52]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f0ec-7aaa-49a6-9ce2-49db49d741d2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:44:27 user nova-compute[74247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)
Oct 16 18:44:27 user nova-compute[74247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)
Oct 16 18:44:27 user nova-compute[74247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1 (non-flash)
Oct 16 18:44:27 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f0ec-7aaa-49a6-9ce2-49db49d741d2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:44:27 user nova-compute[74247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)
Oct 16 18:44:27 user nova-compute[74247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)
Oct 16 18:44:27 user nova-compute[74247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1 (non-flash)
Oct 16 18:44:27 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f0ec-7aaa-49a6-9ce2-49db49d741d2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe0484a8940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1'): ({'sdd'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-eca5f0ec-7aaa-49a6-9ce2-49db49d741d2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Removing single pathed devices sdd {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d417906-d8e5-4b06-a511-20ca0ef5f4a4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[95702a29-e39b-4606-8a5c-ae15ba542662]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-eca5f0ec-7aaa-49a6-9ce2-49db49d741d2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Flushing IO for device /dev/sdd {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7454d54c-620c-413b-8cf5-536aac788af6]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-eca5f0ec-7aaa-49a6-9ce2-49db49d741d2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0c25ef-b86a-4474-a8a3-904f3c233ead]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-eca5f0ec-7aaa-49a6-9ce2-49db49d741d2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-eca5f0ec-7aaa-49a6-9ce2-49db49d741d2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] SCSI volumes sdd have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f0ec-7aaa-49a6-9ce2-49db49d741d2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[348fe9c9-1f0b-46df-806f-ad3b614c5b7c]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f0ec-7aaa-49a6-9ce2-49db49d741d2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1 -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92785de-9ae3-405f-a68d-80966fc647c2]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f0ec-7aaa-49a6-9ce2-49db49d741d2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1, portal: 172.16.0.220,3260]
Oct 16 18:44:27 user nova-compute[74247]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1, portal: 172.16.0.220,3260] successful.
Oct 16 18:44:27 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1 -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d0bfe7a-5342-4dbf-a4c7-5b627a5f3fc1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c209e796-59f9-48c8-9395-d5439498218c]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f0ec-7aaa-49a6-9ce2-49db49d741d2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-eca5f0ec-7aaa-49a6-9ce2-49db49d741d2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f0ec-7aaa-49a6-9ce2-49db49d741d2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] <== disconnect_volume: return (309ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:44:27 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eca5f0ec-7aaa-49a6-9ce2-49db49d741d2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: 61819735-95a5-4543-915d-bd50c671002b] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 18:44:28 user nova-compute[74247]: DEBUG nova.objects.instance [None req-eca5f0ec-7aaa-49a6-9ce2-49db49d741d2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lazy-loading 'flavor' on Instance uuid 61819735-95a5-4543-915d-bd50c671002b {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:44:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-eca5f0ec-7aaa-49a6-9ce2-49db49d741d2 tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "61819735-95a5-4543-915d-bd50c671002b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.736s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:44:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ebd31c55-ffea-4259-9696-7e55e2766877 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "e37fbc27-3404-479a-be08-4d590391cf30" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:44:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ebd31c55-ffea-4259-9696-7e55e2766877 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "e37fbc27-3404-479a-be08-4d590391cf30" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:44:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ebd31c55-ffea-4259-9696-7e55e2766877 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "e37fbc27-3404-479a-be08-4d590391cf30-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:44:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ebd31c55-ffea-4259-9696-7e55e2766877 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "e37fbc27-3404-479a-be08-4d590391cf30-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:44:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ebd31c55-ffea-4259-9696-7e55e2766877 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "e37fbc27-3404-479a-be08-4d590391cf30-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:44:36 user nova-compute[74247]: INFO nova.compute.manager [None req-ebd31c55-ffea-4259-9696-7e55e2766877 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Terminating instance
Oct 16 18:44:36 user nova-compute[74247]: DEBUG nova.compute.manager [None req-ebd31c55-ffea-4259-9696-7e55e2766877 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 18:44:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:36 user nova-compute[74247]: DEBUG nova.compute.manager [req-7f443fcb-74d1-4ec0-b1fd-9078aa1b6ef4 req-9c26b5fc-9458-450c-8997-101aa6ad5cc2 service nova] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Received event network-vif-unplugged-634511f9-ce96-4fe6-8bfc-51846e4dcb4f {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:44:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7f443fcb-74d1-4ec0-b1fd-9078aa1b6ef4 req-9c26b5fc-9458-450c-8997-101aa6ad5cc2 service nova] Acquiring lock "e37fbc27-3404-479a-be08-4d590391cf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:44:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7f443fcb-74d1-4ec0-b1fd-9078aa1b6ef4 req-9c26b5fc-9458-450c-8997-101aa6ad5cc2 service nova] Lock "e37fbc27-3404-479a-be08-4d590391cf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:44:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7f443fcb-74d1-4ec0-b1fd-9078aa1b6ef4 req-9c26b5fc-9458-450c-8997-101aa6ad5cc2 service nova] Lock "e37fbc27-3404-479a-be08-4d590391cf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:44:36 user nova-compute[74247]: DEBUG nova.compute.manager [req-7f443fcb-74d1-4ec0-b1fd-9078aa1b6ef4 req-9c26b5fc-9458-450c-8997-101aa6ad5cc2 service nova] [instance: e37fbc27-3404-479a-be08-4d590391cf30] No waiting events found dispatching network-vif-unplugged-634511f9-ce96-4fe6-8bfc-51846e4dcb4f {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:44:36 user nova-compute[74247]: DEBUG nova.compute.manager [req-7f443fcb-74d1-4ec0-b1fd-9078aa1b6ef4 req-9c26b5fc-9458-450c-8997-101aa6ad5cc2 service nova] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Received event network-vif-unplugged-634511f9-ce96-4fe6-8bfc-51846e4dcb4f for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:44:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:36 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Instance destroyed successfully.
Oct 16 18:44:36 user nova-compute[74247]: DEBUG nova.objects.instance [None req-ebd31c55-ffea-4259-9696-7e55e2766877 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lazy-loading 'resources' on Instance uuid e37fbc27-3404-479a-be08-4d590391cf30 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:44:36 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-ebd31c55-ffea-4259-9696-7e55e2766877 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:23:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1467189349',display_name='tempest-ServerActionsTestOtherA-server-1467189349',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1467189349',id=2,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/sQ/2CMkopvPZot1Iryii0p1Iq3sQgAbR+a1zff3LwsTrC97Bkir58aQPXckuRP2Pk52sgcmyihyOLiY8s4svRhqknfDOoanrdDaAunocHU/6uHElK38rY7fNKG4cJVA==',key_name='tempest-keypair-869426560',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:24:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42bd3eb752f04fd48dfe0623fdf2fe9f',ramdisk_id='',reservation_id='r-plrjjfkw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-291765974',owner_user_name='tempest-ServerActionsTestOtherA-291765974-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:24:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3635a30f06234f0d9a8e0604c25f1208',uuid=e37fbc27-3404-479a-be08-4d590391cf30,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "634511f9-ce96-4fe6-8bfc-51846e4dcb4f", "address": "fa:16:3e:d2:d2:f4", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634511f9-ce", "ovs_interfaceid": "634511f9-ce96-4fe6-8bfc-51846e4dcb4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:44:36 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-ebd31c55-ffea-4259-9696-7e55e2766877 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Converting VIF {"id": "634511f9-ce96-4fe6-8bfc-51846e4dcb4f", "address": "fa:16:3e:d2:d2:f4", "network": {"id": "0a61bae1-2607-4e42-b573-e74ac3edf09a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1201038774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42bd3eb752f04fd48dfe0623fdf2fe9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634511f9-ce", "ovs_interfaceid": "634511f9-ce96-4fe6-8bfc-51846e4dcb4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:44:36 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-ebd31c55-ffea-4259-9696-7e55e2766877 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:d2:f4,bridge_name='br-int',has_traffic_filtering=True,id=634511f9-ce96-4fe6-8bfc-51846e4dcb4f,network=Network(0a61bae1-2607-4e42-b573-e74ac3edf09a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap634511f9-ce') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:44:36 user nova-compute[74247]: DEBUG os_vif [None req-ebd31c55-ffea-4259-9696-7e55e2766877 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:d2:f4,bridge_name='br-int',has_traffic_filtering=True,id=634511f9-ce96-4fe6-8bfc-51846e4dcb4f,network=Network(0a61bae1-2607-4e42-b573-e74ac3edf09a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap634511f9-ce') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:44:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap634511f9-ce, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:44:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b5a1f537-9f6e-4b38-b0b0-c25d4f42b1ad) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:44:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:36 user nova-compute[74247]: INFO os_vif [None req-ebd31c55-ffea-4259-9696-7e55e2766877 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:d2:f4,bridge_name='br-int',has_traffic_filtering=True,id=634511f9-ce96-4fe6-8bfc-51846e4dcb4f,network=Network(0a61bae1-2607-4e42-b573-e74ac3edf09a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap634511f9-ce')
Oct 16 18:44:36 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-ebd31c55-ffea-4259-9696-7e55e2766877 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Deleting instance files /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30_del
Oct 16 18:44:36 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-ebd31c55-ffea-4259-9696-7e55e2766877 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Deletion of /opt/stack/data/nova/instances/e37fbc27-3404-479a-be08-4d590391cf30_del complete
Oct 16 18:44:36 user nova-compute[74247]: INFO nova.compute.manager [None req-ebd31c55-ffea-4259-9696-7e55e2766877 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Took 0.68 seconds to destroy the instance on the hypervisor.
Oct 16 18:44:36 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-ebd31c55-ffea-4259-9696-7e55e2766877 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 18:44:36 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 18:44:36 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: e37fbc27-3404-479a-be08-4d590391cf30] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:44:37 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Took 0.41 seconds to deallocate network for instance.
Oct 16 18:44:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ebd31c55-ffea-4259-9696-7e55e2766877 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ebd31c55-ffea-4259-9696-7e55e2766877 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG nova.compute.manager [req-1f542efb-45c8-40a1-adb8-abb6c1488667 req-d599068f-3190-47b9-96b7-a6682fe6c447 service nova] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Received event network-vif-deleted-634511f9-ce96-4fe6-8bfc-51846e4dcb4f {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gNyfVvjZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:44:37 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:44:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:44:37 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:44:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:44:37 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:44:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54 -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d620906-5f5d-4df4-b928-c4680f2742c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 18:44:37 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54 -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[67747f6e-7e70-4500-9073-22ace9bb803d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54] added
Oct 16 18:44:37 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d45189-5dad-4283-aff4-b304934416ec]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab23ed8-09fb-4c28-abac-a62708cac20d]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gNyfVvjZ {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gNyfVvjZ" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bed39e-2d91-4784-9659-8ce9963f3544]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gNyfVvjZ'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[407274df-e74b-4f43-9f87-159a9960c3c0]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-ebd31c55-ffea-4259-9696-7e55e2766877 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a00b2f-d1e1-41e9-bee3-a52bb35fff38]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:44:37 user nova-compute[74247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)
Oct 16 18:44:37 user nova-compute[74247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)
Oct 16 18:44:37 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:44:37 user nova-compute[74247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)
Oct 16 18:44:37 user nova-compute[74247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)
Oct 16 18:44:37 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-ebd31c55-ffea-4259-9696-7e55e2766877 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54 -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ebd31c55-ffea-4259-9696-7e55e2766877 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.406s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4523a15-1f41-4089-ac22-3f8515542534]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54, portal: 172.16.0.220,3260]
Oct 16 18:44:37 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54, portal: 172.16.0.220,3260] successful.
Oct 16 18:44:37 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:37 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-ebd31c55-ffea-4259-9696-7e55e2766877 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Deleted allocations for instance e37fbc27-3404-479a-be08-4d590391cf30
Oct 16 18:44:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c457e7e6-bc3e-4942-bdd2-f3e4d8cb2886]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4087a351-a4af-4e70-beb0-23c2040a9b37]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:44:37 user nova-compute[74247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)
Oct 16 18:44:37 user nova-compute[74247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)
Oct 16 18:44:37 user nova-compute[74247]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54 (non-flash)
Oct 16 18:44:37 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:44:37 user nova-compute[74247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)
Oct 16 18:44:37 user nova-compute[74247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)
Oct 16 18:44:37 user nova-compute[74247]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54 (non-flash)
Oct 16 18:44:37 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] HCTL ('35', '-', '-', 0) found on session 35 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4bfff6e-4967-41db-a6d5-19dfb4005604]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gNyfVvjZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:44:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ebd31c55-ffea-4259-9696-7e55e2766877 tempest-ServerActionsTestOtherA-291765974 tempest-ServerActionsTestOtherA-291765974-project-member] Lock "e37fbc27-3404-479a-be08-4d590391cf30" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.707s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:44:38 user nova-compute[74247]: DEBUG nova.compute.manager [req-7518b39d-8f2f-4e4a-a5ef-67eaa591e32e req-31f9474e-73f9-44d2-a356-c627af7e582d service nova] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Received event network-vif-plugged-634511f9-ce96-4fe6-8bfc-51846e4dcb4f {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:44:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7518b39d-8f2f-4e4a-a5ef-67eaa591e32e req-31f9474e-73f9-44d2-a356-c627af7e582d service nova] Acquiring lock "e37fbc27-3404-479a-be08-4d590391cf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:44:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7518b39d-8f2f-4e4a-a5ef-67eaa591e32e req-31f9474e-73f9-44d2-a356-c627af7e582d service nova] Lock "e37fbc27-3404-479a-be08-4d590391cf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:44:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7518b39d-8f2f-4e4a-a5ef-67eaa591e32e req-31f9474e-73f9-44d2-a356-c627af7e582d service nova] Lock "e37fbc27-3404-479a-be08-4d590391cf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:44:38 user nova-compute[74247]: DEBUG nova.compute.manager [req-7518b39d-8f2f-4e4a-a5ef-67eaa591e32e req-31f9474e-73f9-44d2-a356-c627af7e582d service nova] [instance: e37fbc27-3404-479a-be08-4d590391cf30] No waiting events found dispatching network-vif-plugged-634511f9-ce96-4fe6-8bfc-51846e4dcb4f {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:44:38 user nova-compute[74247]: WARNING nova.compute.manager [req-7518b39d-8f2f-4e4a-a5ef-67eaa591e32e req-31f9474e-73f9-44d2-a356-c627af7e582d service nova] [instance: e37fbc27-3404-479a-be08-4d590391cf30] Received unexpected event network-vif-plugged-634511f9-ce96-4fe6-8bfc-51846e4dcb4f for instance with vm_state deleted and task_state None.
Oct 16 18:44:38 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:44:38 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23065323561363737', 'path': '/dev/sdd'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:44:38 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065323561363737', 'path': '/dev/sdd'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:44:38 user nova-compute[74247]: DEBUG nova.objects.instance [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lazy-loading 'flavor' on Instance uuid 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:44:38 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 18:44:38 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:44:38 user nova-compute[74247]:   <source dev="/dev/sdd"/>
Oct 16 18:44:38 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:44:38 user nova-compute[74247]:   <serial>b10a9068-67e0-40bf-bc3f-d77b2c17ea54</serial>
Oct 16 18:44:38 user nova-compute[74247]: </disk>
Oct 16 18:44:38 user nova-compute[74247]:  {{(pid=74247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 18:44:39 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:44:39 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:44:39 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] No VIF found with MAC fa:16:3e:d7:26:52, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:44:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f71d76db-f961-484b-a941-e0dbc5c9a87b tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.312s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:44:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-45274ef5-b515-4cfc-9f36-330d2f11a3f5 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Acquiring lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:44:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-45274ef5-b515-4cfc-9f36-330d2f11a3f5 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:44:42 user nova-compute[74247]: INFO nova.compute.manager [None req-45274ef5-b515-4cfc-9f36-330d2f11a3f5 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Detaching volume b10a9068-67e0-40bf-bc3f-d77b2c17ea54
Oct 16 18:44:42 user nova-compute[74247]: INFO nova.virt.block_device [None req-45274ef5-b515-4cfc-9f36-330d2f11a3f5 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Attempting to driver detach volume b10a9068-67e0-40bf-bc3f-d77b2c17ea54 from mountpoint /dev/vdb
Oct 16 18:44:42 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-45274ef5-b515-4cfc-9f36-330d2f11a3f5 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Attempting to detach device vdb from instance 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 from the persistent domain config. {{(pid=74247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 18:44:42 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-45274ef5-b515-4cfc-9f36-330d2f11a3f5 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 18:44:42 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:44:42 user nova-compute[74247]:   <source dev="/dev/sdd"/>
Oct 16 18:44:42 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:44:42 user nova-compute[74247]:   <serial>b10a9068-67e0-40bf-bc3f-d77b2c17ea54</serial>
Oct 16 18:44:42 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 18:44:42 user nova-compute[74247]: </disk>
Oct 16 18:44:42 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:44:42 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-45274ef5-b515-4cfc-9f36-330d2f11a3f5 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Successfully detached device vdb from instance 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 from the persistent domain config.
Oct 16 18:44:42 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-45274ef5-b515-4cfc-9f36-330d2f11a3f5 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 from the live domain config. {{(pid=74247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 18:44:42 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-45274ef5-b515-4cfc-9f36-330d2f11a3f5 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 18:44:42 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:44:42 user nova-compute[74247]:   <source dev="/dev/sdd"/>
Oct 16 18:44:42 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:44:42 user nova-compute[74247]:   <serial>b10a9068-67e0-40bf-bc3f-d77b2c17ea54</serial>
Oct 16 18:44:42 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 18:44:42 user nova-compute[74247]: </disk>
Oct 16 18:44:42 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:44:42 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-45274ef5-b515-4cfc-9f36-330d2f11a3f5 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 {{(pid=74247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 18:44:46 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:46 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5730eaa4-ffc3-4a84-b6a9-fcaa9f1836df tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "61819735-95a5-4543-915d-bd50c671002b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:44:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5730eaa4-ffc3-4a84-b6a9-fcaa9f1836df tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "61819735-95a5-4543-915d-bd50c671002b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:44:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5730eaa4-ffc3-4a84-b6a9-fcaa9f1836df tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "61819735-95a5-4543-915d-bd50c671002b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:44:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5730eaa4-ffc3-4a84-b6a9-fcaa9f1836df tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "61819735-95a5-4543-915d-bd50c671002b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:44:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5730eaa4-ffc3-4a84-b6a9-fcaa9f1836df tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "61819735-95a5-4543-915d-bd50c671002b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:44:56 user nova-compute[74247]: INFO nova.compute.manager [None req-5730eaa4-ffc3-4a84-b6a9-fcaa9f1836df tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: 61819735-95a5-4543-915d-bd50c671002b] Terminating instance
Oct 16 18:44:56 user nova-compute[74247]: DEBUG nova.compute.manager [None req-5730eaa4-ffc3-4a84-b6a9-fcaa9f1836df tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: 61819735-95a5-4543-915d-bd50c671002b] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 18:44:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:57 user nova-compute[74247]: DEBUG nova.compute.manager [req-b31e535d-6252-418d-b77e-9854c8e96b17 req-dd1d4522-1fb1-42be-8afe-5430420bc1a4 service nova] [instance: 61819735-95a5-4543-915d-bd50c671002b] Received event network-vif-unplugged-02f2319c-e3f4-48f2-98e7-0b97b42da9c0 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:44:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-b31e535d-6252-418d-b77e-9854c8e96b17 req-dd1d4522-1fb1-42be-8afe-5430420bc1a4 service nova] Acquiring lock "61819735-95a5-4543-915d-bd50c671002b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:44:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-b31e535d-6252-418d-b77e-9854c8e96b17 req-dd1d4522-1fb1-42be-8afe-5430420bc1a4 service nova] Lock "61819735-95a5-4543-915d-bd50c671002b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:44:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-b31e535d-6252-418d-b77e-9854c8e96b17 req-dd1d4522-1fb1-42be-8afe-5430420bc1a4 service nova] Lock "61819735-95a5-4543-915d-bd50c671002b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:44:57 user nova-compute[74247]: DEBUG nova.compute.manager [req-b31e535d-6252-418d-b77e-9854c8e96b17 req-dd1d4522-1fb1-42be-8afe-5430420bc1a4 service nova] [instance: 61819735-95a5-4543-915d-bd50c671002b] No waiting events found dispatching network-vif-unplugged-02f2319c-e3f4-48f2-98e7-0b97b42da9c0 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:44:57 user nova-compute[74247]: DEBUG nova.compute.manager [req-b31e535d-6252-418d-b77e-9854c8e96b17 req-dd1d4522-1fb1-42be-8afe-5430420bc1a4 service nova] [instance: 61819735-95a5-4543-915d-bd50c671002b] Received event network-vif-unplugged-02f2319c-e3f4-48f2-98e7-0b97b42da9c0 for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:44:57 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 61819735-95a5-4543-915d-bd50c671002b] Instance destroyed successfully.
Oct 16 18:44:57 user nova-compute[74247]: DEBUG nova.objects.instance [None req-5730eaa4-ffc3-4a84-b6a9-fcaa9f1836df tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lazy-loading 'resources' on Instance uuid 61819735-95a5-4543-915d-bd50c671002b {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:44:57 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-5730eaa4-ffc3-4a84-b6a9-fcaa9f1836df tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:41:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1801816855',display_name='tempest-AttachVolumeNegativeTest-server-1801816855',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1801816855',id=31,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKtr2HivV1IE/bw7qeFi+T2kA17TBbYndTh1M4sL20JL/aWNpUXUvzaMM9q8gMMaxn0CWMscDz3It7OHES7yEg0Jnxy0qDOC/R/759xRoWwBOypdHFoFnS96/dxAM9KFQ==',key_name='tempest-keypair-334338757',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:41:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c96ced9d4c0c474fbc7edeed6f73324a',ramdisk_id='',reservation_id='r-s24t6rw4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1731725928',owner_user_name='tempest-AttachVolumeNegativeTest-1731725928-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:41:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bd70613da1f489f86227655ff364795',uuid=61819735-95a5-4543-915d-bd50c671002b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "02f2319c-e3f4-48f2-98e7-0b97b42da9c0", "address": "fa:16:3e:c0:62:93", "network": {"id": "fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1988491128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96ced9d4c0c474fbc7edeed6f73324a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02f2319c-e3", "ovs_interfaceid": "02f2319c-e3f4-48f2-98e7-0b97b42da9c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:44:57 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-5730eaa4-ffc3-4a84-b6a9-fcaa9f1836df tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Converting VIF {"id": "02f2319c-e3f4-48f2-98e7-0b97b42da9c0", "address": "fa:16:3e:c0:62:93", "network": {"id": "fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1988491128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96ced9d4c0c474fbc7edeed6f73324a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02f2319c-e3", "ovs_interfaceid": "02f2319c-e3f4-48f2-98e7-0b97b42da9c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:44:57 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-5730eaa4-ffc3-4a84-b6a9-fcaa9f1836df tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:62:93,bridge_name='br-int',has_traffic_filtering=True,id=02f2319c-e3f4-48f2-98e7-0b97b42da9c0,network=Network(fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02f2319c-e3') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:44:57 user nova-compute[74247]: DEBUG os_vif [None req-5730eaa4-ffc3-4a84-b6a9-fcaa9f1836df tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:62:93,bridge_name='br-int',has_traffic_filtering=True,id=02f2319c-e3f4-48f2-98e7-0b97b42da9c0,network=Network(fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02f2319c-e3') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:44:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap02f2319c-e3, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:44:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7d73de72-0c9f-474a-a55c-ce198b63622a) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:44:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:57 user nova-compute[74247]: INFO os_vif [None req-5730eaa4-ffc3-4a84-b6a9-fcaa9f1836df tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:62:93,bridge_name='br-int',has_traffic_filtering=True,id=02f2319c-e3f4-48f2-98e7-0b97b42da9c0,network=Network(fbcc15b8-2a2f-4fc5-9c5d-3ec3158c7eb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02f2319c-e3')
Oct 16 18:44:57 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-5730eaa4-ffc3-4a84-b6a9-fcaa9f1836df tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: 61819735-95a5-4543-915d-bd50c671002b] Deleting instance files /opt/stack/data/nova/instances/61819735-95a5-4543-915d-bd50c671002b_del
Oct 16 18:44:57 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-5730eaa4-ffc3-4a84-b6a9-fcaa9f1836df tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: 61819735-95a5-4543-915d-bd50c671002b] Deletion of /opt/stack/data/nova/instances/61819735-95a5-4543-915d-bd50c671002b_del complete
Oct 16 18:44:57 user nova-compute[74247]: INFO nova.compute.manager [None req-5730eaa4-ffc3-4a84-b6a9-fcaa9f1836df tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] [instance: 61819735-95a5-4543-915d-bd50c671002b] Took 0.84 seconds to destroy the instance on the hypervisor.
Oct 16 18:44:57 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-5730eaa4-ffc3-4a84-b6a9-fcaa9f1836df tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 18:44:57 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: 61819735-95a5-4543-915d-bd50c671002b] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 18:44:57 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 61819735-95a5-4543-915d-bd50c671002b] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 18:44:58 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 61819735-95a5-4543-915d-bd50c671002b] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:44:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:44:58 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: 61819735-95a5-4543-915d-bd50c671002b] Took 0.60 seconds to deallocate network for instance.
Oct 16 18:44:58 user nova-compute[74247]: DEBUG nova.compute.manager [req-5325eda7-4b3c-47f6-97b8-19f6414706f0 req-ce74e3e7-aec0-43ae-8c08-5ec432202f44 service nova] [instance: 61819735-95a5-4543-915d-bd50c671002b] Received event network-vif-deleted-02f2319c-e3f4-48f2-98e7-0b97b42da9c0 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:44:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5730eaa4-ffc3-4a84-b6a9-fcaa9f1836df tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:44:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5730eaa4-ffc3-4a84-b6a9-fcaa9f1836df tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:44:58 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-5730eaa4-ffc3-4a84-b6a9-fcaa9f1836df tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:44:58 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-5730eaa4-ffc3-4a84-b6a9-fcaa9f1836df tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:44:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5730eaa4-ffc3-4a84-b6a9-fcaa9f1836df tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.322s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:44:58 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-5730eaa4-ffc3-4a84-b6a9-fcaa9f1836df tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Deleted allocations for instance 61819735-95a5-4543-915d-bd50c671002b
Oct 16 18:44:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5730eaa4-ffc3-4a84-b6a9-fcaa9f1836df tempest-AttachVolumeNegativeTest-1731725928 tempest-AttachVolumeNegativeTest-1731725928-project-member] Lock "61819735-95a5-4543-915d-bd50c671002b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.935s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:44:59 user nova-compute[74247]: DEBUG nova.compute.manager [req-b61f3597-33eb-4416-a13e-b94523936488 req-91436327-2229-4154-943f-0fd1db3bf027 service nova] [instance: 61819735-95a5-4543-915d-bd50c671002b] Received event network-vif-plugged-02f2319c-e3f4-48f2-98e7-0b97b42da9c0 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:44:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-b61f3597-33eb-4416-a13e-b94523936488 req-91436327-2229-4154-943f-0fd1db3bf027 service nova] Acquiring lock "61819735-95a5-4543-915d-bd50c671002b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:44:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-b61f3597-33eb-4416-a13e-b94523936488 req-91436327-2229-4154-943f-0fd1db3bf027 service nova] Lock "61819735-95a5-4543-915d-bd50c671002b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:44:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-b61f3597-33eb-4416-a13e-b94523936488 req-91436327-2229-4154-943f-0fd1db3bf027 service nova] Lock "61819735-95a5-4543-915d-bd50c671002b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:44:59 user nova-compute[74247]: DEBUG nova.compute.manager [req-b61f3597-33eb-4416-a13e-b94523936488 req-91436327-2229-4154-943f-0fd1db3bf027 service nova] [instance: 61819735-95a5-4543-915d-bd50c671002b] No waiting events found dispatching network-vif-plugged-02f2319c-e3f4-48f2-98e7-0b97b42da9c0 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:44:59 user nova-compute[74247]: WARNING nova.compute.manager [req-b61f3597-33eb-4416-a13e-b94523936488 req-91436327-2229-4154-943f-0fd1db3bf027 service nova] [instance: 61819735-95a5-4543-915d-bd50c671002b] Received unexpected event network-vif-plugged-02f2319c-e3f4-48f2-98e7-0b97b42da9c0 for instance with vm_state deleted and task_state None.
Oct 16 18:45:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:02 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:02 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-45274ef5-b515-4cfc-9f36-330d2f11a3f5 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 is timed out.
Oct 16 18:45:02 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-45274ef5-b515-4cfc-9f36-330d2f11a3f5 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Successfully detached device vdb from instance 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 from the live domain config.
Oct 16 18:45:02 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45274ef5-b515-4cfc-9f36-330d2f11a3f5 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 18:45:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45274ef5-b515-4cfc-9f36-330d2f11a3f5 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gNyfVvjZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:45:02 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-45274ef5-b515-4cfc-9f36-330d2f11a3f5 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:45:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-45274ef5-b515-4cfc-9f36-330d2f11a3f5 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:45:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-45274ef5-b515-4cfc-9f36-330d2f11a3f5 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:45:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:45:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:45:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[257f3e06-6e6f-41ba-9a0f-5b41c59b86eb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:45:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45274ef5-b515-4cfc-9f36-330d2f11a3f5 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 18:45:02 user nova-compute[74247]: No targets found.
Oct 16 18:45:02 user nova-compute[74247]: iSNS:
Oct 16 18:45:02 user nova-compute[74247]: No targets found.
Oct 16 18:45:02 user nova-compute[74247]: STATIC:
Oct 16 18:45:02 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54
Oct 16 18:45:02 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:45:02 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:45:02 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27
Oct 16 18:45:02 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:45:02 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:45:02 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc
Oct 16 18:45:02 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:45:02 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:45:02 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f
Oct 16 18:45:02 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:45:02 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:45:02 user nova-compute[74247]: FIRMWARE:
Oct 16 18:45:02 user nova-compute[74247]: No targets found.
Oct 16 18:45:02 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:45:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45274ef5-b515-4cfc-9f36-330d2f11a3f5 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 18:45:02 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 18:45:02 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 18:45:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45274ef5-b515-4cfc-9f36-330d2f11a3f5 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 18:45:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:45:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:45:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1493976d-27bd-4e58-9bc3-799589964312]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:45:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:45:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:45:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad461f15-4532-4330-a035-2dcc22bf0172]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:45:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45274ef5-b515-4cfc-9f36-330d2f11a3f5 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:45:02 user nova-compute[74247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)
Oct 16 18:45:02 user nova-compute[74247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)
Oct 16 18:45:02 user nova-compute[74247]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54 (non-flash)
Oct 16 18:45:02 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:45:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45274ef5-b515-4cfc-9f36-330d2f11a3f5 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:45:02 user nova-compute[74247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)
Oct 16 18:45:02 user nova-compute[74247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)
Oct 16 18:45:02 user nova-compute[74247]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54 (non-flash)
Oct 16 18:45:02 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:45:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45274ef5-b515-4cfc-9f36-330d2f11a3f5 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe0685dda20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54'): ({'sdd'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 18:45:02 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-45274ef5-b515-4cfc-9f36-330d2f11a3f5 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Removing single pathed devices sdd {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 18:45:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:45:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:45:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbc1381-f73b-4e5a-86fe-dd98e7b166b5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:45:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:45:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:45:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3942b9-aa6f-4829-9468-4e5d88810f19]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:45:02 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-45274ef5-b515-4cfc-9f36-330d2f11a3f5 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Flushing IO for device /dev/sdd {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 18:45:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:45:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:45:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03bdae9-ca67-48a0-97fb-34d9f2a83700]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:45:02 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-45274ef5-b515-4cfc-9f36-330d2f11a3f5 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 18:45:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:45:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:45:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8c00f7-80fe-4a04-b8da-8f4b6e0a06b3]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:45:02 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-45274ef5-b515-4cfc-9f36-330d2f11a3f5 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 18:45:02 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-45274ef5-b515-4cfc-9f36-330d2f11a3f5 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] SCSI volumes sdd have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 18:45:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45274ef5-b515-4cfc-9f36-330d2f11a3f5 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 18:45:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:45:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:45:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8959902e-4d7e-46dd-b642-81aca737417a]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:45:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45274ef5-b515-4cfc-9f36-330d2f11a3f5 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:45:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54 -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:45:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:45:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87432b1-5fab-4647-92f1-4f57a03b7762]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:45:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45274ef5-b515-4cfc-9f36-330d2f11a3f5 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54, portal: 172.16.0.220,3260]
Oct 16 18:45:03 user nova-compute[74247]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54, portal: 172.16.0.220,3260] successful.
Oct 16 18:45:03 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:45:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54 -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:45:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b10a9068-67e0-40bf-bc3f-d77b2c17ea54 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:45:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[559d0ba0-2f35-4c70-a575-7281764ead0d]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:45:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45274ef5-b515-4cfc-9f36-330d2f11a3f5 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:45:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-45274ef5-b515-4cfc-9f36-330d2f11a3f5 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:45:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45274ef5-b515-4cfc-9f36-330d2f11a3f5 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] <== disconnect_volume: return (304ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:45:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45274ef5-b515-4cfc-9f36-330d2f11a3f5 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 18:45:03 user nova-compute[74247]: DEBUG nova.objects.instance [None req-45274ef5-b515-4cfc-9f36-330d2f11a3f5 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lazy-loading 'flavor' on Instance uuid 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:45:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-45274ef5-b515-4cfc-9f36-330d2f11a3f5 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.814s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:45:04 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:45:04 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Cleaning up deleted instances {{(pid=74247) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 16 18:45:04 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] There are 0 instances to clean {{(pid=74247) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 16 18:45:05 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:45:05 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Cleaning up deleted instances with incomplete migration  {{(pid=74247) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 16 18:45:07 user nova-compute[74247]: INFO nova.compute.manager [None req-061ba56a-e504-417e-9ab8-e7ab7598bf10 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Unrescuing
Oct 16 18:45:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-061ba56a-e504-417e-9ab8-e7ab7598bf10 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquiring lock "refresh_cache-3dfec5ff-83b2-442e-af36-d17e959bf316" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:45:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-061ba56a-e504-417e-9ab8-e7ab7598bf10 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquired lock "refresh_cache-3dfec5ff-83b2-442e-af36-d17e959bf316" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:45:07 user nova-compute[74247]: DEBUG nova.network.neutron [None req-061ba56a-e504-417e-9ab8-e7ab7598bf10 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:45:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:07 user nova-compute[74247]: DEBUG nova.network.neutron [None req-061ba56a-e504-417e-9ab8-e7ab7598bf10 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Updating instance_info_cache with network_info: [{"id": "2ebee28a-6811-4631-a379-665b2ac7c97b", "address": "fa:16:3e:12:f3:44", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebee28a-68", "ovs_interfaceid": "2ebee28a-6811-4631-a379-665b2ac7c97b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:45:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-061ba56a-e504-417e-9ab8-e7ab7598bf10 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Releasing lock "refresh_cache-3dfec5ff-83b2-442e-af36-d17e959bf316" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:45:07 user nova-compute[74247]: DEBUG nova.objects.instance [None req-061ba56a-e504-417e-9ab8-e7ab7598bf10 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lazy-loading 'flavor' on Instance uuid 3dfec5ff-83b2-442e-af36-d17e959bf316 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:45:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:08 user nova-compute[74247]: DEBUG nova.compute.manager [req-24961d99-5e59-440c-99e2-0131d5b75d9d req-cfdbb090-c973-4746-9545-f589989915f1 service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Received event network-vif-unplugged-2ebee28a-6811-4631-a379-665b2ac7c97b {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:45:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-24961d99-5e59-440c-99e2-0131d5b75d9d req-cfdbb090-c973-4746-9545-f589989915f1 service nova] Acquiring lock "3dfec5ff-83b2-442e-af36-d17e959bf316-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:45:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-24961d99-5e59-440c-99e2-0131d5b75d9d req-cfdbb090-c973-4746-9545-f589989915f1 service nova] Lock "3dfec5ff-83b2-442e-af36-d17e959bf316-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:45:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-24961d99-5e59-440c-99e2-0131d5b75d9d req-cfdbb090-c973-4746-9545-f589989915f1 service nova] Lock "3dfec5ff-83b2-442e-af36-d17e959bf316-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:45:08 user nova-compute[74247]: DEBUG nova.compute.manager [req-24961d99-5e59-440c-99e2-0131d5b75d9d req-cfdbb090-c973-4746-9545-f589989915f1 service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] No waiting events found dispatching network-vif-unplugged-2ebee28a-6811-4631-a379-665b2ac7c97b {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:45:08 user nova-compute[74247]: WARNING nova.compute.manager [req-24961d99-5e59-440c-99e2-0131d5b75d9d req-cfdbb090-c973-4746-9545-f589989915f1 service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Received unexpected event network-vif-unplugged-2ebee28a-6811-4631-a379-665b2ac7c97b for instance with vm_state rescued and task_state unrescuing.
Oct 16 18:45:08 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Instance destroyed successfully.
Oct 16 18:45:08 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:45:08 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 18:45:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "refresh_cache-d775101d-53a1-48c7-af24-91480be6af61" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:45:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquired lock "refresh_cache-d775101d-53a1-48c7-af24-91480be6af61" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:45:08 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: d775101d-53a1-48c7-af24-91480be6af61] Forcefully refreshing network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 18:45:09 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: d775101d-53a1-48c7-af24-91480be6af61] Updating instance_info_cache with network_info: [{"id": "646f5b58-acad-402e-bdf5-e5bd423c69e8", "address": "fa:16:3e:45:9e:7d", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap646f5b58-ac", "ovs_interfaceid": "646f5b58-acad-402e-bdf5-e5bd423c69e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:45:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Releasing lock "refresh_cache-d775101d-53a1-48c7-af24-91480be6af61" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:45:09 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: d775101d-53a1-48c7-af24-91480be6af61] Updated the network info_cache for instance {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 18:45:09 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:45:09 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:45:09 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:45:09 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:45:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:10 user nova-compute[74247]: DEBUG nova.compute.manager [req-16e3fab7-099e-4277-b7ed-0f37ce48ecfb req-606ea8be-ddf8-40e6-b2d9-b305502adbdf service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Received event network-vif-plugged-2ebee28a-6811-4631-a379-665b2ac7c97b {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:45:10 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-16e3fab7-099e-4277-b7ed-0f37ce48ecfb req-606ea8be-ddf8-40e6-b2d9-b305502adbdf service nova] Acquiring lock "3dfec5ff-83b2-442e-af36-d17e959bf316-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:45:10 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-16e3fab7-099e-4277-b7ed-0f37ce48ecfb req-606ea8be-ddf8-40e6-b2d9-b305502adbdf service nova] Lock "3dfec5ff-83b2-442e-af36-d17e959bf316-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:45:10 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-16e3fab7-099e-4277-b7ed-0f37ce48ecfb req-606ea8be-ddf8-40e6-b2d9-b305502adbdf service nova] Lock "3dfec5ff-83b2-442e-af36-d17e959bf316-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:45:10 user nova-compute[74247]: DEBUG nova.compute.manager [req-16e3fab7-099e-4277-b7ed-0f37ce48ecfb req-606ea8be-ddf8-40e6-b2d9-b305502adbdf service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] No waiting events found dispatching network-vif-plugged-2ebee28a-6811-4631-a379-665b2ac7c97b {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:45:10 user nova-compute[74247]: WARNING nova.compute.manager [req-16e3fab7-099e-4277-b7ed-0f37ce48ecfb req-606ea8be-ddf8-40e6-b2d9-b305502adbdf service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Received unexpected event network-vif-plugged-2ebee28a-6811-4631-a379-665b2ac7c97b for instance with vm_state rescued and task_state unrescuing.
Oct 16 18:45:10 user nova-compute[74247]: DEBUG nova.compute.manager [req-16e3fab7-099e-4277-b7ed-0f37ce48ecfb req-606ea8be-ddf8-40e6-b2d9-b305502adbdf service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Received event network-vif-plugged-2ebee28a-6811-4631-a379-665b2ac7c97b {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:45:10 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-16e3fab7-099e-4277-b7ed-0f37ce48ecfb req-606ea8be-ddf8-40e6-b2d9-b305502adbdf service nova] Acquiring lock "3dfec5ff-83b2-442e-af36-d17e959bf316-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:45:10 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-16e3fab7-099e-4277-b7ed-0f37ce48ecfb req-606ea8be-ddf8-40e6-b2d9-b305502adbdf service nova] Lock "3dfec5ff-83b2-442e-af36-d17e959bf316-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:45:10 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-16e3fab7-099e-4277-b7ed-0f37ce48ecfb req-606ea8be-ddf8-40e6-b2d9-b305502adbdf service nova] Lock "3dfec5ff-83b2-442e-af36-d17e959bf316-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:45:10 user nova-compute[74247]: DEBUG nova.compute.manager [req-16e3fab7-099e-4277-b7ed-0f37ce48ecfb req-606ea8be-ddf8-40e6-b2d9-b305502adbdf service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] No waiting events found dispatching network-vif-plugged-2ebee28a-6811-4631-a379-665b2ac7c97b {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:45:10 user nova-compute[74247]: WARNING nova.compute.manager [req-16e3fab7-099e-4277-b7ed-0f37ce48ecfb req-606ea8be-ddf8-40e6-b2d9-b305502adbdf service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Received unexpected event network-vif-plugged-2ebee28a-6811-4631-a379-665b2ac7c97b for instance with vm_state rescued and task_state unrescuing.
Oct 16 18:45:10 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:10 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:10 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:45:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:12 user nova-compute[74247]: DEBUG nova.compute.manager [None req-061ba56a-e504-417e-9ab8-e7ab7598bf10 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:45:12 user nova-compute[74247]: DEBUG nova.compute.manager [req-8664e9c4-e645-4f9c-ad2f-5ec8e650def2 req-449fb5f4-28e6-4368-8853-0d2c44b0631c service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Received event network-vif-plugged-2ebee28a-6811-4631-a379-665b2ac7c97b {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:45:12 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-8664e9c4-e645-4f9c-ad2f-5ec8e650def2 req-449fb5f4-28e6-4368-8853-0d2c44b0631c service nova] Acquiring lock "3dfec5ff-83b2-442e-af36-d17e959bf316-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:45:12 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-8664e9c4-e645-4f9c-ad2f-5ec8e650def2 req-449fb5f4-28e6-4368-8853-0d2c44b0631c service nova] Lock "3dfec5ff-83b2-442e-af36-d17e959bf316-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:45:12 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-8664e9c4-e645-4f9c-ad2f-5ec8e650def2 req-449fb5f4-28e6-4368-8853-0d2c44b0631c service nova] Lock "3dfec5ff-83b2-442e-af36-d17e959bf316-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:45:12 user nova-compute[74247]: DEBUG nova.compute.manager [req-8664e9c4-e645-4f9c-ad2f-5ec8e650def2 req-449fb5f4-28e6-4368-8853-0d2c44b0631c service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] No waiting events found dispatching network-vif-plugged-2ebee28a-6811-4631-a379-665b2ac7c97b {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:45:12 user nova-compute[74247]: WARNING nova.compute.manager [req-8664e9c4-e645-4f9c-ad2f-5ec8e650def2 req-449fb5f4-28e6-4368-8853-0d2c44b0631c service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Received unexpected event network-vif-plugged-2ebee28a-6811-4631-a379-665b2ac7c97b for instance with vm_state active and task_state None.
Oct 16 18:45:12 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:13 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:45:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:45:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:45:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:45:13 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 18:45:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:45:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:45:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:45:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:45:14 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:45:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d69a8d-98d5-4044-987a-f376aedfbe2a/disk.rescue --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:45:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d69a8d-98d5-4044-987a-f376aedfbe2a/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:45:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d69a8d-98d5-4044-987a-f376aedfbe2a/disk.rescue --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:45:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d69a8d-98d5-4044-987a-f376aedfbe2a/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:45:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:45:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:45:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:45:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:45:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:45:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:45:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:45:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:45:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:45:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:45:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:45:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:45:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:45:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:45:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:45:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:45:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:45:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:45:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:45:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:45:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:45:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:45:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfd28a0-528c-434a-8850-aa7d29c1e738/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:45:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfd28a0-528c-434a-8850-aa7d29c1e738/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:45:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfd28a0-528c-434a-8850-aa7d29c1e738/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:45:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfd28a0-528c-434a-8850-aa7d29c1e738/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:45:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:45:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:45:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:45:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:45:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075e943e-8f32-4be9-8d02-30584668c34b/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:45:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075e943e-8f32-4be9-8d02-30584668c34b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:45:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075e943e-8f32-4be9-8d02-30584668c34b/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:45:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075e943e-8f32-4be9-8d02-30584668c34b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:45:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:17 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:45:17 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:45:17 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=7762MB free_disk=24.765907287597656GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 18:45:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:45:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:45:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance cddf4842-1c25-4cc8-914e-af30849e4d6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:45:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 958af87e-69d0-4da1-8fcf-90e0f275d62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:45:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance d775101d-53a1-48c7-af24-91480be6af61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:45:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 7dcc08e9-7439-436b-8d9f-facaf04e22c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:45:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:45:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 220798e9-aea4-4c79-9737-175ab0598e7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:45:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 3dfec5ff-83b2-442e-af36-d17e959bf316 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:45:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 25d69a8d-98d5-4044-987a-f376aedfbe2a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:45:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 0dfd28a0-528c-434a-8850-aa7d29c1e738 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:45:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 075e943e-8f32-4be9-8d02-30584668c34b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:45:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 18:45:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 18:45:18 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Refreshing inventories for resource provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 16 18:45:18 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Updating ProviderTree inventory for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 16 18:45:18 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Updating inventory in ProviderTree for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 16 18:45:18 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Refreshing aggregate associations for resource provider 7b8a7b7b-c686-4162-903b-700fbc4d7273, aggregates: None {{(pid=74247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 16 18:45:18 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Refreshing trait associations for resource provider 7b8a7b7b-c686-4162-903b-700fbc4d7273, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=74247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 16 18:45:18 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:45:18 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:45:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 18:45:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.581s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:45:18 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:45:18 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:45:18 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 18:45:18 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:45:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:29 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:37 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:37 user nova-compute[74247]: DEBUG nova.compute.manager [req-f8ba42f3-f7c2-499b-b8ad-26dfb780900a req-41aa45f5-58a4-43ce-a533-422a798ef772 service nova] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Received event network-changed-88e3804c-7596-4dd5-b478-fda70e1f9ebb {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:45:37 user nova-compute[74247]: DEBUG nova.compute.manager [req-f8ba42f3-f7c2-499b-b8ad-26dfb780900a req-41aa45f5-58a4-43ce-a533-422a798ef772 service nova] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Refreshing instance network info cache due to event network-changed-88e3804c-7596-4dd5-b478-fda70e1f9ebb. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:45:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f8ba42f3-f7c2-499b-b8ad-26dfb780900a req-41aa45f5-58a4-43ce-a533-422a798ef772 service nova] Acquiring lock "refresh_cache-0dfd28a0-528c-434a-8850-aa7d29c1e738" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:45:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f8ba42f3-f7c2-499b-b8ad-26dfb780900a req-41aa45f5-58a4-43ce-a533-422a798ef772 service nova] Acquired lock "refresh_cache-0dfd28a0-528c-434a-8850-aa7d29c1e738" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:45:37 user nova-compute[74247]: DEBUG nova.network.neutron [req-f8ba42f3-f7c2-499b-b8ad-26dfb780900a req-41aa45f5-58a4-43ce-a533-422a798ef772 service nova] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Refreshing network info cache for port 88e3804c-7596-4dd5-b478-fda70e1f9ebb {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:45:37 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:38 user nova-compute[74247]: DEBUG nova.network.neutron [req-f8ba42f3-f7c2-499b-b8ad-26dfb780900a req-41aa45f5-58a4-43ce-a533-422a798ef772 service nova] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Updated VIF entry in instance network info cache for port 88e3804c-7596-4dd5-b478-fda70e1f9ebb. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:45:38 user nova-compute[74247]: DEBUG nova.network.neutron [req-f8ba42f3-f7c2-499b-b8ad-26dfb780900a req-41aa45f5-58a4-43ce-a533-422a798ef772 service nova] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Updating instance_info_cache with network_info: [{"id": "88e3804c-7596-4dd5-b478-fda70e1f9ebb", "address": "fa:16:3e:cd:31:0f", "network": {"id": "12aae3c0-8171-4d91-a65c-d823d49c6d8c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1631066218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e98ba2d44d0c401cb6a51f3d7ea3db59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88e3804c-75", "ovs_interfaceid": "88e3804c-7596-4dd5-b478-fda70e1f9ebb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:45:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f8ba42f3-f7c2-499b-b8ad-26dfb780900a req-41aa45f5-58a4-43ce-a533-422a798ef772 service nova] Releasing lock "refresh_cache-0dfd28a0-528c-434a-8850-aa7d29c1e738" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:45:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquiring lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:45:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:45:40 user nova-compute[74247]: DEBUG nova.compute.manager [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 18:45:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:45:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:45:40 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:45:40 user nova-compute[74247]: INFO nova.compute.claims [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Claim successful on node user
Oct 16 18:45:40 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:45:40 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:45:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.447s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:45:40 user nova-compute[74247]: DEBUG nova.compute.manager [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 18:45:40 user nova-compute[74247]: DEBUG nova.compute.manager [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 18:45:40 user nova-compute[74247]: DEBUG nova.network.neutron [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 18:45:40 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 18:45:40 user nova-compute[74247]: DEBUG nova.compute.manager [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 18:45:40 user nova-compute[74247]: DEBUG nova.policy [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '82c71a4cbbf8436dbfdc43bb4db65ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6d2ba688434391b03a9f3320a360de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 18:45:41 user nova-compute[74247]: DEBUG nova.compute.manager [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 18:45:41 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:45:41 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Creating image(s)
Oct 16 18:45:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquiring lock "/opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:45:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "/opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:45:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "/opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:45:41 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:45:41 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.190s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:45:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquiring lock "37399febbd18f60b85fd0f833558f6a3539ab231" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:45:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:45:41 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:45:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:41 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.180s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:45:41 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk 1073741824 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:45:41 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk 1073741824" returned: 0 in 0.046s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:45:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:45:41 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:45:41 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.192s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:45:41 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk. size=1073741824 {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 18:45:41 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:45:41 user nova-compute[74247]: DEBUG nova.network.neutron [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Successfully created port: 77ca2d19-f745-461d-9f32-8d42469a6bfc {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:45:41 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:45:41 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Cannot resize image /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk to a smaller size. {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 18:45:41 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 18:45:41 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Ensure instance console log exists: /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:45:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:45:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:45:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG nova.network.neutron [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Successfully updated port: 77ca2d19-f745-461d-9f32-8d42469a6bfc {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquiring lock "refresh_cache-fa1dea31-91bc-4fda-8fb2-638628b66b3f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquired lock "refresh_cache-fa1dea31-91bc-4fda-8fb2-638628b66b3f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG nova.network.neutron [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG nova.compute.manager [req-e4cc10b0-5635-4c2f-b1e2-5ff77a14c41b req-3f158e6e-a1eb-4ea8-aef6-f295d20ece62 service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Received event network-changed-77ca2d19-f745-461d-9f32-8d42469a6bfc {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG nova.compute.manager [req-e4cc10b0-5635-4c2f-b1e2-5ff77a14c41b req-3f158e6e-a1eb-4ea8-aef6-f295d20ece62 service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Refreshing instance network info cache due to event network-changed-77ca2d19-f745-461d-9f32-8d42469a6bfc. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e4cc10b0-5635-4c2f-b1e2-5ff77a14c41b req-3f158e6e-a1eb-4ea8-aef6-f295d20ece62 service nova] Acquiring lock "refresh_cache-fa1dea31-91bc-4fda-8fb2-638628b66b3f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG nova.network.neutron [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG nova.network.neutron [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Updating instance_info_cache with network_info: [{"id": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "address": "fa:16:3e:ea:29:cf", "network": {"id": "14ee32da-d0e3-499f-bd47-721e882b2a57", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-700103883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6d2ba688434391b03a9f3320a360de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77ca2d19-f7", "ovs_interfaceid": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Releasing lock "refresh_cache-fa1dea31-91bc-4fda-8fb2-638628b66b3f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG nova.compute.manager [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Instance network_info: |[{"id": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "address": "fa:16:3e:ea:29:cf", "network": {"id": "14ee32da-d0e3-499f-bd47-721e882b2a57", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-700103883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6d2ba688434391b03a9f3320a360de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77ca2d19-f7", "ovs_interfaceid": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e4cc10b0-5635-4c2f-b1e2-5ff77a14c41b req-3f158e6e-a1eb-4ea8-aef6-f295d20ece62 service nova] Acquired lock "refresh_cache-fa1dea31-91bc-4fda-8fb2-638628b66b3f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG nova.network.neutron [req-e4cc10b0-5635-4c2f-b1e2-5ff77a14c41b req-3f158e6e-a1eb-4ea8-aef6-f295d20ece62 service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Refreshing network info cache for port 77ca2d19-f745-461d-9f32-8d42469a6bfc {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Start _get_guest_xml network_info=[{"id": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "address": "fa:16:3e:ea:29:cf", "network": {"id": "14ee32da-d0e3-499f-bd47-721e882b2a57", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-700103883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6d2ba688434391b03a9f3320a360de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77ca2d19-f7", "ovs_interfaceid": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': '83126bb1-29f5-42fe-8620-72ab0797f776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:45:42 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:45:42 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:45:42 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-659707189',display_name='tempest-AttachVolumeTestJSON-server-659707189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-659707189',id=35,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZNyKtinECwQEZs0xtAfyopWvuS0WcUALkCCqBfwO2f0LJvjht0xSFVuqtR8GKspliYK+mf0usf7lCpwlqMVzv4m9PsNpIcERNXyS11WNd3vgzvglK2WxbIqiF5MPTBmg==',key_name='tempest-keypair-1281053187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d6d2ba688434391b03a9f3320a360de',ramdisk_id='',reservation_id='r-lyeae496',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1409761379',owner_user_name='tempest-AttachVolumeTestJSON-1409761379-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:45:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82c71a4cbbf8436dbfdc43bb4db65ef1',uuid=fa1dea31-91bc-4fda-8fb2-638628b66b3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "address": "fa:16:3e:ea:29:cf", "network": {"id": "14ee32da-d0e3-499f-bd47-721e882b2a57", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-700103883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6d2ba688434391b03a9f3320a360de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77ca2d19-f7", "ovs_interfaceid": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Converting VIF {"id": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "address": "fa:16:3e:ea:29:cf", "network": {"id": "14ee32da-d0e3-499f-bd47-721e882b2a57", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-700103883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6d2ba688434391b03a9f3320a360de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77ca2d19-f7", "ovs_interfaceid": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:29:cf,bridge_name='br-int',has_traffic_filtering=True,id=77ca2d19-f745-461d-9f32-8d42469a6bfc,network=Network(14ee32da-d0e3-499f-bd47-721e882b2a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77ca2d19-f7') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG nova.objects.instance [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lazy-loading 'pci_devices' on Instance uuid fa1dea31-91bc-4fda-8fb2-638628b66b3f {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:45:42 user nova-compute[74247]:   <uuid>fa1dea31-91bc-4fda-8fb2-638628b66b3f</uuid>
Oct 16 18:45:42 user nova-compute[74247]:   <name>instance-00000023</name>
Oct 16 18:45:42 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:45:42 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:45:42 user nova-compute[74247]:   <metadata>
Oct 16 18:45:42 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:45:42 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:45:42 user nova-compute[74247]:       <nova:name>tempest-AttachVolumeTestJSON-server-659707189</nova:name>
Oct 16 18:45:42 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:45:42</nova:creationTime>
Oct 16 18:45:42 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:45:42 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:45:42 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:45:42 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:45:42 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:45:42 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:45:42 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:45:42 user nova-compute[74247]:       <nova:owner>
Oct 16 18:45:42 user nova-compute[74247]:         <nova:user uuid="82c71a4cbbf8436dbfdc43bb4db65ef1">tempest-AttachVolumeTestJSON-1409761379-project-member</nova:user>
Oct 16 18:45:42 user nova-compute[74247]:         <nova:project uuid="1d6d2ba688434391b03a9f3320a360de">tempest-AttachVolumeTestJSON-1409761379</nova:project>
Oct 16 18:45:42 user nova-compute[74247]:       </nova:owner>
Oct 16 18:45:42 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:45:42 user nova-compute[74247]:       <nova:ports>
Oct 16 18:45:42 user nova-compute[74247]:         <nova:port uuid="77ca2d19-f745-461d-9f32-8d42469a6bfc">
Oct 16 18:45:42 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 16 18:45:42 user nova-compute[74247]:         </nova:port>
Oct 16 18:45:42 user nova-compute[74247]:       </nova:ports>
Oct 16 18:45:42 user nova-compute[74247]:     </nova:instance>
Oct 16 18:45:42 user nova-compute[74247]:   </metadata>
Oct 16 18:45:42 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:45:42 user nova-compute[74247]:     <system>
Oct 16 18:45:42 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:45:42 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:45:42 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:45:42 user nova-compute[74247]:       <entry name="serial">fa1dea31-91bc-4fda-8fb2-638628b66b3f</entry>
Oct 16 18:45:42 user nova-compute[74247]:       <entry name="uuid">fa1dea31-91bc-4fda-8fb2-638628b66b3f</entry>
Oct 16 18:45:42 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:45:42 user nova-compute[74247]:     </system>
Oct 16 18:45:42 user nova-compute[74247]:   </sysinfo>
Oct 16 18:45:42 user nova-compute[74247]:   <os>
Oct 16 18:45:42 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:45:42 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:45:42 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:45:42 user nova-compute[74247]:   </os>
Oct 16 18:45:42 user nova-compute[74247]:   <features>
Oct 16 18:45:42 user nova-compute[74247]:     <acpi/>
Oct 16 18:45:42 user nova-compute[74247]:     <apic/>
Oct 16 18:45:42 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:45:42 user nova-compute[74247]:   </features>
Oct 16 18:45:42 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:45:42 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:45:42 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:45:42 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:45:42 user nova-compute[74247]:   </clock>
Oct 16 18:45:42 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:45:42 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:45:42 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:45:42 user nova-compute[74247]:   </cpu>
Oct 16 18:45:42 user nova-compute[74247]:   <devices>
Oct 16 18:45:42 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:45:42 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:45:42 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk"/>
Oct 16 18:45:42 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:45:42 user nova-compute[74247]:     </disk>
Oct 16 18:45:42 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:45:42 user nova-compute[74247]:       <mac address="fa:16:3e:ea:29:cf"/>
Oct 16 18:45:42 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:45:42 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:45:42 user nova-compute[74247]:       <target dev="tap77ca2d19-f7"/>
Oct 16 18:45:42 user nova-compute[74247]:     </interface>
Oct 16 18:45:42 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:45:42 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/console.log" append="off"/>
Oct 16 18:45:42 user nova-compute[74247]:     </serial>
Oct 16 18:45:42 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:45:42 user nova-compute[74247]:     <video>
Oct 16 18:45:42 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:45:42 user nova-compute[74247]:     </video>
Oct 16 18:45:42 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:45:42 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:45:42 user nova-compute[74247]:     </rng>
Oct 16 18:45:42 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:45:42 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:45:42 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:45:42 user nova-compute[74247]:     </memballoon>
Oct 16 18:45:42 user nova-compute[74247]:   </devices>
Oct 16 18:45:42 user nova-compute[74247]: </domain>
Oct 16 18:45:42 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-659707189',display_name='tempest-AttachVolumeTestJSON-server-659707189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-659707189',id=35,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZNyKtinECwQEZs0xtAfyopWvuS0WcUALkCCqBfwO2f0LJvjht0xSFVuqtR8GKspliYK+mf0usf7lCpwlqMVzv4m9PsNpIcERNXyS11WNd3vgzvglK2WxbIqiF5MPTBmg==',key_name='tempest-keypair-1281053187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d6d2ba688434391b03a9f3320a360de',ramdisk_id='',reservation_id='r-lyeae496',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1409761379',owner_user_name='tempest-AttachVolumeTestJSON-1409761379-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:45:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82c71a4cbbf8436dbfdc43bb4db65ef1',uuid=fa1dea31-91bc-4fda-8fb2-638628b66b3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "address": "fa:16:3e:ea:29:cf", "network": {"id": "14ee32da-d0e3-499f-bd47-721e882b2a57", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-700103883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6d2ba688434391b03a9f3320a360de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77ca2d19-f7", "ovs_interfaceid": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Converting VIF {"id": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "address": "fa:16:3e:ea:29:cf", "network": {"id": "14ee32da-d0e3-499f-bd47-721e882b2a57", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-700103883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6d2ba688434391b03a9f3320a360de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77ca2d19-f7", "ovs_interfaceid": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:29:cf,bridge_name='br-int',has_traffic_filtering=True,id=77ca2d19-f745-461d-9f32-8d42469a6bfc,network=Network(14ee32da-d0e3-499f-bd47-721e882b2a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77ca2d19-f7') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG os_vif [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:29:cf,bridge_name='br-int',has_traffic_filtering=True,id=77ca2d19-f745-461d-9f32-8d42469a6bfc,network=Network(14ee32da-d0e3-499f-bd47-721e882b2a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77ca2d19-f7') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c5760a63-86e1-5b15-ad02-28cb0ebebcde', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap77ca2d19-f7, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap77ca2d19-f7, col_values=(('qos', UUID('ea4dc382-a084-44be-9a40-232ea5c24733')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap77ca2d19-f7, col_values=(('external_ids', {'iface-id': '77ca2d19-f745-461d-9f32-8d42469a6bfc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:29:cf', 'vm-uuid': 'fa1dea31-91bc-4fda-8fb2-638628b66b3f'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:42 user nova-compute[74247]: INFO os_vif [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:29:cf,bridge_name='br-int',has_traffic_filtering=True,id=77ca2d19-f745-461d-9f32-8d42469a6bfc,network=Network(14ee32da-d0e3-499f-bd47-721e882b2a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77ca2d19-f7')
Oct 16 18:45:42 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:45:42 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] No VIF found with MAC fa:16:3e:ea:29:cf, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:45:43 user nova-compute[74247]: DEBUG nova.network.neutron [req-e4cc10b0-5635-4c2f-b1e2-5ff77a14c41b req-3f158e6e-a1eb-4ea8-aef6-f295d20ece62 service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Updated VIF entry in instance network info cache for port 77ca2d19-f745-461d-9f32-8d42469a6bfc. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:45:43 user nova-compute[74247]: DEBUG nova.network.neutron [req-e4cc10b0-5635-4c2f-b1e2-5ff77a14c41b req-3f158e6e-a1eb-4ea8-aef6-f295d20ece62 service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Updating instance_info_cache with network_info: [{"id": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "address": "fa:16:3e:ea:29:cf", "network": {"id": "14ee32da-d0e3-499f-bd47-721e882b2a57", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-700103883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6d2ba688434391b03a9f3320a360de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77ca2d19-f7", "ovs_interfaceid": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:45:43 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e4cc10b0-5635-4c2f-b1e2-5ff77a14c41b req-3f158e6e-a1eb-4ea8-aef6-f295d20ece62 service nova] Releasing lock "refresh_cache-fa1dea31-91bc-4fda-8fb2-638628b66b3f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:45:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Acquiring lock "0dfd28a0-528c-434a-8850-aa7d29c1e738" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:45:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Lock "0dfd28a0-528c-434a-8850-aa7d29c1e738" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:45:44 user nova-compute[74247]: DEBUG nova.objects.instance [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Lazy-loading 'flavor' on Instance uuid 0dfd28a0-528c-434a-8850-aa7d29c1e738 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:45:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Lock "0dfd28a0-528c-434a-8850-aa7d29c1e738" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:45:44 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:44 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:44 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Acquiring lock "0dfd28a0-528c-434a-8850-aa7d29c1e738" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:45:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Lock "0dfd28a0-528c-434a-8850-aa7d29c1e738" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:45:44 user nova-compute[74247]: INFO nova.compute.manager [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Attaching volume 53088408-54d5-436b-aa84-f92e2f01da5a to /dev/vdb
Oct 16 18:45:44 user nova-compute[74247]: DEBUG os_brick.utils [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:45:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:45:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:45:44 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4837dd60-ed69-4929-92ae-7fe323cb7a11]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:45:44 user nova-compute[74247]: DEBUG nova.compute.manager [req-cf497db4-14fb-432a-b8bb-3e140e5d3171 req-70a12892-0c6d-4f5f-854d-93be812ddefe service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Received event network-vif-plugged-77ca2d19-f745-461d-9f32-8d42469a6bfc {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:45:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-cf497db4-14fb-432a-b8bb-3e140e5d3171 req-70a12892-0c6d-4f5f-854d-93be812ddefe service nova] Acquiring lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:45:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-cf497db4-14fb-432a-b8bb-3e140e5d3171 req-70a12892-0c6d-4f5f-854d-93be812ddefe service nova] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:45:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-cf497db4-14fb-432a-b8bb-3e140e5d3171 req-70a12892-0c6d-4f5f-854d-93be812ddefe service nova] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:45:44 user nova-compute[74247]: DEBUG nova.compute.manager [req-cf497db4-14fb-432a-b8bb-3e140e5d3171 req-70a12892-0c6d-4f5f-854d-93be812ddefe service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] No waiting events found dispatching network-vif-plugged-77ca2d19-f745-461d-9f32-8d42469a6bfc {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:45:44 user nova-compute[74247]: WARNING nova.compute.manager [req-cf497db4-14fb-432a-b8bb-3e140e5d3171 req-70a12892-0c6d-4f5f-854d-93be812ddefe service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Received unexpected event network-vif-plugged-77ca2d19-f745-461d-9f32-8d42469a6bfc for instance with vm_state building and task_state spawning.
Oct 16 18:45:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:45:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:45:44 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c686e24c-0088-4326-9ec1-34f353a2c9ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:45:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:45:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:45:44 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2241ad14-bc20-4b55-8960-bc96d11ed8e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:45:44 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0defa0-4b70-4199-9130-6bcc5576fd80]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:45:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:45:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:45:44 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 18:45:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:45:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:45:44 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 18:45:44 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6592a0-900f-4115-b08a-1f9371287e30]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:45:44 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 18:45:44 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 18:45:44 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 18:45:44 user nova-compute[74247]: DEBUG os_brick.utils [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:45:44 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Updating existing volume attachment record: 748a673d-3e64-41bc-994e-ae5fa00c63cf {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 18:45:44 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:44 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:46 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:46 user nova-compute[74247]: DEBUG nova.compute.manager [req-d2f6302a-ea90-425f-8b31-9181488ba68c req-b7913e10-8b9f-4ef2-b539-356f49eebbf7 service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Received event network-vif-plugged-77ca2d19-f745-461d-9f32-8d42469a6bfc {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:45:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d2f6302a-ea90-425f-8b31-9181488ba68c req-b7913e10-8b9f-4ef2-b539-356f49eebbf7 service nova] Acquiring lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:45:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d2f6302a-ea90-425f-8b31-9181488ba68c req-b7913e10-8b9f-4ef2-b539-356f49eebbf7 service nova] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:45:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d2f6302a-ea90-425f-8b31-9181488ba68c req-b7913e10-8b9f-4ef2-b539-356f49eebbf7 service nova] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:45:46 user nova-compute[74247]: DEBUG nova.compute.manager [req-d2f6302a-ea90-425f-8b31-9181488ba68c req-b7913e10-8b9f-4ef2-b539-356f49eebbf7 service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] No waiting events found dispatching network-vif-plugged-77ca2d19-f745-461d-9f32-8d42469a6bfc {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:45:46 user nova-compute[74247]: WARNING nova.compute.manager [req-d2f6302a-ea90-425f-8b31-9181488ba68c req-b7913e10-8b9f-4ef2-b539-356f49eebbf7 service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Received unexpected event network-vif-plugged-77ca2d19-f745-461d-9f32-8d42469a6bfc for instance with vm_state building and task_state spawning.
Oct 16 18:45:46 user nova-compute[74247]: DEBUG nova.compute.manager [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:45:46 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:45:46 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Instance spawned successfully.
Oct 16 18:45:46 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 18:45:46 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:45:46 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:45:46 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:45:46 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:45:46 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:45:46 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:45:46 user nova-compute[74247]: INFO nova.compute.manager [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Took 5.63 seconds to spawn the instance on the hypervisor.
Oct 16 18:45:46 user nova-compute[74247]: DEBUG nova.compute.manager [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:45:46 user nova-compute[74247]: INFO nova.compute.manager [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Took 6.42 seconds to build instance.
Oct 16 18:45:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-62e0ee17-e864-4cf4-9c16-1b0ba6c8e26c tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.556s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:45:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:50 user nova-compute[74247]: DEBUG nova.compute.manager [req-870d3f9d-ea94-4baf-8baa-b1789b7ec0c1 req-93c91ef4-8cf2-4f35-a21f-21cf323e4e30 service nova] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Received event network-changed-5297bf76-2e6f-4240-819b-12b1594b0fe2 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:45:50 user nova-compute[74247]: DEBUG nova.compute.manager [req-870d3f9d-ea94-4baf-8baa-b1789b7ec0c1 req-93c91ef4-8cf2-4f35-a21f-21cf323e4e30 service nova] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Refreshing instance network info cache due to event network-changed-5297bf76-2e6f-4240-819b-12b1594b0fe2. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:45:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-870d3f9d-ea94-4baf-8baa-b1789b7ec0c1 req-93c91ef4-8cf2-4f35-a21f-21cf323e4e30 service nova] Acquiring lock "refresh_cache-075e943e-8f32-4be9-8d02-30584668c34b" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:45:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-870d3f9d-ea94-4baf-8baa-b1789b7ec0c1 req-93c91ef4-8cf2-4f35-a21f-21cf323e4e30 service nova] Acquired lock "refresh_cache-075e943e-8f32-4be9-8d02-30584668c34b" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:45:50 user nova-compute[74247]: DEBUG nova.network.neutron [req-870d3f9d-ea94-4baf-8baa-b1789b7ec0c1 req-93c91ef4-8cf2-4f35-a21f-21cf323e4e30 service nova] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Refreshing network info cache for port 5297bf76-2e6f-4240-819b-12b1594b0fe2 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:45:50 user nova-compute[74247]: DEBUG nova.network.neutron [req-870d3f9d-ea94-4baf-8baa-b1789b7ec0c1 req-93c91ef4-8cf2-4f35-a21f-21cf323e4e30 service nova] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Updated VIF entry in instance network info cache for port 5297bf76-2e6f-4240-819b-12b1594b0fe2. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:45:50 user nova-compute[74247]: DEBUG nova.network.neutron [req-870d3f9d-ea94-4baf-8baa-b1789b7ec0c1 req-93c91ef4-8cf2-4f35-a21f-21cf323e4e30 service nova] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Updating instance_info_cache with network_info: [{"id": "5297bf76-2e6f-4240-819b-12b1594b0fe2", "address": "fa:16:3e:fd:a6:1e", "network": {"id": "88a1b265-5360-4362-90bc-3506f805688f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-620663417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5204c1aec5764c298a206429645eb268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5297bf76-2e", "ovs_interfaceid": "5297bf76-2e6f-4240-819b-12b1594b0fe2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:45:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-870d3f9d-ea94-4baf-8baa-b1789b7ec0c1 req-93c91ef4-8cf2-4f35-a21f-21cf323e4e30 service nova] Releasing lock "refresh_cache-075e943e-8f32-4be9-8d02-30584668c34b" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:45:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:52 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-43ad8bcc-81fb-4bf9-924d-8492361f5201 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquiring lock "075e943e-8f32-4be9-8d02-30584668c34b" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:45:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-43ad8bcc-81fb-4bf9-924d-8492361f5201 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "075e943e-8f32-4be9-8d02-30584668c34b" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:45:56 user nova-compute[74247]: INFO nova.compute.manager [None req-43ad8bcc-81fb-4bf9-924d-8492361f5201 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Shelving
Oct 16 18:45:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:57 user nova-compute[74247]: DEBUG nova.compute.manager [req-63d4ad0e-cf8b-466d-881c-2f94d8278d00 req-d8ba7737-ac58-4340-8dca-69328d815f59 service nova] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Received event network-vif-unplugged-5297bf76-2e6f-4240-819b-12b1594b0fe2 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:45:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-63d4ad0e-cf8b-466d-881c-2f94d8278d00 req-d8ba7737-ac58-4340-8dca-69328d815f59 service nova] Acquiring lock "075e943e-8f32-4be9-8d02-30584668c34b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:45:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-63d4ad0e-cf8b-466d-881c-2f94d8278d00 req-d8ba7737-ac58-4340-8dca-69328d815f59 service nova] Lock "075e943e-8f32-4be9-8d02-30584668c34b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:45:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-63d4ad0e-cf8b-466d-881c-2f94d8278d00 req-d8ba7737-ac58-4340-8dca-69328d815f59 service nova] Lock "075e943e-8f32-4be9-8d02-30584668c34b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:45:57 user nova-compute[74247]: DEBUG nova.compute.manager [req-63d4ad0e-cf8b-466d-881c-2f94d8278d00 req-d8ba7737-ac58-4340-8dca-69328d815f59 service nova] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] No waiting events found dispatching network-vif-unplugged-5297bf76-2e6f-4240-819b-12b1594b0fe2 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:45:57 user nova-compute[74247]: WARNING nova.compute.manager [req-63d4ad0e-cf8b-466d-881c-2f94d8278d00 req-d8ba7737-ac58-4340-8dca-69328d815f59 service nova] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Received unexpected event network-vif-unplugged-5297bf76-2e6f-4240-819b-12b1594b0fe2 for instance with vm_state active and task_state shelving.
Oct 16 18:45:57 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Instance destroyed successfully.
Oct 16 18:45:57 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-43ad8bcc-81fb-4bf9-924d-8492361f5201 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Beginning cold snapshot process
Oct 16 18:45:57 user nova-compute[74247]: DEBUG nova.privsep.utils [None req-43ad8bcc-81fb-4bf9-924d-8492361f5201 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74247) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 18:45:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-43ad8bcc-81fb-4bf9-924d-8492361f5201 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/075e943e-8f32-4be9-8d02-30584668c34b/disk /opt/stack/data/nova/instances/snapshots/tmp9sheafu7/e72ff13dc7744216b318dd6bd8f1f974 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:45:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:45:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-43ad8bcc-81fb-4bf9-924d-8492361f5201 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/075e943e-8f32-4be9-8d02-30584668c34b/disk /opt/stack/data/nova/instances/snapshots/tmp9sheafu7/e72ff13dc7744216b318dd6bd8f1f974" returned: 0 in 0.626s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:45:58 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-43ad8bcc-81fb-4bf9-924d-8492361f5201 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Snapshot extracted, beginning image upload
Oct 16 18:45:59 user nova-compute[74247]: DEBUG nova.compute.manager [req-1cedb36e-0df0-4362-98c7-398adf85c15b req-8152c5b3-1deb-41c9-83cf-0324538bc3e8 service nova] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Received event network-vif-plugged-5297bf76-2e6f-4240-819b-12b1594b0fe2 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:45:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1cedb36e-0df0-4362-98c7-398adf85c15b req-8152c5b3-1deb-41c9-83cf-0324538bc3e8 service nova] Acquiring lock "075e943e-8f32-4be9-8d02-30584668c34b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:45:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1cedb36e-0df0-4362-98c7-398adf85c15b req-8152c5b3-1deb-41c9-83cf-0324538bc3e8 service nova] Lock "075e943e-8f32-4be9-8d02-30584668c34b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:45:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1cedb36e-0df0-4362-98c7-398adf85c15b req-8152c5b3-1deb-41c9-83cf-0324538bc3e8 service nova] Lock "075e943e-8f32-4be9-8d02-30584668c34b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:45:59 user nova-compute[74247]: DEBUG nova.compute.manager [req-1cedb36e-0df0-4362-98c7-398adf85c15b req-8152c5b3-1deb-41c9-83cf-0324538bc3e8 service nova] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] No waiting events found dispatching network-vif-plugged-5297bf76-2e6f-4240-819b-12b1594b0fe2 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:45:59 user nova-compute[74247]: WARNING nova.compute.manager [req-1cedb36e-0df0-4362-98c7-398adf85c15b req-8152c5b3-1deb-41c9-83cf-0324538bc3e8 service nova] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Received unexpected event network-vif-plugged-5297bf76-2e6f-4240-819b-12b1594b0fe2 for instance with vm_state active and task_state shelving_image_uploading.
Oct 16 18:46:01 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-43ad8bcc-81fb-4bf9-924d-8492361f5201 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Snapshot image upload complete
Oct 16 18:46:01 user nova-compute[74247]: DEBUG nova.compute.manager [None req-43ad8bcc-81fb-4bf9-924d-8492361f5201 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:46:01 user nova-compute[74247]: INFO nova.compute.manager [None req-43ad8bcc-81fb-4bf9-924d-8492361f5201 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Shelve offloading
Oct 16 18:46:01 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Instance destroyed successfully.
Oct 16 18:46:01 user nova-compute[74247]: DEBUG nova.compute.manager [None req-43ad8bcc-81fb-4bf9-924d-8492361f5201 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:46:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-43ad8bcc-81fb-4bf9-924d-8492361f5201 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquiring lock "refresh_cache-075e943e-8f32-4be9-8d02-30584668c34b" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:46:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-43ad8bcc-81fb-4bf9-924d-8492361f5201 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquired lock "refresh_cache-075e943e-8f32-4be9-8d02-30584668c34b" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:46:01 user nova-compute[74247]: DEBUG nova.network.neutron [None req-43ad8bcc-81fb-4bf9-924d-8492361f5201 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:46:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:46:01 user nova-compute[74247]: DEBUG nova.network.neutron [None req-43ad8bcc-81fb-4bf9-924d-8492361f5201 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Updating instance_info_cache with network_info: [{"id": "5297bf76-2e6f-4240-819b-12b1594b0fe2", "address": "fa:16:3e:fd:a6:1e", "network": {"id": "88a1b265-5360-4362-90bc-3506f805688f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-620663417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5204c1aec5764c298a206429645eb268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5297bf76-2e", "ovs_interfaceid": "5297bf76-2e6f-4240-819b-12b1594b0fe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:46:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-43ad8bcc-81fb-4bf9-924d-8492361f5201 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Releasing lock "refresh_cache-075e943e-8f32-4be9-8d02-30584668c34b" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:46:02 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Instance destroyed successfully.
Oct 16 18:46:02 user nova-compute[74247]: DEBUG nova.objects.instance [None req-43ad8bcc-81fb-4bf9-924d-8492361f5201 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lazy-loading 'resources' on Instance uuid 075e943e-8f32-4be9-8d02-30584668c34b {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-43ad8bcc-81fb-4bf9-924d-8492361f5201 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:43:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-246997190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-246997190',id=34,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIhrr+elGpfgxpvDxCYEg3TwFRm9479AxAze0wrEYlT36ZJD5juZ2Mgda1vXnfPW9D0eHXznG5lqW6nzlxRtDM9vSOVC+rVIUMbi26juPUHNHhtCjNg+9DevghtLuUxhQ==',key_name='tempest-keypair-873631301',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:44:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5204c1aec5764c298a206429645eb268',ramdisk_id='',reservation_id='r-7whme9zu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-537076068',owner_user_name='tempest-AttachVolumeShelveTestJSON-537076068-project-member',shelved_at='2023-10-16T18:46:01.297850',shelved_host='user',shelved_image_id='f01fb2f8-6382-4556-ab94-79b6d3ee1c10'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:45:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bda4c43b45347be96b152caba47b07d',uuid=075e943e-8f32-4be9-8d02-30584668c34b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "5297bf76-2e6f-4240-819b-12b1594b0fe2", "address": "fa:16:3e:fd:a6:1e", "network": {"id": "88a1b265-5360-4362-90bc-3506f805688f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-620663417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5204c1aec5764c298a206429645eb268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5297bf76-2e", "ovs_interfaceid": "5297bf76-2e6f-4240-819b-12b1594b0fe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-43ad8bcc-81fb-4bf9-924d-8492361f5201 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Converting VIF {"id": "5297bf76-2e6f-4240-819b-12b1594b0fe2", "address": "fa:16:3e:fd:a6:1e", "network": {"id": "88a1b265-5360-4362-90bc-3506f805688f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-620663417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5204c1aec5764c298a206429645eb268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5297bf76-2e", "ovs_interfaceid": "5297bf76-2e6f-4240-819b-12b1594b0fe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-43ad8bcc-81fb-4bf9-924d-8492361f5201 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:a6:1e,bridge_name='br-int',has_traffic_filtering=True,id=5297bf76-2e6f-4240-819b-12b1594b0fe2,network=Network(88a1b265-5360-4362-90bc-3506f805688f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5297bf76-2e') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG os_vif [None req-43ad8bcc-81fb-4bf9-924d-8492361f5201 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:a6:1e,bridge_name='br-int',has_traffic_filtering=True,id=5297bf76-2e6f-4240-819b-12b1594b0fe2,network=Network(88a1b265-5360-4362-90bc-3506f805688f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5297bf76-2e') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5297bf76-2e, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG nova.compute.manager [req-4b85e6f2-7db6-474d-899b-94bcc2eaec29 req-28bba402-9ff0-4a27-8b4e-153097372336 service nova] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Received event network-changed-5297bf76-2e6f-4240-819b-12b1594b0fe2 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG nova.compute.manager [req-4b85e6f2-7db6-474d-899b-94bcc2eaec29 req-28bba402-9ff0-4a27-8b4e-153097372336 service nova] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Refreshing instance network info cache due to event network-changed-5297bf76-2e6f-4240-819b-12b1594b0fe2. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4b85e6f2-7db6-474d-899b-94bcc2eaec29 req-28bba402-9ff0-4a27-8b4e-153097372336 service nova] Acquiring lock "refresh_cache-075e943e-8f32-4be9-8d02-30584668c34b" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4b85e6f2-7db6-474d-899b-94bcc2eaec29 req-28bba402-9ff0-4a27-8b4e-153097372336 service nova] Acquired lock "refresh_cache-075e943e-8f32-4be9-8d02-30584668c34b" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG nova.network.neutron [req-4b85e6f2-7db6-474d-899b-94bcc2eaec29 req-28bba402-9ff0-4a27-8b4e-153097372336 service nova] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Refreshing network info cache for port 5297bf76-2e6f-4240-819b-12b1594b0fe2 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=380a5c0e-ba61-475c-b0f5-7480a10c187b) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:46:02 user nova-compute[74247]: INFO os_vif [None req-43ad8bcc-81fb-4bf9-924d-8492361f5201 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:a6:1e,bridge_name='br-int',has_traffic_filtering=True,id=5297bf76-2e6f-4240-819b-12b1594b0fe2,network=Network(88a1b265-5360-4362-90bc-3506f805688f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5297bf76-2e')
Oct 16 18:46:02 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-43ad8bcc-81fb-4bf9-924d-8492361f5201 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Deleting instance files /opt/stack/data/nova/instances/075e943e-8f32-4be9-8d02-30584668c34b_del
Oct 16 18:46:02 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-43ad8bcc-81fb-4bf9-924d-8492361f5201 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Deletion of /opt/stack/data/nova/instances/075e943e-8f32-4be9-8d02-30584668c34b_del complete
Oct 16 18:46:02 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-43ad8bcc-81fb-4bf9-924d-8492361f5201 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Deleted allocations for instance 075e943e-8f32-4be9-8d02-30584668c34b
Oct 16 18:46:02 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YvJptiCA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:46:02 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:46:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:46:02 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:46:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:46:02 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:46:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-43ad8bcc-81fb-4bf9-924d-8492361f5201 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-43ad8bcc-81fb-4bf9-924d-8492361f5201 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG nova.objects.instance [None req-43ad8bcc-81fb-4bf9-924d-8492361f5201 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lazy-loading 'numa_topology' on Instance uuid 075e943e-8f32-4be9-8d02-30584668c34b {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG nova.objects.base [None req-43ad8bcc-81fb-4bf9-924d-8492361f5201 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Object Instance<075e943e-8f32-4be9-8d02-30584668c34b> lazy-loaded attributes: resources,numa_topology {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[770899f5-30a3-46dd-b759-f2bfc0d39593]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 18:46:02 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1890718-726e-4f02-9704-fbf8b731d131]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a] added
Oct 16 18:46:02 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e091fa-0c07-4bc8-bc03-b6294eb51ff3]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[181cb618-6f80-47b9-bcff-10e73df99e7b]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YvJptiCA {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YvJptiCA" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f696fd8-3c77-4221-82ad-d05ad5c1a36f]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YvJptiCA'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf637403-3277-467d-8e48-cfecf755fe97]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fe01ea-7efe-4f2e-985a-037adae52944]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:46:02 user nova-compute[74247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)
Oct 16 18:46:02 user nova-compute[74247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)
Oct 16 18:46:02 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:46:02 user nova-compute[74247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)
Oct 16 18:46:02 user nova-compute[74247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)
Oct 16 18:46:02 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0150ad-4666-4ee0-999c-e5fa25c005ac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a, portal: 172.16.0.220,3260]
Oct 16 18:46:02 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a, portal: 172.16.0.220,3260] successful.
Oct 16 18:46:02 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:46:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:46:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:46:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f50dcb-5ee2-435c-8339-a947d4560912]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:46:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:46:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:46:03 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-43ad8bcc-81fb-4bf9-924d-8492361f5201 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:46:03 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-43ad8bcc-81fb-4bf9-924d-8492361f5201 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:46:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:46:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d66643d-5b11-422e-9fbc-5c7e4edd154d]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:46:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:46:03 user nova-compute[74247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)
Oct 16 18:46:03 user nova-compute[74247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)
Oct 16 18:46:03 user nova-compute[74247]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a (non-flash)
Oct 16 18:46:03 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:46:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:46:03 user nova-compute[74247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)
Oct 16 18:46:03 user nova-compute[74247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)
Oct 16 18:46:03 user nova-compute[74247]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a (non-flash)
Oct 16 18:46:03 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:46:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:46:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:46:03 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] HCTL ('35', '-', '-', 0) found on session 36 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:46:03 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:46:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:46:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-43ad8bcc-81fb-4bf9-924d-8492361f5201 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.349s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:46:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:46:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c5f682-ae9e-4f2f-967b-3660ed301cd3]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:46:03 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: None {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:46:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-43ad8bcc-81fb-4bf9-924d-8492361f5201 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "075e943e-8f32-4be9-8d02-30584668c34b" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.357s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:46:03 user nova-compute[74247]: DEBUG nova.network.neutron [req-4b85e6f2-7db6-474d-899b-94bcc2eaec29 req-28bba402-9ff0-4a27-8b4e-153097372336 service nova] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Updated VIF entry in instance network info cache for port 5297bf76-2e6f-4240-819b-12b1594b0fe2. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:46:03 user nova-compute[74247]: DEBUG nova.network.neutron [req-4b85e6f2-7db6-474d-899b-94bcc2eaec29 req-28bba402-9ff0-4a27-8b4e-153097372336 service nova] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Updating instance_info_cache with network_info: [{"id": "5297bf76-2e6f-4240-819b-12b1594b0fe2", "address": "fa:16:3e:fd:a6:1e", "network": {"id": "88a1b265-5360-4362-90bc-3506f805688f", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-620663417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5204c1aec5764c298a206429645eb268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap5297bf76-2e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:46:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4b85e6f2-7db6-474d-899b-94bcc2eaec29 req-28bba402-9ff0-4a27-8b4e-153097372336 service nova] Releasing lock "refresh_cache-075e943e-8f32-4be9-8d02-30584668c34b" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:46:04 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:46:04 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YvJptiCA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:46:04 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:46:04 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '26334323437353233', 'path': '/dev/sdd'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:46:04 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334323437353233', 'path': '/dev/sdd'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:46:04 user nova-compute[74247]: DEBUG nova.objects.instance [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Lazy-loading 'flavor' on Instance uuid 0dfd28a0-528c-434a-8850-aa7d29c1e738 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:46:04 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 18:46:04 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:46:04 user nova-compute[74247]:   <source dev="/dev/sdd"/>
Oct 16 18:46:04 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:46:04 user nova-compute[74247]:   <serial>53088408-54d5-436b-aa84-f92e2f01da5a</serial>
Oct 16 18:46:04 user nova-compute[74247]: </disk>
Oct 16 18:46:04 user nova-compute[74247]:  {{(pid=74247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 18:46:04 user nova-compute[74247]: INFO nova.compute.manager [None req-b93a5656-1841-46bf-87f9-9a49c098ec72 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Unrescuing
Oct 16 18:46:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-b93a5656-1841-46bf-87f9-9a49c098ec72 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "refresh_cache-25d69a8d-98d5-4044-987a-f376aedfbe2a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:46:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-b93a5656-1841-46bf-87f9-9a49c098ec72 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquired lock "refresh_cache-25d69a8d-98d5-4044-987a-f376aedfbe2a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:46:04 user nova-compute[74247]: DEBUG nova.network.neutron [None req-b93a5656-1841-46bf-87f9-9a49c098ec72 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:46:04 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:46:04 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:46:04 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] No VIF found with MAC fa:16:3e:cd:31:0f, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:46:04 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:46:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-cce677a5-b057-4195-891d-e5201be255ab tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Lock "0dfd28a0-528c-434a-8850-aa7d29c1e738" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.383s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:46:04 user nova-compute[74247]: DEBUG nova.network.neutron [None req-b93a5656-1841-46bf-87f9-9a49c098ec72 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Updating instance_info_cache with network_info: [{"id": "1e2af952-39b5-4add-9542-925c9babc88c", "address": "fa:16:3e:32:37:ce", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2af952-39", "ovs_interfaceid": "1e2af952-39b5-4add-9542-925c9babc88c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:46:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-b93a5656-1841-46bf-87f9-9a49c098ec72 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Releasing lock "refresh_cache-25d69a8d-98d5-4044-987a-f376aedfbe2a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:46:04 user nova-compute[74247]: DEBUG nova.objects.instance [None req-b93a5656-1841-46bf-87f9-9a49c098ec72 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lazy-loading 'flavor' on Instance uuid 25d69a8d-98d5-4044-987a-f376aedfbe2a {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:46:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:46:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:46:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:46:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:46:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-22413f2d-3cfa-45a2-9aad-571596cdb7d8 req-04b5a035-1f14-464e-a73a-41b6d0effe1b service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Received event network-vif-unplugged-1e2af952-39b5-4add-9542-925c9babc88c {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:46:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-22413f2d-3cfa-45a2-9aad-571596cdb7d8 req-04b5a035-1f14-464e-a73a-41b6d0effe1b service nova] Acquiring lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:46:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-22413f2d-3cfa-45a2-9aad-571596cdb7d8 req-04b5a035-1f14-464e-a73a-41b6d0effe1b service nova] Lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:46:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-22413f2d-3cfa-45a2-9aad-571596cdb7d8 req-04b5a035-1f14-464e-a73a-41b6d0effe1b service nova] Lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:46:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-22413f2d-3cfa-45a2-9aad-571596cdb7d8 req-04b5a035-1f14-464e-a73a-41b6d0effe1b service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] No waiting events found dispatching network-vif-unplugged-1e2af952-39b5-4add-9542-925c9babc88c {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:46:05 user nova-compute[74247]: WARNING nova.compute.manager [req-22413f2d-3cfa-45a2-9aad-571596cdb7d8 req-04b5a035-1f14-464e-a73a-41b6d0effe1b service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Received unexpected event network-vif-unplugged-1e2af952-39b5-4add-9542-925c9babc88c for instance with vm_state rescued and task_state unrescuing.
Oct 16 18:46:05 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Instance destroyed successfully.
Oct 16 18:46:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:46:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-2649a91b-24ff-4266-8e0a-0279d9e05576 tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Acquiring lock "0dfd28a0-528c-434a-8850-aa7d29c1e738" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:46:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-2649a91b-24ff-4266-8e0a-0279d9e05576 tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Lock "0dfd28a0-528c-434a-8850-aa7d29c1e738" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:46:06 user nova-compute[74247]: INFO nova.compute.manager [None req-2649a91b-24ff-4266-8e0a-0279d9e05576 tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Detaching volume 53088408-54d5-436b-aa84-f92e2f01da5a
Oct 16 18:46:06 user nova-compute[74247]: INFO nova.virt.block_device [None req-2649a91b-24ff-4266-8e0a-0279d9e05576 tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Attempting to driver detach volume 53088408-54d5-436b-aa84-f92e2f01da5a from mountpoint /dev/vdb
Oct 16 18:46:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-2649a91b-24ff-4266-8e0a-0279d9e05576 tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Attempting to detach device vdb from instance 0dfd28a0-528c-434a-8850-aa7d29c1e738 from the persistent domain config. {{(pid=74247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 18:46:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-2649a91b-24ff-4266-8e0a-0279d9e05576 tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 18:46:06 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:46:06 user nova-compute[74247]:   <source dev="/dev/sdd"/>
Oct 16 18:46:06 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:46:06 user nova-compute[74247]:   <serial>53088408-54d5-436b-aa84-f92e2f01da5a</serial>
Oct 16 18:46:06 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 18:46:06 user nova-compute[74247]: </disk>
Oct 16 18:46:06 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:46:06 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-2649a91b-24ff-4266-8e0a-0279d9e05576 tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Successfully detached device vdb from instance 0dfd28a0-528c-434a-8850-aa7d29c1e738 from the persistent domain config.
Oct 16 18:46:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-2649a91b-24ff-4266-8e0a-0279d9e05576 tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0dfd28a0-528c-434a-8850-aa7d29c1e738 from the live domain config. {{(pid=74247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 18:46:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-2649a91b-24ff-4266-8e0a-0279d9e05576 tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 18:46:06 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:46:06 user nova-compute[74247]:   <source dev="/dev/sdd"/>
Oct 16 18:46:06 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:46:06 user nova-compute[74247]:   <serial>53088408-54d5-436b-aa84-f92e2f01da5a</serial>
Oct 16 18:46:06 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 18:46:06 user nova-compute[74247]: </disk>
Oct 16 18:46:06 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:46:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:46:07 user nova-compute[74247]: DEBUG nova.compute.manager [req-9b394c9e-b671-4e82-a1bf-99ee2eecfbc8 req-7f5ea6c2-62d7-41ca-9403-7de376f1c7eb service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Received event network-vif-plugged-1e2af952-39b5-4add-9542-925c9babc88c {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:46:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9b394c9e-b671-4e82-a1bf-99ee2eecfbc8 req-7f5ea6c2-62d7-41ca-9403-7de376f1c7eb service nova] Acquiring lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:46:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9b394c9e-b671-4e82-a1bf-99ee2eecfbc8 req-7f5ea6c2-62d7-41ca-9403-7de376f1c7eb service nova] Lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:46:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9b394c9e-b671-4e82-a1bf-99ee2eecfbc8 req-7f5ea6c2-62d7-41ca-9403-7de376f1c7eb service nova] Lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:46:07 user nova-compute[74247]: DEBUG nova.compute.manager [req-9b394c9e-b671-4e82-a1bf-99ee2eecfbc8 req-7f5ea6c2-62d7-41ca-9403-7de376f1c7eb service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] No waiting events found dispatching network-vif-plugged-1e2af952-39b5-4add-9542-925c9babc88c {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:46:07 user nova-compute[74247]: WARNING nova.compute.manager [req-9b394c9e-b671-4e82-a1bf-99ee2eecfbc8 req-7f5ea6c2-62d7-41ca-9403-7de376f1c7eb service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Received unexpected event network-vif-plugged-1e2af952-39b5-4add-9542-925c9babc88c for instance with vm_state rescued and task_state unrescuing.
Oct 16 18:46:07 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-2649a91b-24ff-4266-8e0a-0279d9e05576 tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0dfd28a0-528c-434a-8850-aa7d29c1e738 {{(pid=74247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 18:46:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:46:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:46:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:46:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:46:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:46:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:46:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:46:08 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:46:09 user nova-compute[74247]: DEBUG nova.compute.manager [req-1b8fd491-ce2c-4ad7-aea6-18fa863c1675 req-f8a603ad-5c5a-419c-b97c-5aeecd5cf418 service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Received event network-vif-plugged-1e2af952-39b5-4add-9542-925c9babc88c {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:46:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1b8fd491-ce2c-4ad7-aea6-18fa863c1675 req-f8a603ad-5c5a-419c-b97c-5aeecd5cf418 service nova] Acquiring lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:46:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1b8fd491-ce2c-4ad7-aea6-18fa863c1675 req-f8a603ad-5c5a-419c-b97c-5aeecd5cf418 service nova] Lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:46:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1b8fd491-ce2c-4ad7-aea6-18fa863c1675 req-f8a603ad-5c5a-419c-b97c-5aeecd5cf418 service nova] Lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:46:09 user nova-compute[74247]: DEBUG nova.compute.manager [req-1b8fd491-ce2c-4ad7-aea6-18fa863c1675 req-f8a603ad-5c5a-419c-b97c-5aeecd5cf418 service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] No waiting events found dispatching network-vif-plugged-1e2af952-39b5-4add-9542-925c9babc88c {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:46:09 user nova-compute[74247]: WARNING nova.compute.manager [req-1b8fd491-ce2c-4ad7-aea6-18fa863c1675 req-f8a603ad-5c5a-419c-b97c-5aeecd5cf418 service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Received unexpected event network-vif-plugged-1e2af952-39b5-4add-9542-925c9babc88c for instance with vm_state rescued and task_state unrescuing.
Oct 16 18:46:09 user nova-compute[74247]: DEBUG nova.compute.manager [req-1b8fd491-ce2c-4ad7-aea6-18fa863c1675 req-f8a603ad-5c5a-419c-b97c-5aeecd5cf418 service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Received event network-vif-plugged-1e2af952-39b5-4add-9542-925c9babc88c {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:46:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1b8fd491-ce2c-4ad7-aea6-18fa863c1675 req-f8a603ad-5c5a-419c-b97c-5aeecd5cf418 service nova] Acquiring lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:46:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1b8fd491-ce2c-4ad7-aea6-18fa863c1675 req-f8a603ad-5c5a-419c-b97c-5aeecd5cf418 service nova] Lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:46:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1b8fd491-ce2c-4ad7-aea6-18fa863c1675 req-f8a603ad-5c5a-419c-b97c-5aeecd5cf418 service nova] Lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:46:09 user nova-compute[74247]: DEBUG nova.compute.manager [req-1b8fd491-ce2c-4ad7-aea6-18fa863c1675 req-f8a603ad-5c5a-419c-b97c-5aeecd5cf418 service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] No waiting events found dispatching network-vif-plugged-1e2af952-39b5-4add-9542-925c9babc88c {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:46:09 user nova-compute[74247]: WARNING nova.compute.manager [req-1b8fd491-ce2c-4ad7-aea6-18fa863c1675 req-f8a603ad-5c5a-419c-b97c-5aeecd5cf418 service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Received unexpected event network-vif-plugged-1e2af952-39b5-4add-9542-925c9babc88c for instance with vm_state rescued and task_state unrescuing.
Oct 16 18:46:09 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:46:09 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 18:46:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "refresh_cache-7dcc08e9-7439-436b-8d9f-facaf04e22c1" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:46:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquired lock "refresh_cache-7dcc08e9-7439-436b-8d9f-facaf04e22c1" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:46:09 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Forcefully refreshing network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 18:46:10 user nova-compute[74247]: DEBUG nova.compute.manager [None req-b93a5656-1841-46bf-87f9-9a49c098ec72 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:46:10 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Updating instance_info_cache with network_info: [{"id": "b7a0865a-62eb-4517-83ba-eb30ff219e50", "address": "fa:16:3e:47:07:5d", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a0865a-62", "ovs_interfaceid": "b7a0865a-62eb-4517-83ba-eb30ff219e50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:46:10 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Releasing lock "refresh_cache-7dcc08e9-7439-436b-8d9f-facaf04e22c1" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:46:10 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Updated the network info_cache for instance {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 18:46:10 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:46:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:46:11 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:46:11 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:46:12 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:46:12 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:46:13 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:46:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:46:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:46:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:46:13 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 18:46:13 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:46:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:46:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:46:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:46:14 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:46:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:46:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:46:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:46:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:46:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:46:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:46:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:46:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:46:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:46:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:46:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:46:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:46:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:46:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:46:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:46:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:46:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:46:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:46:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:46:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:46:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:46:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:46:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:46:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:46:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:46:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:46:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:46:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfd28a0-528c-434a-8850-aa7d29c1e738/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:46:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfd28a0-528c-434a-8850-aa7d29c1e738/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:46:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfd28a0-528c-434a-8850-aa7d29c1e738/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:46:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfd28a0-528c-434a-8850-aa7d29c1e738/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:46:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:46:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:46:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:46:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:46:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:46:18 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:46:18 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:46:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=7756MB free_disk=24.713573455810547GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 18:46:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:46:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:46:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance cddf4842-1c25-4cc8-914e-af30849e4d6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:46:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 958af87e-69d0-4da1-8fcf-90e0f275d62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:46:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance d775101d-53a1-48c7-af24-91480be6af61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:46:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 7dcc08e9-7439-436b-8d9f-facaf04e22c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:46:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:46:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 220798e9-aea4-4c79-9737-175ab0598e7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:46:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 3dfec5ff-83b2-442e-af36-d17e959bf316 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:46:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 25d69a8d-98d5-4044-987a-f376aedfbe2a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:46:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 0dfd28a0-528c-434a-8850-aa7d29c1e738 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:46:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance fa1dea31-91bc-4fda-8fb2-638628b66b3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:46:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 18:46:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 18:46:18 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:46:18 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:46:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 18:46:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.501s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:46:19 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:46:19 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:46:19 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 18:46:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:46:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:46:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:46:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:46:27 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-2649a91b-24ff-4266-8e0a-0279d9e05576 tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0dfd28a0-528c-434a-8850-aa7d29c1e738 is timed out.
Oct 16 18:46:27 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-2649a91b-24ff-4266-8e0a-0279d9e05576 tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Successfully detached device vdb from instance 0dfd28a0-528c-434a-8850-aa7d29c1e738 from the live domain config.
Oct 16 18:46:27 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2649a91b-24ff-4266-8e0a-0279d9e05576 tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2649a91b-24ff-4266-8e0a-0279d9e05576 tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YvJptiCA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:46:27 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-2649a91b-24ff-4266-8e0a-0279d9e05576 tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:46:27 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-2649a91b-24ff-4266-8e0a-0279d9e05576 tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-2649a91b-24ff-4266-8e0a-0279d9e05576 tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f21007b-e885-4c7a-a04e-dd299790a838]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2649a91b-24ff-4266-8e0a-0279d9e05576 tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 18:46:27 user nova-compute[74247]: No targets found.
Oct 16 18:46:27 user nova-compute[74247]: iSNS:
Oct 16 18:46:27 user nova-compute[74247]: No targets found.
Oct 16 18:46:27 user nova-compute[74247]: STATIC:
Oct 16 18:46:27 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27
Oct 16 18:46:27 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:46:27 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:46:27 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc
Oct 16 18:46:27 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:46:27 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:46:27 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f
Oct 16 18:46:27 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:46:27 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:46:27 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a
Oct 16 18:46:27 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:46:27 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:46:27 user nova-compute[74247]: FIRMWARE:
Oct 16 18:46:27 user nova-compute[74247]: No targets found.
Oct 16 18:46:27 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2649a91b-24ff-4266-8e0a-0279d9e05576 tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 18:46:27 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 18:46:27 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2649a91b-24ff-4266-8e0a-0279d9e05576 tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b36ec0d-4843-446d-9374-de62cf77d8f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7157f7-ff1b-4d2d-8bdd-b5ee00989856]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2649a91b-24ff-4266-8e0a-0279d9e05576 tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:46:27 user nova-compute[74247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)
Oct 16 18:46:27 user nova-compute[74247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)
Oct 16 18:46:27 user nova-compute[74247]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a (non-flash)
Oct 16 18:46:27 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2649a91b-24ff-4266-8e0a-0279d9e05576 tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:46:27 user nova-compute[74247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)
Oct 16 18:46:27 user nova-compute[74247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)
Oct 16 18:46:27 user nova-compute[74247]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a (non-flash)
Oct 16 18:46:27 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2649a91b-24ff-4266-8e0a-0279d9e05576 tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe04839beb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a'): ({'sdd'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-2649a91b-24ff-4266-8e0a-0279d9e05576 tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Removing single pathed devices sdd {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc95093-15dd-4611-b4f7-70a51c780618]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4573c83-3c2a-4c79-bbe8-551a80ca3e81]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-2649a91b-24ff-4266-8e0a-0279d9e05576 tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Flushing IO for device /dev/sdd {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1757e71-dc6d-48d1-9e39-fa00e238a4c3]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-2649a91b-24ff-4266-8e0a-0279d9e05576 tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7810a95-694c-4e91-8e7e-c5657e1d3068]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-2649a91b-24ff-4266-8e0a-0279d9e05576 tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-2649a91b-24ff-4266-8e0a-0279d9e05576 tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] SCSI volumes sdd have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2649a91b-24ff-4266-8e0a-0279d9e05576 tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[296faad3-9e24-4d66-83b3-907dad534fc2]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2649a91b-24ff-4266-8e0a-0279d9e05576 tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae09bbc8-c094-4e48-aeef-4c6f4c0e003b]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2649a91b-24ff-4266-8e0a-0279d9e05576 tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a, portal: 172.16.0.220,3260]
Oct 16 18:46:27 user nova-compute[74247]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a, portal: 172.16.0.220,3260] successful.
Oct 16 18:46:27 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53088408-54d5-436b-aa84-f92e2f01da5a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[107d67f4-a56c-467d-bf79-14ebadfcac22]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2649a91b-24ff-4266-8e0a-0279d9e05576 tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-2649a91b-24ff-4266-8e0a-0279d9e05576 tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2649a91b-24ff-4266-8e0a-0279d9e05576 tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] <== disconnect_volume: return (315ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:46:27 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2649a91b-24ff-4266-8e0a-0279d9e05576 tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 18:46:28 user nova-compute[74247]: DEBUG nova.objects.instance [None req-2649a91b-24ff-4266-8e0a-0279d9e05576 tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Lazy-loading 'flavor' on Instance uuid 0dfd28a0-528c-434a-8850-aa7d29c1e738 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:46:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-2649a91b-24ff-4266-8e0a-0279d9e05576 tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Lock "0dfd28a0-528c-434a-8850-aa7d29c1e738" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.066s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:46:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:46:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:46:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:46:37 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:46:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:46:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-222283dc-3702-41c0-9ecd-f0616284a5c4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Acquiring lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:46:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-222283dc-3702-41c0-9ecd-f0616284a5c4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:46:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-222283dc-3702-41c0-9ecd-f0616284a5c4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Acquiring lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:46:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-222283dc-3702-41c0-9ecd-f0616284a5c4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:46:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-222283dc-3702-41c0-9ecd-f0616284a5c4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:46:41 user nova-compute[74247]: INFO nova.compute.manager [None req-222283dc-3702-41c0-9ecd-f0616284a5c4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Terminating instance
Oct 16 18:46:41 user nova-compute[74247]: DEBUG nova.compute.manager [None req-222283dc-3702-41c0-9ecd-f0616284a5c4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 18:46:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:46:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:46:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:46:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:46:42 user nova-compute[74247]: DEBUG nova.compute.manager [req-e945dd7e-876c-4eaf-891b-1a0bf1917e41 req-4a51c299-d043-40f9-b6f5-01865fbd25a8 service nova] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Received event network-vif-unplugged-15e062f0-b415-4b0d-abe3-eb3f3fb38761 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:46:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e945dd7e-876c-4eaf-891b-1a0bf1917e41 req-4a51c299-d043-40f9-b6f5-01865fbd25a8 service nova] Acquiring lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:46:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e945dd7e-876c-4eaf-891b-1a0bf1917e41 req-4a51c299-d043-40f9-b6f5-01865fbd25a8 service nova] Lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:46:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e945dd7e-876c-4eaf-891b-1a0bf1917e41 req-4a51c299-d043-40f9-b6f5-01865fbd25a8 service nova] Lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:46:42 user nova-compute[74247]: DEBUG nova.compute.manager [req-e945dd7e-876c-4eaf-891b-1a0bf1917e41 req-4a51c299-d043-40f9-b6f5-01865fbd25a8 service nova] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] No waiting events found dispatching network-vif-unplugged-15e062f0-b415-4b0d-abe3-eb3f3fb38761 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:46:42 user nova-compute[74247]: DEBUG nova.compute.manager [req-e945dd7e-876c-4eaf-891b-1a0bf1917e41 req-4a51c299-d043-40f9-b6f5-01865fbd25a8 service nova] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Received event network-vif-unplugged-15e062f0-b415-4b0d-abe3-eb3f3fb38761 for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:46:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:46:42 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Instance destroyed successfully.
Oct 16 18:46:42 user nova-compute[74247]: DEBUG nova.objects.instance [None req-222283dc-3702-41c0-9ecd-f0616284a5c4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lazy-loading 'resources' on Instance uuid 2589b875-41d7-4d8e-9b35-8840dd5d3ac2 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:46:42 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-222283dc-3702-41c0-9ecd-f0616284a5c4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:36:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-732861081',display_name='tempest-SnapshotDataIntegrityTests-server-732861081',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-732861081',id=26,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMa0J6Xvc30sq6v+q+USS4nkXLAdQPG3ZqpJz7++E93jwv74NIw1TYdlR8Ic0KHDEEaJpE6tCZskyKJhqU78bh30XGc4aDayCmYEWDZKG78BkK+EPQEzxnCUo2dhRNMmwA==',key_name='tempest-keypair-441281210',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:36:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fd2f559ca43548d7ab27cdf82968c3c9',ramdisk_id='',reservation_id='r-0xqse43y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-731547854',owner_user_name='tempest-SnapshotDataIntegrityTests-731547854-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:36:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeea855e8c84444cbc34ccc923e302cf',uuid=2589b875-41d7-4d8e-9b35-8840dd5d3ac2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15e062f0-b415-4b0d-abe3-eb3f3fb38761", "address": "fa:16:3e:d7:26:52", "network": {"id": "c2bd79d9-3793-4e55-b351-f6c16468a347", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2030561886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2f559ca43548d7ab27cdf82968c3c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e062f0-b4", "ovs_interfaceid": "15e062f0-b415-4b0d-abe3-eb3f3fb38761", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:46:42 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-222283dc-3702-41c0-9ecd-f0616284a5c4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Converting VIF {"id": "15e062f0-b415-4b0d-abe3-eb3f3fb38761", "address": "fa:16:3e:d7:26:52", "network": {"id": "c2bd79d9-3793-4e55-b351-f6c16468a347", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2030561886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2f559ca43548d7ab27cdf82968c3c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e062f0-b4", "ovs_interfaceid": "15e062f0-b415-4b0d-abe3-eb3f3fb38761", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:46:42 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-222283dc-3702-41c0-9ecd-f0616284a5c4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:26:52,bridge_name='br-int',has_traffic_filtering=True,id=15e062f0-b415-4b0d-abe3-eb3f3fb38761,network=Network(c2bd79d9-3793-4e55-b351-f6c16468a347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e062f0-b4') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:46:42 user nova-compute[74247]: DEBUG os_vif [None req-222283dc-3702-41c0-9ecd-f0616284a5c4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:26:52,bridge_name='br-int',has_traffic_filtering=True,id=15e062f0-b415-4b0d-abe3-eb3f3fb38761,network=Network(c2bd79d9-3793-4e55-b351-f6c16468a347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e062f0-b4') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:46:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:46:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15e062f0-b4, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:46:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:46:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:46:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:46:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e326377f-552b-428c-ba58-0af616d2367a) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:46:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:46:42 user nova-compute[74247]: INFO os_vif [None req-222283dc-3702-41c0-9ecd-f0616284a5c4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:26:52,bridge_name='br-int',has_traffic_filtering=True,id=15e062f0-b415-4b0d-abe3-eb3f3fb38761,network=Network(c2bd79d9-3793-4e55-b351-f6c16468a347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e062f0-b4')
Oct 16 18:46:42 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-222283dc-3702-41c0-9ecd-f0616284a5c4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Deleting instance files /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2_del
Oct 16 18:46:42 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-222283dc-3702-41c0-9ecd-f0616284a5c4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Deletion of /opt/stack/data/nova/instances/2589b875-41d7-4d8e-9b35-8840dd5d3ac2_del complete
Oct 16 18:46:42 user nova-compute[74247]: INFO nova.compute.manager [None req-222283dc-3702-41c0-9ecd-f0616284a5c4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 16 18:46:42 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-222283dc-3702-41c0-9ecd-f0616284a5c4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 18:46:42 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 18:46:42 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 18:46:43 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:46:43 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Took 0.73 seconds to deallocate network for instance.
Oct 16 18:46:43 user nova-compute[74247]: DEBUG nova.compute.manager [req-29930518-8728-4ba3-b5fd-935ea9ff3a81 req-0d73ed99-5ff6-41b0-a7a3-e1167e63d121 service nova] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Received event network-vif-deleted-15e062f0-b415-4b0d-abe3-eb3f3fb38761 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:46:43 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-222283dc-3702-41c0-9ecd-f0616284a5c4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:46:43 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-222283dc-3702-41c0-9ecd-f0616284a5c4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:46:43 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-222283dc-3702-41c0-9ecd-f0616284a5c4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:46:44 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-222283dc-3702-41c0-9ecd-f0616284a5c4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:46:44 user nova-compute[74247]: DEBUG nova.compute.manager [req-c78cd8f8-ce14-4cf0-8be2-79f68131f8f8 req-b2bc6543-51df-41f8-b4d9-c30e08fd4aac service nova] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Received event network-vif-plugged-15e062f0-b415-4b0d-abe3-eb3f3fb38761 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:46:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c78cd8f8-ce14-4cf0-8be2-79f68131f8f8 req-b2bc6543-51df-41f8-b4d9-c30e08fd4aac service nova] Acquiring lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:46:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c78cd8f8-ce14-4cf0-8be2-79f68131f8f8 req-b2bc6543-51df-41f8-b4d9-c30e08fd4aac service nova] Lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:46:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c78cd8f8-ce14-4cf0-8be2-79f68131f8f8 req-b2bc6543-51df-41f8-b4d9-c30e08fd4aac service nova] Lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:46:44 user nova-compute[74247]: DEBUG nova.compute.manager [req-c78cd8f8-ce14-4cf0-8be2-79f68131f8f8 req-b2bc6543-51df-41f8-b4d9-c30e08fd4aac service nova] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] No waiting events found dispatching network-vif-plugged-15e062f0-b415-4b0d-abe3-eb3f3fb38761 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:46:44 user nova-compute[74247]: WARNING nova.compute.manager [req-c78cd8f8-ce14-4cf0-8be2-79f68131f8f8 req-b2bc6543-51df-41f8-b4d9-c30e08fd4aac service nova] [instance: 2589b875-41d7-4d8e-9b35-8840dd5d3ac2] Received unexpected event network-vif-plugged-15e062f0-b415-4b0d-abe3-eb3f3fb38761 for instance with vm_state deleted and task_state None.
Oct 16 18:46:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-222283dc-3702-41c0-9ecd-f0616284a5c4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.743s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:46:44 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-222283dc-3702-41c0-9ecd-f0616284a5c4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Deleted allocations for instance 2589b875-41d7-4d8e-9b35-8840dd5d3ac2
Oct 16 18:46:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-222283dc-3702-41c0-9ecd-f0616284a5c4 tempest-SnapshotDataIntegrityTests-731547854 tempest-SnapshotDataIntegrityTests-731547854-project-member] Lock "2589b875-41d7-4d8e-9b35-8840dd5d3ac2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.665s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:46:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:46:52 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:46:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:46:58 user nova-compute[74247]: DEBUG nova.compute.manager [req-797606ba-ff8e-416e-801c-f623b04025df req-25a47e68-78bb-4963-88fa-ab622a9e9eb4 service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Received event network-changed-2ebee28a-6811-4631-a379-665b2ac7c97b {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:46:58 user nova-compute[74247]: DEBUG nova.compute.manager [req-797606ba-ff8e-416e-801c-f623b04025df req-25a47e68-78bb-4963-88fa-ab622a9e9eb4 service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Refreshing instance network info cache due to event network-changed-2ebee28a-6811-4631-a379-665b2ac7c97b. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:46:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-797606ba-ff8e-416e-801c-f623b04025df req-25a47e68-78bb-4963-88fa-ab622a9e9eb4 service nova] Acquiring lock "refresh_cache-3dfec5ff-83b2-442e-af36-d17e959bf316" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:46:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-797606ba-ff8e-416e-801c-f623b04025df req-25a47e68-78bb-4963-88fa-ab622a9e9eb4 service nova] Acquired lock "refresh_cache-3dfec5ff-83b2-442e-af36-d17e959bf316" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:46:58 user nova-compute[74247]: DEBUG nova.network.neutron [req-797606ba-ff8e-416e-801c-f623b04025df req-25a47e68-78bb-4963-88fa-ab622a9e9eb4 service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Refreshing network info cache for port 2ebee28a-6811-4631-a379-665b2ac7c97b {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:46:59 user nova-compute[74247]: DEBUG nova.network.neutron [req-797606ba-ff8e-416e-801c-f623b04025df req-25a47e68-78bb-4963-88fa-ab622a9e9eb4 service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Updated VIF entry in instance network info cache for port 2ebee28a-6811-4631-a379-665b2ac7c97b. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:46:59 user nova-compute[74247]: DEBUG nova.network.neutron [req-797606ba-ff8e-416e-801c-f623b04025df req-25a47e68-78bb-4963-88fa-ab622a9e9eb4 service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Updating instance_info_cache with network_info: [{"id": "2ebee28a-6811-4631-a379-665b2ac7c97b", "address": "fa:16:3e:12:f3:44", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebee28a-68", "ovs_interfaceid": "2ebee28a-6811-4631-a379-665b2ac7c97b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:46:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-797606ba-ff8e-416e-801c-f623b04025df req-25a47e68-78bb-4963-88fa-ab622a9e9eb4 service nova] Releasing lock "refresh_cache-3dfec5ff-83b2-442e-af36-d17e959bf316" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:46:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4cefdc8f-a7c9-4d3e-b081-9766e41ca2d7 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquiring lock "3dfec5ff-83b2-442e-af36-d17e959bf316" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:46:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4cefdc8f-a7c9-4d3e-b081-9766e41ca2d7 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "3dfec5ff-83b2-442e-af36-d17e959bf316" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:46:59 user nova-compute[74247]: INFO nova.compute.manager [None req-4cefdc8f-a7c9-4d3e-b081-9766e41ca2d7 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Detaching volume c5377b24-e3c8-4620-9d52-23efadf4dc6f
Oct 16 18:46:59 user nova-compute[74247]: INFO nova.virt.block_device [None req-4cefdc8f-a7c9-4d3e-b081-9766e41ca2d7 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Attempting to driver detach volume c5377b24-e3c8-4620-9d52-23efadf4dc6f from mountpoint /dev/vdb
Oct 16 18:46:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4cefdc8f-a7c9-4d3e-b081-9766e41ca2d7 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Attempting to detach device vdb from instance 3dfec5ff-83b2-442e-af36-d17e959bf316 from the persistent domain config. {{(pid=74247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 18:46:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-4cefdc8f-a7c9-4d3e-b081-9766e41ca2d7 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 18:46:59 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:46:59 user nova-compute[74247]:   <source dev="/dev/sde"/>
Oct 16 18:46:59 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:46:59 user nova-compute[74247]:   <serial>c5377b24-e3c8-4620-9d52-23efadf4dc6f</serial>
Oct 16 18:46:59 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 18:46:59 user nova-compute[74247]: </disk>
Oct 16 18:46:59 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:46:59 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-4cefdc8f-a7c9-4d3e-b081-9766e41ca2d7 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Successfully detached device vdb from instance 3dfec5ff-83b2-442e-af36-d17e959bf316 from the persistent domain config.
Oct 16 18:46:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4cefdc8f-a7c9-4d3e-b081-9766e41ca2d7 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3dfec5ff-83b2-442e-af36-d17e959bf316 from the live domain config. {{(pid=74247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 18:46:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-4cefdc8f-a7c9-4d3e-b081-9766e41ca2d7 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 18:46:59 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:46:59 user nova-compute[74247]:   <source dev="/dev/sde"/>
Oct 16 18:46:59 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:46:59 user nova-compute[74247]:   <serial>c5377b24-e3c8-4620-9d52-23efadf4dc6f</serial>
Oct 16 18:46:59 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 18:46:59 user nova-compute[74247]: </disk>
Oct 16 18:46:59 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:47:00 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4cefdc8f-a7c9-4d3e-b081-9766e41ca2d7 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3dfec5ff-83b2-442e-af36-d17e959bf316 {{(pid=74247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 18:47:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:01 user nova-compute[74247]: DEBUG nova.compute.manager [req-5b1b9b56-8ce6-4000-bf7a-8c0be7acba46 req-691a3652-18d4-44ba-8c90-a08b464f608b service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Received event network-changed-2ebee28a-6811-4631-a379-665b2ac7c97b {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:47:01 user nova-compute[74247]: DEBUG nova.compute.manager [req-5b1b9b56-8ce6-4000-bf7a-8c0be7acba46 req-691a3652-18d4-44ba-8c90-a08b464f608b service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Refreshing instance network info cache due to event network-changed-2ebee28a-6811-4631-a379-665b2ac7c97b. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:47:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-5b1b9b56-8ce6-4000-bf7a-8c0be7acba46 req-691a3652-18d4-44ba-8c90-a08b464f608b service nova] Acquiring lock "refresh_cache-3dfec5ff-83b2-442e-af36-d17e959bf316" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:47:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-5b1b9b56-8ce6-4000-bf7a-8c0be7acba46 req-691a3652-18d4-44ba-8c90-a08b464f608b service nova] Acquired lock "refresh_cache-3dfec5ff-83b2-442e-af36-d17e959bf316" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:47:01 user nova-compute[74247]: DEBUG nova.network.neutron [req-5b1b9b56-8ce6-4000-bf7a-8c0be7acba46 req-691a3652-18d4-44ba-8c90-a08b464f608b service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Refreshing network info cache for port 2ebee28a-6811-4631-a379-665b2ac7c97b {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:47:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:01 user nova-compute[74247]: DEBUG nova.network.neutron [req-5b1b9b56-8ce6-4000-bf7a-8c0be7acba46 req-691a3652-18d4-44ba-8c90-a08b464f608b service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Updated VIF entry in instance network info cache for port 2ebee28a-6811-4631-a379-665b2ac7c97b. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:47:01 user nova-compute[74247]: DEBUG nova.network.neutron [req-5b1b9b56-8ce6-4000-bf7a-8c0be7acba46 req-691a3652-18d4-44ba-8c90-a08b464f608b service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Updating instance_info_cache with network_info: [{"id": "2ebee28a-6811-4631-a379-665b2ac7c97b", "address": "fa:16:3e:12:f3:44", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebee28a-68", "ovs_interfaceid": "2ebee28a-6811-4631-a379-665b2ac7c97b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:47:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-5b1b9b56-8ce6-4000-bf7a-8c0be7acba46 req-691a3652-18d4-44ba-8c90-a08b464f608b service nova] Releasing lock "refresh_cache-3dfec5ff-83b2-442e-af36-d17e959bf316" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:47:02 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-69ba0f11-5663-4ea3-b079-ce99cd490acc tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Acquiring lock "0dfd28a0-528c-434a-8850-aa7d29c1e738" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:47:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-69ba0f11-5663-4ea3-b079-ce99cd490acc tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Lock "0dfd28a0-528c-434a-8850-aa7d29c1e738" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:47:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-69ba0f11-5663-4ea3-b079-ce99cd490acc tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Acquiring lock "0dfd28a0-528c-434a-8850-aa7d29c1e738-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:47:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-69ba0f11-5663-4ea3-b079-ce99cd490acc tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Lock "0dfd28a0-528c-434a-8850-aa7d29c1e738-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:47:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-69ba0f11-5663-4ea3-b079-ce99cd490acc tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Lock "0dfd28a0-528c-434a-8850-aa7d29c1e738-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:47:06 user nova-compute[74247]: INFO nova.compute.manager [None req-69ba0f11-5663-4ea3-b079-ce99cd490acc tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Terminating instance
Oct 16 18:47:06 user nova-compute[74247]: DEBUG nova.compute.manager [None req-69ba0f11-5663-4ea3-b079-ce99cd490acc tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 18:47:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:07 user nova-compute[74247]: DEBUG nova.compute.manager [req-0dd95bba-1761-48d8-8ed0-7fb4bf761f9b req-0c83f1c6-28bb-474f-9692-0f523aa467e8 service nova] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Received event network-vif-unplugged-88e3804c-7596-4dd5-b478-fda70e1f9ebb {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:47:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0dd95bba-1761-48d8-8ed0-7fb4bf761f9b req-0c83f1c6-28bb-474f-9692-0f523aa467e8 service nova] Acquiring lock "0dfd28a0-528c-434a-8850-aa7d29c1e738-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:47:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0dd95bba-1761-48d8-8ed0-7fb4bf761f9b req-0c83f1c6-28bb-474f-9692-0f523aa467e8 service nova] Lock "0dfd28a0-528c-434a-8850-aa7d29c1e738-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:47:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0dd95bba-1761-48d8-8ed0-7fb4bf761f9b req-0c83f1c6-28bb-474f-9692-0f523aa467e8 service nova] Lock "0dfd28a0-528c-434a-8850-aa7d29c1e738-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:47:07 user nova-compute[74247]: DEBUG nova.compute.manager [req-0dd95bba-1761-48d8-8ed0-7fb4bf761f9b req-0c83f1c6-28bb-474f-9692-0f523aa467e8 service nova] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] No waiting events found dispatching network-vif-unplugged-88e3804c-7596-4dd5-b478-fda70e1f9ebb {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:47:07 user nova-compute[74247]: DEBUG nova.compute.manager [req-0dd95bba-1761-48d8-8ed0-7fb4bf761f9b req-0c83f1c6-28bb-474f-9692-0f523aa467e8 service nova] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Received event network-vif-unplugged-88e3804c-7596-4dd5-b478-fda70e1f9ebb for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:47:07 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Instance destroyed successfully.
Oct 16 18:47:07 user nova-compute[74247]: DEBUG nova.objects.instance [None req-69ba0f11-5663-4ea3-b079-ce99cd490acc tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Lazy-loading 'resources' on Instance uuid 0dfd28a0-528c-434a-8850-aa7d29c1e738 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:47:07 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-69ba0f11-5663-4ea3-b079-ce99cd490acc tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:43:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-792500812',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-792500812',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7925008',id=33,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlV1V84aagvEuTKJxNl6gNXm4LitBUnA/wcqb2iO6VgGSsXwsK48WqLiwEUw7iYWDgfusstJQ3SE6X9RMvxc++BDSZlOto/yGhT9dG7qUxCWbJdM0dZUlba2uaGqrP0bQ==',key_name='tempest-keypair-1460952140',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:43:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e98ba2d44d0c401cb6a51f3d7ea3db59',ramdisk_id='',reservation_id='r-86q4j8o1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-535182982',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:43:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e493a201e17747cc907b2cdb0d22246f',uuid=0dfd28a0-528c-434a-8850-aa7d29c1e738,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "88e3804c-7596-4dd5-b478-fda70e1f9ebb", "address": "fa:16:3e:cd:31:0f", "network": {"id": "12aae3c0-8171-4d91-a65c-d823d49c6d8c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1631066218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e98ba2d44d0c401cb6a51f3d7ea3db59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88e3804c-75", "ovs_interfaceid": "88e3804c-7596-4dd5-b478-fda70e1f9ebb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:47:07 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-69ba0f11-5663-4ea3-b079-ce99cd490acc tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Converting VIF {"id": "88e3804c-7596-4dd5-b478-fda70e1f9ebb", "address": "fa:16:3e:cd:31:0f", "network": {"id": "12aae3c0-8171-4d91-a65c-d823d49c6d8c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1631066218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e98ba2d44d0c401cb6a51f3d7ea3db59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88e3804c-75", "ovs_interfaceid": "88e3804c-7596-4dd5-b478-fda70e1f9ebb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:47:07 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-69ba0f11-5663-4ea3-b079-ce99cd490acc tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:31:0f,bridge_name='br-int',has_traffic_filtering=True,id=88e3804c-7596-4dd5-b478-fda70e1f9ebb,network=Network(12aae3c0-8171-4d91-a65c-d823d49c6d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88e3804c-75') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:47:07 user nova-compute[74247]: DEBUG os_vif [None req-69ba0f11-5663-4ea3-b079-ce99cd490acc tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:31:0f,bridge_name='br-int',has_traffic_filtering=True,id=88e3804c-7596-4dd5-b478-fda70e1f9ebb,network=Network(12aae3c0-8171-4d91-a65c-d823d49c6d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88e3804c-75') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:47:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap88e3804c-75, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:47:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f2ea8b54-c4e1-4290-a3b7-b80f6b15a0a5) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:47:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:07 user nova-compute[74247]: INFO os_vif [None req-69ba0f11-5663-4ea3-b079-ce99cd490acc tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:31:0f,bridge_name='br-int',has_traffic_filtering=True,id=88e3804c-7596-4dd5-b478-fda70e1f9ebb,network=Network(12aae3c0-8171-4d91-a65c-d823d49c6d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88e3804c-75')
Oct 16 18:47:07 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-69ba0f11-5663-4ea3-b079-ce99cd490acc tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Deleting instance files /opt/stack/data/nova/instances/0dfd28a0-528c-434a-8850-aa7d29c1e738_del
Oct 16 18:47:07 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-69ba0f11-5663-4ea3-b079-ce99cd490acc tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Deletion of /opt/stack/data/nova/instances/0dfd28a0-528c-434a-8850-aa7d29c1e738_del complete
Oct 16 18:47:07 user nova-compute[74247]: INFO nova.compute.manager [None req-69ba0f11-5663-4ea3-b079-ce99cd490acc tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 16 18:47:07 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-69ba0f11-5663-4ea3-b079-ce99cd490acc tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 18:47:07 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 18:47:07 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 18:47:08 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:47:08 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Took 0.71 seconds to deallocate network for instance.
Oct 16 18:47:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-69ba0f11-5663-4ea3-b079-ce99cd490acc tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:47:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-69ba0f11-5663-4ea3-b079-ce99cd490acc tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:47:08 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-69ba0f11-5663-4ea3-b079-ce99cd490acc tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:47:08 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-69ba0f11-5663-4ea3-b079-ce99cd490acc tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:47:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-69ba0f11-5663-4ea3-b079-ce99cd490acc tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.269s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:47:08 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-69ba0f11-5663-4ea3-b079-ce99cd490acc tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Deleted allocations for instance 0dfd28a0-528c-434a-8850-aa7d29c1e738
Oct 16 18:47:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-69ba0f11-5663-4ea3-b079-ce99cd490acc tempest-TestServerVolumeAttachScenarioOldVersion-535182982 tempest-TestServerVolumeAttachScenarioOldVersion-535182982-project-member] Lock "0dfd28a0-528c-434a-8850-aa7d29c1e738" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.061s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:47:09 user nova-compute[74247]: DEBUG nova.compute.manager [req-7db93cf3-52a7-4ef5-8fd9-acc5a237240c req-2bcfc010-3563-468b-886d-280fae2a861c service nova] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Received event network-vif-plugged-88e3804c-7596-4dd5-b478-fda70e1f9ebb {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:47:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7db93cf3-52a7-4ef5-8fd9-acc5a237240c req-2bcfc010-3563-468b-886d-280fae2a861c service nova] Acquiring lock "0dfd28a0-528c-434a-8850-aa7d29c1e738-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:47:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7db93cf3-52a7-4ef5-8fd9-acc5a237240c req-2bcfc010-3563-468b-886d-280fae2a861c service nova] Lock "0dfd28a0-528c-434a-8850-aa7d29c1e738-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:47:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7db93cf3-52a7-4ef5-8fd9-acc5a237240c req-2bcfc010-3563-468b-886d-280fae2a861c service nova] Lock "0dfd28a0-528c-434a-8850-aa7d29c1e738-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:47:09 user nova-compute[74247]: DEBUG nova.compute.manager [req-7db93cf3-52a7-4ef5-8fd9-acc5a237240c req-2bcfc010-3563-468b-886d-280fae2a861c service nova] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] No waiting events found dispatching network-vif-plugged-88e3804c-7596-4dd5-b478-fda70e1f9ebb {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:47:09 user nova-compute[74247]: WARNING nova.compute.manager [req-7db93cf3-52a7-4ef5-8fd9-acc5a237240c req-2bcfc010-3563-468b-886d-280fae2a861c service nova] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Received unexpected event network-vif-plugged-88e3804c-7596-4dd5-b478-fda70e1f9ebb for instance with vm_state deleted and task_state None.
Oct 16 18:47:09 user nova-compute[74247]: DEBUG nova.compute.manager [req-7db93cf3-52a7-4ef5-8fd9-acc5a237240c req-2bcfc010-3563-468b-886d-280fae2a861c service nova] [instance: 0dfd28a0-528c-434a-8850-aa7d29c1e738] Received event network-vif-deleted-88e3804c-7596-4dd5-b478-fda70e1f9ebb {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:47:09 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:47:09 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 18:47:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "refresh_cache-220798e9-aea4-4c79-9737-175ab0598e7e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:47:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquired lock "refresh_cache-220798e9-aea4-4c79-9737-175ab0598e7e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:47:09 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Forcefully refreshing network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 18:47:10 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Updating instance_info_cache with network_info: [{"id": "2d83e040-9c34-466f-8a75-19b3710af8ea", "address": "fa:16:3e:25:a7:be", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d83e040-9c", "ovs_interfaceid": "2d83e040-9c34-466f-8a75-19b3710af8ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:47:10 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Releasing lock "refresh_cache-220798e9-aea4-4c79-9737-175ab0598e7e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:47:10 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Updated the network info_cache for instance {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 18:47:10 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:47:10 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:47:11 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:47:12 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:13 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:47:14 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:47:14 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:47:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:47:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:47:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:47:14 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 18:47:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:47:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:47:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:17 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:47:17 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:47:17 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=7958MB free_disk=24.766582489013672GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 18:47:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:47:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:47:17 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance cddf4842-1c25-4cc8-914e-af30849e4d6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:47:17 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 958af87e-69d0-4da1-8fcf-90e0f275d62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:47:17 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance d775101d-53a1-48c7-af24-91480be6af61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:47:17 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 7dcc08e9-7439-436b-8d9f-facaf04e22c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:47:17 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 220798e9-aea4-4c79-9737-175ab0598e7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:47:17 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 3dfec5ff-83b2-442e-af36-d17e959bf316 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:47:17 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 25d69a8d-98d5-4044-987a-f376aedfbe2a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:47:17 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance fa1dea31-91bc-4fda-8fb2-638628b66b3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:47:17 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 18:47:17 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 18:47:18 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:47:18 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:47:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 18:47:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.402s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:47:19 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:47:19 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:47:19 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 18:47:20 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4cefdc8f-a7c9-4d3e-b081-9766e41ca2d7 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3dfec5ff-83b2-442e-af36-d17e959bf316 is timed out.
Oct 16 18:47:20 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-4cefdc8f-a7c9-4d3e-b081-9766e41ca2d7 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Successfully detached device vdb from instance 3dfec5ff-83b2-442e-af36-d17e959bf316 from the live domain config.
Oct 16 18:47:20 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cefdc8f-a7c9-4d3e-b081-9766e41ca2d7 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cefdc8f-a7c9-4d3e-b081-9766e41ca2d7 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sixbaqgy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:47:20 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-4cefdc8f-a7c9-4d3e-b081-9766e41ca2d7 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:47:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-4cefdc8f-a7c9-4d3e-b081-9766e41ca2d7 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-4cefdc8f-a7c9-4d3e-b081-9766e41ca2d7 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c70b27d-dcee-4e70-962e-a4c9c6bae01a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cefdc8f-a7c9-4d3e-b081-9766e41ca2d7 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 18:47:20 user nova-compute[74247]: No targets found.
Oct 16 18:47:20 user nova-compute[74247]: iSNS:
Oct 16 18:47:20 user nova-compute[74247]: No targets found.
Oct 16 18:47:20 user nova-compute[74247]: STATIC:
Oct 16 18:47:20 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27
Oct 16 18:47:20 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:47:20 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:47:20 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc
Oct 16 18:47:20 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:47:20 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:47:20 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f
Oct 16 18:47:20 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:47:20 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:47:20 user nova-compute[74247]: FIRMWARE:
Oct 16 18:47:20 user nova-compute[74247]: No targets found.
Oct 16 18:47:20 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cefdc8f-a7c9-4d3e-b081-9766e41ca2d7 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 18:47:20 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 18:47:20 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cefdc8f-a7c9-4d3e-b081-9766e41ca2d7 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09c832f-b495-419b-a192-fe686e1a34b3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a13fb4-297c-46e9-8b65-5f9dc5562274]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cefdc8f-a7c9-4d3e-b081-9766e41ca2d7 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:47:20 user nova-compute[74247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)
Oct 16 18:47:20 user nova-compute[74247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)
Oct 16 18:47:20 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cefdc8f-a7c9-4d3e-b081-9766e41ca2d7 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:47:20 user nova-compute[74247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)
Oct 16 18:47:20 user nova-compute[74247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f (non-flash)
Oct 16 18:47:20 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cefdc8f-a7c9-4d3e-b081-9766e41ca2d7 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe0780f3ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f'): ({'sde'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-4cefdc8f-a7c9-4d3e-b081-9766e41ca2d7 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Removing single pathed devices sde {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1332a28-8a29-432a-98bb-3706af70f72b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[387af8ba-5036-48e3-8645-2a1f1674b7c3]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-4cefdc8f-a7c9-4d3e-b081-9766e41ca2d7 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Flushing IO for device /dev/sde {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[080a8680-ebd8-4712-9799-fa384930ee2c]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-4cefdc8f-a7c9-4d3e-b081-9766e41ca2d7 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e453cca-40ec-437b-9e7a-637ebc68856d]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-4cefdc8f-a7c9-4d3e-b081-9766e41ca2d7 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-4cefdc8f-a7c9-4d3e-b081-9766e41ca2d7 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] SCSI volumes sde have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cefdc8f-a7c9-4d3e-b081-9766e41ca2d7 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f4a808-598c-4e2c-806d-1b81918d0aea]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cefdc8f-a7c9-4d3e-b081-9766e41ca2d7 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[878af0e2-8566-4613-8536-7ce8fb276276]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cefdc8f-a7c9-4d3e-b081-9766e41ca2d7 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f, portal: 172.16.0.220,3260]
Oct 16 18:47:20 user nova-compute[74247]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f, portal: 172.16.0.220,3260] successful.
Oct 16 18:47:20 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5377b24-e3c8-4620-9d52-23efadf4dc6f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0bef3d-ed39-4525-b8a9-2d0035c73729]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cefdc8f-a7c9-4d3e-b081-9766e41ca2d7 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-4cefdc8f-a7c9-4d3e-b081-9766e41ca2d7 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cefdc8f-a7c9-4d3e-b081-9766e41ca2d7 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] <== disconnect_volume: return (321ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:47:20 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cefdc8f-a7c9-4d3e-b081-9766e41ca2d7 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 18:47:21 user nova-compute[74247]: DEBUG nova.objects.instance [None req-4cefdc8f-a7c9-4d3e-b081-9766e41ca2d7 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lazy-loading 'flavor' on Instance uuid 3dfec5ff-83b2-442e-af36-d17e959bf316 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:47:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4cefdc8f-a7c9-4d3e-b081-9766e41ca2d7 tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "3dfec5ff-83b2-442e-af36-d17e959bf316" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.951s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:47:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:47:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:31 user nova-compute[74247]: DEBUG nova.compute.manager [req-fdbebb35-b171-41da-a0f6-c96c42f5cf6f req-81d63e30-7d6a-48b1-aae6-46fac68fb481 service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Received event network-changed-77ca2d19-f745-461d-9f32-8d42469a6bfc {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:47:31 user nova-compute[74247]: DEBUG nova.compute.manager [req-fdbebb35-b171-41da-a0f6-c96c42f5cf6f req-81d63e30-7d6a-48b1-aae6-46fac68fb481 service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Refreshing instance network info cache due to event network-changed-77ca2d19-f745-461d-9f32-8d42469a6bfc. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:47:31 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-fdbebb35-b171-41da-a0f6-c96c42f5cf6f req-81d63e30-7d6a-48b1-aae6-46fac68fb481 service nova] Acquiring lock "refresh_cache-fa1dea31-91bc-4fda-8fb2-638628b66b3f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:47:31 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-fdbebb35-b171-41da-a0f6-c96c42f5cf6f req-81d63e30-7d6a-48b1-aae6-46fac68fb481 service nova] Acquired lock "refresh_cache-fa1dea31-91bc-4fda-8fb2-638628b66b3f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:47:31 user nova-compute[74247]: DEBUG nova.network.neutron [req-fdbebb35-b171-41da-a0f6-c96c42f5cf6f req-81d63e30-7d6a-48b1-aae6-46fac68fb481 service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Refreshing network info cache for port 77ca2d19-f745-461d-9f32-8d42469a6bfc {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:47:31 user nova-compute[74247]: DEBUG nova.network.neutron [req-fdbebb35-b171-41da-a0f6-c96c42f5cf6f req-81d63e30-7d6a-48b1-aae6-46fac68fb481 service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Updated VIF entry in instance network info cache for port 77ca2d19-f745-461d-9f32-8d42469a6bfc. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:47:31 user nova-compute[74247]: DEBUG nova.network.neutron [req-fdbebb35-b171-41da-a0f6-c96c42f5cf6f req-81d63e30-7d6a-48b1-aae6-46fac68fb481 service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Updating instance_info_cache with network_info: [{"id": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "address": "fa:16:3e:ea:29:cf", "network": {"id": "14ee32da-d0e3-499f-bd47-721e882b2a57", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-700103883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6d2ba688434391b03a9f3320a360de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77ca2d19-f7", "ovs_interfaceid": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:47:31 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-fdbebb35-b171-41da-a0f6-c96c42f5cf6f req-81d63e30-7d6a-48b1-aae6-46fac68fb481 service nova] Releasing lock "refresh_cache-fa1dea31-91bc-4fda-8fb2-638628b66b3f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:47:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:37 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquiring lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:47:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:47:38 user nova-compute[74247]: DEBUG nova.objects.instance [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lazy-loading 'flavor' on Instance uuid fa1dea31-91bc-4fda-8fb2-638628b66b3f {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:47:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:47:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquiring lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:47:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:47:38 user nova-compute[74247]: INFO nova.compute.manager [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Attaching volume 45f2a888-7a58-4dfb-af98-407e583a6d33 to /dev/vdb
Oct 16 18:47:38 user nova-compute[74247]: DEBUG os_brick.utils [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:47:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:38 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d2968a-f517-407b-9cda-d6546565f655]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:47:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:38 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f34645-267f-44e6-8a8a-91f0c041ced9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:47:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:38 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[26745de4-1ac9-4957-b67b-9798d6e0c39d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:47:38 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe363f66-6b21-480c-af4d-2893f52023fe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:47:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:47:38 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 18:47:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:47:38 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 18:47:38 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c881ce2-f138-4553-aa65-20d3f917b7ee]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:47:38 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 18:47:38 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 18:47:38 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 18:47:38 user nova-compute[74247]: DEBUG os_brick.utils [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:47:38 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Updating existing volume attachment record: a0300b28-d401-47de-a0d9-72d57d09c26a {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 18:47:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:46 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquiring lock "075e943e-8f32-4be9-8d02-30584668c34b" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:47:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "075e943e-8f32-4be9-8d02-30584668c34b" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:47:49 user nova-compute[74247]: INFO nova.compute.manager [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Unshelving
Oct 16 18:47:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:47:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:47:49 user nova-compute[74247]: DEBUG nova.objects.instance [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lazy-loading 'pci_requests' on Instance uuid 075e943e-8f32-4be9-8d02-30584668c34b {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:47:49 user nova-compute[74247]: DEBUG nova.objects.instance [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lazy-loading 'numa_topology' on Instance uuid 075e943e-8f32-4be9-8d02-30584668c34b {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:47:49 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:47:49 user nova-compute[74247]: INFO nova.compute.claims [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Claim successful on node user
Oct 16 18:47:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a3f61bba-9a4c-4be4-a667-736cb5ef6eba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquiring lock "3dfec5ff-83b2-442e-af36-d17e959bf316" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:47:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a3f61bba-9a4c-4be4-a667-736cb5ef6eba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "3dfec5ff-83b2-442e-af36-d17e959bf316" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:47:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a3f61bba-9a4c-4be4-a667-736cb5ef6eba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquiring lock "3dfec5ff-83b2-442e-af36-d17e959bf316-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:47:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a3f61bba-9a4c-4be4-a667-736cb5ef6eba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "3dfec5ff-83b2-442e-af36-d17e959bf316-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:47:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a3f61bba-9a4c-4be4-a667-736cb5ef6eba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "3dfec5ff-83b2-442e-af36-d17e959bf316-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:47:49 user nova-compute[74247]: INFO nova.compute.manager [None req-a3f61bba-9a4c-4be4-a667-736cb5ef6eba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Terminating instance
Oct 16 18:47:49 user nova-compute[74247]: DEBUG nova.compute.manager [None req-a3f61bba-9a4c-4be4-a667-736cb5ef6eba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 18:47:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:50 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:47:50 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:47:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:47:50 user nova-compute[74247]: DEBUG nova.compute.manager [req-2b0e2642-9904-4d0f-8018-536fce3d50be req-0e42874f-2aff-4bda-9db8-1f5e9d993a61 service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Received event network-vif-unplugged-2ebee28a-6811-4631-a379-665b2ac7c97b {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:47:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-2b0e2642-9904-4d0f-8018-536fce3d50be req-0e42874f-2aff-4bda-9db8-1f5e9d993a61 service nova] Acquiring lock "3dfec5ff-83b2-442e-af36-d17e959bf316-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:47:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-2b0e2642-9904-4d0f-8018-536fce3d50be req-0e42874f-2aff-4bda-9db8-1f5e9d993a61 service nova] Lock "3dfec5ff-83b2-442e-af36-d17e959bf316-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:47:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-2b0e2642-9904-4d0f-8018-536fce3d50be req-0e42874f-2aff-4bda-9db8-1f5e9d993a61 service nova] Lock "3dfec5ff-83b2-442e-af36-d17e959bf316-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:47:50 user nova-compute[74247]: DEBUG nova.compute.manager [req-2b0e2642-9904-4d0f-8018-536fce3d50be req-0e42874f-2aff-4bda-9db8-1f5e9d993a61 service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] No waiting events found dispatching network-vif-unplugged-2ebee28a-6811-4631-a379-665b2ac7c97b {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:47:50 user nova-compute[74247]: DEBUG nova.compute.manager [req-2b0e2642-9904-4d0f-8018-536fce3d50be req-0e42874f-2aff-4bda-9db8-1f5e9d993a61 service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Received event network-vif-unplugged-2ebee28a-6811-4631-a379-665b2ac7c97b for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:47:50 user nova-compute[74247]: INFO nova.network.neutron [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Updating port 5297bf76-2e6f-4240-819b-12b1594b0fe2 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 16 18:47:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:50 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Instance destroyed successfully.
Oct 16 18:47:50 user nova-compute[74247]: DEBUG nova.objects.instance [None req-a3f61bba-9a4c-4be4-a667-736cb5ef6eba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lazy-loading 'resources' on Instance uuid 3dfec5ff-83b2-442e-af36-d17e959bf316 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:47:50 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-a3f61bba-9a4c-4be4-a667-736cb5ef6eba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:41:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1641247620',display_name='tempest-ServerRescueNegativeTestJSON-server-1641247620',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1641247620',id=30,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPsDWRwLQfsC0Y7dw9Z15xe1y5GC7wHRETqUhbz5J1D6I9OPjIxouEGDX+yZjSp+CFSUIs9c1ficEwzIGhYvXQr7II5hyw6ajkuKxYHIVRNPTwDYN/rcvL+tVrC3iDbD+Q==',key_name='tempest-keypair-1614073413',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:43:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16160dad45544c6e8d9758e883089822',ramdisk_id='',reservation_id='r-61vw28hu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2007731322',owner_user_name='tempest-ServerRescueNegativeTestJSON-2007731322-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:45:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51026968ba1f49eaa8e0cc27a81855db',uuid=3dfec5ff-83b2-442e-af36-d17e959bf316,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ebee28a-6811-4631-a379-665b2ac7c97b", "address": "fa:16:3e:12:f3:44", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebee28a-68", "ovs_interfaceid": "2ebee28a-6811-4631-a379-665b2ac7c97b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:47:50 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-a3f61bba-9a4c-4be4-a667-736cb5ef6eba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Converting VIF {"id": "2ebee28a-6811-4631-a379-665b2ac7c97b", "address": "fa:16:3e:12:f3:44", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebee28a-68", "ovs_interfaceid": "2ebee28a-6811-4631-a379-665b2ac7c97b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:47:50 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-a3f61bba-9a4c-4be4-a667-736cb5ef6eba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:f3:44,bridge_name='br-int',has_traffic_filtering=True,id=2ebee28a-6811-4631-a379-665b2ac7c97b,network=Network(57ee1ccc-d7df-4a86-9234-c3c5f447e051),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ebee28a-68') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:47:50 user nova-compute[74247]: DEBUG os_vif [None req-a3f61bba-9a4c-4be4-a667-736cb5ef6eba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:f3:44,bridge_name='br-int',has_traffic_filtering=True,id=2ebee28a-6811-4631-a379-665b2ac7c97b,network=Network(57ee1ccc-d7df-4a86-9234-c3c5f447e051),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ebee28a-68') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:47:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ebee28a-68, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:47:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:47:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=21538f63-ae28-4fd6-81a2-af2d346e0ab8) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:47:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:50 user nova-compute[74247]: INFO os_vif [None req-a3f61bba-9a4c-4be4-a667-736cb5ef6eba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:f3:44,bridge_name='br-int',has_traffic_filtering=True,id=2ebee28a-6811-4631-a379-665b2ac7c97b,network=Network(57ee1ccc-d7df-4a86-9234-c3c5f447e051),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ebee28a-68')
Oct 16 18:47:50 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-a3f61bba-9a4c-4be4-a667-736cb5ef6eba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Deleting instance files /opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316_del
Oct 16 18:47:50 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-a3f61bba-9a4c-4be4-a667-736cb5ef6eba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Deletion of /opt/stack/data/nova/instances/3dfec5ff-83b2-442e-af36-d17e959bf316_del complete
Oct 16 18:47:50 user nova-compute[74247]: INFO nova.compute.manager [None req-a3f61bba-9a4c-4be4-a667-736cb5ef6eba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 16 18:47:50 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-a3f61bba-9a4c-4be4-a667-736cb5ef6eba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 18:47:50 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 18:47:50 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 18:47:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquiring lock "refresh_cache-075e943e-8f32-4be9-8d02-30584668c34b" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:47:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquired lock "refresh_cache-075e943e-8f32-4be9-8d02-30584668c34b" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:47:50 user nova-compute[74247]: DEBUG nova.network.neutron [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:47:50 user nova-compute[74247]: DEBUG nova.compute.manager [req-9983c5c2-7c6d-476f-aafc-6842aa282137 req-cf4f338c-43d1-4e74-8344-06eed34e19e0 service nova] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Received event network-changed-5297bf76-2e6f-4240-819b-12b1594b0fe2 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:47:50 user nova-compute[74247]: DEBUG nova.compute.manager [req-9983c5c2-7c6d-476f-aafc-6842aa282137 req-cf4f338c-43d1-4e74-8344-06eed34e19e0 service nova] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Refreshing instance network info cache due to event network-changed-5297bf76-2e6f-4240-819b-12b1594b0fe2. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:47:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9983c5c2-7c6d-476f-aafc-6842aa282137 req-cf4f338c-43d1-4e74-8344-06eed34e19e0 service nova] Acquiring lock "refresh_cache-075e943e-8f32-4be9-8d02-30584668c34b" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:47:51 user nova-compute[74247]: DEBUG nova.network.neutron [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Updating instance_info_cache with network_info: [{"id": "5297bf76-2e6f-4240-819b-12b1594b0fe2", "address": "fa:16:3e:fd:a6:1e", "network": {"id": "88a1b265-5360-4362-90bc-3506f805688f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-620663417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5204c1aec5764c298a206429645eb268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5297bf76-2e", "ovs_interfaceid": "5297bf76-2e6f-4240-819b-12b1594b0fe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:47:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Releasing lock "refresh_cache-075e943e-8f32-4be9-8d02-30584668c34b" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:47:51 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:47:51 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Creating image(s)
Oct 16 18:47:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquiring lock "/opt/stack/data/nova/instances/075e943e-8f32-4be9-8d02-30584668c34b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:47:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "/opt/stack/data/nova/instances/075e943e-8f32-4be9-8d02-30584668c34b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:47:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "/opt/stack/data/nova/instances/075e943e-8f32-4be9-8d02-30584668c34b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:47:51 user nova-compute[74247]: DEBUG nova.objects.instance [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lazy-loading 'trusted_certs' on Instance uuid 075e943e-8f32-4be9-8d02-30584668c34b {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:47:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9983c5c2-7c6d-476f-aafc-6842aa282137 req-cf4f338c-43d1-4e74-8344-06eed34e19e0 service nova] Acquired lock "refresh_cache-075e943e-8f32-4be9-8d02-30584668c34b" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:47:51 user nova-compute[74247]: DEBUG nova.network.neutron [req-9983c5c2-7c6d-476f-aafc-6842aa282137 req-cf4f338c-43d1-4e74-8344-06eed34e19e0 service nova] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Refreshing network info cache for port 5297bf76-2e6f-4240-819b-12b1594b0fe2 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:47:51 user nova-compute[74247]: DEBUG nova.objects.base [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Object Instance<075e943e-8f32-4be9-8d02-30584668c34b> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:47:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquiring lock "0898cd6fc334f222de8047fd54b36971b7e86a9a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:47:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "0898cd6fc334f222de8047fd54b36971b7e86a9a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:47:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0898cd6fc334f222de8047fd54b36971b7e86a9a.part --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:52 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:52 user nova-compute[74247]: DEBUG nova.compute.manager [req-251ad739-b7d5-4b66-b5a9-2ab21b70238f req-d993682c-572c-4823-9686-3bfe1fc51296 service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Received event network-vif-deleted-2ebee28a-6811-4631-a379-665b2ac7c97b {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:47:52 user nova-compute[74247]: INFO nova.compute.manager [req-251ad739-b7d5-4b66-b5a9-2ab21b70238f req-d993682c-572c-4823-9686-3bfe1fc51296 service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Neutron deleted interface 2ebee28a-6811-4631-a379-665b2ac7c97b; detaching it from the instance and deleting it from the info cache
Oct 16 18:47:52 user nova-compute[74247]: DEBUG nova.network.neutron [req-251ad739-b7d5-4b66-b5a9-2ab21b70238f req-d993682c-572c-4823-9686-3bfe1fc51296 service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:47:52 user nova-compute[74247]: DEBUG nova.compute.manager [req-4cbce020-a578-4bf7-9b35-ebcce17c3a07 req-bf653fcf-3bd0-47c7-be62-c21fc6d259b6 service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Received event network-vif-plugged-2ebee28a-6811-4631-a379-665b2ac7c97b {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:47:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4cbce020-a578-4bf7-9b35-ebcce17c3a07 req-bf653fcf-3bd0-47c7-be62-c21fc6d259b6 service nova] Acquiring lock "3dfec5ff-83b2-442e-af36-d17e959bf316-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:47:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4cbce020-a578-4bf7-9b35-ebcce17c3a07 req-bf653fcf-3bd0-47c7-be62-c21fc6d259b6 service nova] Lock "3dfec5ff-83b2-442e-af36-d17e959bf316-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:47:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4cbce020-a578-4bf7-9b35-ebcce17c3a07 req-bf653fcf-3bd0-47c7-be62-c21fc6d259b6 service nova] Lock "3dfec5ff-83b2-442e-af36-d17e959bf316-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:47:52 user nova-compute[74247]: DEBUG nova.compute.manager [req-4cbce020-a578-4bf7-9b35-ebcce17c3a07 req-bf653fcf-3bd0-47c7-be62-c21fc6d259b6 service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] No waiting events found dispatching network-vif-plugged-2ebee28a-6811-4631-a379-665b2ac7c97b {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:47:52 user nova-compute[74247]: WARNING nova.compute.manager [req-4cbce020-a578-4bf7-9b35-ebcce17c3a07 req-bf653fcf-3bd0-47c7-be62-c21fc6d259b6 service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Received unexpected event network-vif-plugged-2ebee28a-6811-4631-a379-665b2ac7c97b for instance with vm_state active and task_state deleting.
Oct 16 18:47:52 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:47:52 user nova-compute[74247]: DEBUG nova.compute.manager [req-251ad739-b7d5-4b66-b5a9-2ab21b70238f req-d993682c-572c-4823-9686-3bfe1fc51296 service nova] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Detach interface failed, port_id=2ebee28a-6811-4631-a379-665b2ac7c97b, reason: Instance 3dfec5ff-83b2-442e-af36-d17e959bf316 could not be found. {{(pid=74247) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 18:47:52 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: 3dfec5ff-83b2-442e-af36-d17e959bf316] Took 1.70 seconds to deallocate network for instance.
Oct 16 18:47:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a3f61bba-9a4c-4be4-a667-736cb5ef6eba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:47:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a3f61bba-9a4c-4be4-a667-736cb5ef6eba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:47:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0898cd6fc334f222de8047fd54b36971b7e86a9a.part --force-share --output=json" returned: 0 in 0.193s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:52 user nova-compute[74247]: DEBUG nova.virt.images [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] f01fb2f8-6382-4556-ab94-79b6d3ee1c10 was qcow2, converting to raw {{(pid=74247) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 16 18:47:52 user nova-compute[74247]: DEBUG nova.privsep.utils [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74247) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 18:47:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0898cd6fc334f222de8047fd54b36971b7e86a9a.part /opt/stack/data/nova/instances/_base/0898cd6fc334f222de8047fd54b36971b7e86a9a.converted {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:52 user nova-compute[74247]: DEBUG nova.network.neutron [req-9983c5c2-7c6d-476f-aafc-6842aa282137 req-cf4f338c-43d1-4e74-8344-06eed34e19e0 service nova] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Updated VIF entry in instance network info cache for port 5297bf76-2e6f-4240-819b-12b1594b0fe2. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:47:52 user nova-compute[74247]: DEBUG nova.network.neutron [req-9983c5c2-7c6d-476f-aafc-6842aa282137 req-cf4f338c-43d1-4e74-8344-06eed34e19e0 service nova] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Updating instance_info_cache with network_info: [{"id": "5297bf76-2e6f-4240-819b-12b1594b0fe2", "address": "fa:16:3e:fd:a6:1e", "network": {"id": "88a1b265-5360-4362-90bc-3506f805688f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-620663417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5204c1aec5764c298a206429645eb268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5297bf76-2e", "ovs_interfaceid": "5297bf76-2e6f-4240-819b-12b1594b0fe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:47:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9983c5c2-7c6d-476f-aafc-6842aa282137 req-cf4f338c-43d1-4e74-8344-06eed34e19e0 service nova] Releasing lock "refresh_cache-075e943e-8f32-4be9-8d02-30584668c34b" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:47:52 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-a3f61bba-9a4c-4be4-a667-736cb5ef6eba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:47:53 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-a3f61bba-9a4c-4be4-a667-736cb5ef6eba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:47:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a3f61bba-9a4c-4be4-a667-736cb5ef6eba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.593s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:47:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0898cd6fc334f222de8047fd54b36971b7e86a9a.part /opt/stack/data/nova/instances/_base/0898cd6fc334f222de8047fd54b36971b7e86a9a.converted" returned: 0 in 0.565s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0898cd6fc334f222de8047fd54b36971b7e86a9a.converted --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:53 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-a3f61bba-9a4c-4be4-a667-736cb5ef6eba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Deleted allocations for instance 3dfec5ff-83b2-442e-af36-d17e959bf316
Oct 16 18:47:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a3f61bba-9a4c-4be4-a667-736cb5ef6eba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "3dfec5ff-83b2-442e-af36-d17e959bf316" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.398s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:47:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0898cd6fc334f222de8047fd54b36971b7e86a9a.converted --force-share --output=json" returned: 0 in 0.182s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "0898cd6fc334f222de8047fd54b36971b7e86a9a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.136s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:47:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0898cd6fc334f222de8047fd54b36971b7e86a9a --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0898cd6fc334f222de8047fd54b36971b7e86a9a --force-share --output=json" returned: 0 in 0.191s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquiring lock "0898cd6fc334f222de8047fd54b36971b7e86a9a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:47:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "0898cd6fc334f222de8047fd54b36971b7e86a9a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:47:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0898cd6fc334f222de8047fd54b36971b7e86a9a --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0898cd6fc334f222de8047fd54b36971b7e86a9a --force-share --output=json" returned: 0 in 0.170s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0898cd6fc334f222de8047fd54b36971b7e86a9a,backing_fmt=raw /opt/stack/data/nova/instances/075e943e-8f32-4be9-8d02-30584668c34b/disk 1073741824 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0898cd6fc334f222de8047fd54b36971b7e86a9a,backing_fmt=raw /opt/stack/data/nova/instances/075e943e-8f32-4be9-8d02-30584668c34b/disk 1073741824" returned: 0 in 0.059s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "0898cd6fc334f222de8047fd54b36971b7e86a9a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:47:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0898cd6fc334f222de8047fd54b36971b7e86a9a --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0898cd6fc334f222de8047fd54b36971b7e86a9a --force-share --output=json" returned: 0 in 0.198s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:53 user nova-compute[74247]: DEBUG nova.objects.instance [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lazy-loading 'migration_context' on Instance uuid 075e943e-8f32-4be9-8d02-30584668c34b {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:47:54 user nova-compute[74247]: DEBUG nova.objects.base [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Object Instance<075e943e-8f32-4be9-8d02-30584668c34b> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:47:54 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Rebasing disk image.
Oct 16 18:47:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.175s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 -F raw /opt/stack/data/nova/instances/075e943e-8f32-4be9-8d02-30584668c34b/disk {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:55 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:47:55 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jvtxomgk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:47:55 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:47:55 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:47:55 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:47:55 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:47:55 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:47:55 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:47:55 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:47:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:55 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eee26ed-b022-4b8b-9d63-a889544c5ea0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:47:55 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 18:47:55 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:47:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "25d69a8d-98d5-4044-987a-f376aedfbe2a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:47:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "25d69a8d-98d5-4044-987a-f376aedfbe2a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:47:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:47:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:47:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:47:55 user nova-compute[74247]: INFO nova.compute.manager [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Terminating instance
Oct 16 18:47:55 user nova-compute[74247]: DEBUG nova.compute.manager [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 18:47:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:55 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e867fd3-c59f-492b-ab79-107b00573635]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:47:55 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33] added
Oct 16 18:47:55 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:47:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:55 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7990ff-fea4-49b8-9a9e-6cd48d867fd6]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:47:55 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:47:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:55 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d10cc6-85b5-47ef-ae8f-d14427177c7b]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:47:55 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:47:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jvtxomgk {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jvtxomgk" returned: 0 in 0.122s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3710274-da3f-473b-b33d-1fa2caaa5d47]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jvtxomgk'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.040s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fba1635-e09c-4502-8c47-ae33d4d703ac]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[366023cd-3991-433a-812f-823aba5bfd77]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:47:56 user nova-compute[74247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)
Oct 16 18:47:56 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:47:56 user nova-compute[74247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)
Oct 16 18:47:56 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 -p 172.16.0.220:3260 --login" returned: 0 in 0.178s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc649a50-8269-463c-aedf-ac1555adadb8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33, portal: 172.16.0.220,3260]
Oct 16 18:47:56 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33, portal: 172.16.0.220,3260] successful.
Oct 16 18:47:56 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.048s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bec781-88ab-45d8-882a-f26c69a01315]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a82a1a-68ba-45a0-8bbd-942224d2d177]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:47:56 user nova-compute[74247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)
Oct 16 18:47:56 user nova-compute[74247]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 (non-flash)
Oct 16 18:47:56 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:47:56 user nova-compute[74247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)
Oct 16 18:47:56 user nova-compute[74247]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 (non-flash)
Oct 16 18:47:56 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.698s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.044s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc7e452-1d10-4313-bd13-e0d41369e0c3]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jvtxomgk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG nova.compute.manager [req-8bb47b65-d48a-4a7c-92db-68b67a813bd0 req-fff9d8c3-bfdd-4527-b020-3d6f2e994528 service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Received event network-vif-unplugged-1e2af952-39b5-4add-9542-925c9babc88c {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-8bb47b65-d48a-4a7c-92db-68b67a813bd0 req-fff9d8c3-bfdd-4527-b020-3d6f2e994528 service nova] Acquiring lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-8bb47b65-d48a-4a7c-92db-68b67a813bd0 req-fff9d8c3-bfdd-4527-b020-3d6f2e994528 service nova] Lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-8bb47b65-d48a-4a7c-92db-68b67a813bd0 req-fff9d8c3-bfdd-4527-b020-3d6f2e994528 service nova] Lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG nova.compute.manager [req-8bb47b65-d48a-4a7c-92db-68b67a813bd0 req-fff9d8c3-bfdd-4527-b020-3d6f2e994528 service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] No waiting events found dispatching network-vif-unplugged-1e2af952-39b5-4add-9542-925c9babc88c {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG nova.compute.manager [req-8bb47b65-d48a-4a7c-92db-68b67a813bd0 req-fff9d8c3-bfdd-4527-b020-3d6f2e994528 service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Received event network-vif-unplugged-1e2af952-39b5-4add-9542-925c9babc88c for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 -F raw /opt/stack/data/nova/instances/075e943e-8f32-4be9-8d02-30584668c34b/disk" returned: 0 in 2.806s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Ensure instance console log exists: /opt/stack/data/nova/instances/075e943e-8f32-4be9-8d02-30584668c34b/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:47:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Start _get_guest_xml network_info=[{"id": "5297bf76-2e6f-4240-819b-12b1594b0fe2", "address": "fa:16:3e:fd:a6:1e", "network": {"id": "88a1b265-5360-4362-90bc-3506f805688f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-620663417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5204c1aec5764c298a206429645eb268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5297bf76-2e", "ovs_interfaceid": "5297bf76-2e6f-4240-819b-12b1594b0fe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='cee0a1345725f1bb53640b3a891ae800',container_format='bare',created_at=2023-10-16T18:45:57Z,direct_url=<?>,disk_format='qcow2',id=f01fb2f8-6382-4556-ab94-79b6d3ee1c10,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-246997190-shelved',owner='5204c1aec5764c298a206429645eb268',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-16T18:46:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': '83126bb1-29f5-42fe-8620-72ab0797f776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:47:57 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:47:57 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:47:57 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='cee0a1345725f1bb53640b3a891ae800',container_format='bare',created_at=2023-10-16T18:45:57Z,direct_url=<?>,disk_format='qcow2',id=f01fb2f8-6382-4556-ab94-79b6d3ee1c10,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-246997190-shelved',owner='5204c1aec5764c298a206429645eb268',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-16T18:46:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG nova.objects.instance [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lazy-loading 'vcpu_model' on Instance uuid 075e943e-8f32-4be9-8d02-30584668c34b {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG nova.objects.base [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Object Instance<075e943e-8f32-4be9-8d02-30584668c34b> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T18:43:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-246997190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-246997190',id=34,image_ref='f01fb2f8-6382-4556-ab94-79b6d3ee1c10',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-873631301',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:44:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5204c1aec5764c298a206429645eb268',ramdisk_id='',reservation_id='r-7whme9zu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-537076068',owner_user_name='tempest-AttachVolumeShelveTestJSON-537076068-project-member',shelved_at='2023-10-16T18:46:01.297850',shelved_host='user',shelved_image_id='f01fb2f8-6382-4556-ab94-79b6d3ee1c10'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:47:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bda4c43b45347be96b152caba47b07d',uuid=075e943e-8f32-4be9-8d02-30584668c34b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5297bf76-2e6f-4240-819b-12b1594b0fe2", "address": "fa:16:3e:fd:a6:1e", "network": {"id": "88a1b265-5360-4362-90bc-3506f805688f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-620663417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5204c1aec5764c298a206429645eb268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5297bf76-2e", "ovs_interfaceid": "5297bf76-2e6f-4240-819b-12b1594b0fe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Converting VIF {"id": "5297bf76-2e6f-4240-819b-12b1594b0fe2", "address": "fa:16:3e:fd:a6:1e", "network": {"id": "88a1b265-5360-4362-90bc-3506f805688f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-620663417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5204c1aec5764c298a206429645eb268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5297bf76-2e", "ovs_interfaceid": "5297bf76-2e6f-4240-819b-12b1594b0fe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:a6:1e,bridge_name='br-int',has_traffic_filtering=True,id=5297bf76-2e6f-4240-819b-12b1594b0fe2,network=Network(88a1b265-5360-4362-90bc-3506f805688f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5297bf76-2e') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG nova.objects.instance [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lazy-loading 'pci_devices' on Instance uuid 075e943e-8f32-4be9-8d02-30584668c34b {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG nova.objects.base [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Object Instance<075e943e-8f32-4be9-8d02-30584668c34b> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:47:57 user nova-compute[74247]:   <uuid>075e943e-8f32-4be9-8d02-30584668c34b</uuid>
Oct 16 18:47:57 user nova-compute[74247]:   <name>instance-00000022</name>
Oct 16 18:47:57 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:47:57 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:47:57 user nova-compute[74247]:   <metadata>
Oct 16 18:47:57 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:47:57 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:47:57 user nova-compute[74247]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-246997190</nova:name>
Oct 16 18:47:57 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:47:57</nova:creationTime>
Oct 16 18:47:57 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:47:57 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:47:57 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:47:57 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:47:57 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:47:57 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:47:57 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:47:57 user nova-compute[74247]:       <nova:owner>
Oct 16 18:47:57 user nova-compute[74247]:         <nova:user uuid="2bda4c43b45347be96b152caba47b07d">tempest-AttachVolumeShelveTestJSON-537076068-project-member</nova:user>
Oct 16 18:47:57 user nova-compute[74247]:         <nova:project uuid="5204c1aec5764c298a206429645eb268">tempest-AttachVolumeShelveTestJSON-537076068</nova:project>
Oct 16 18:47:57 user nova-compute[74247]:       </nova:owner>
Oct 16 18:47:57 user nova-compute[74247]:       <nova:root type="image" uuid="f01fb2f8-6382-4556-ab94-79b6d3ee1c10"/>
Oct 16 18:47:57 user nova-compute[74247]:       <nova:ports>
Oct 16 18:47:57 user nova-compute[74247]:         <nova:port uuid="5297bf76-2e6f-4240-819b-12b1594b0fe2">
Oct 16 18:47:57 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 16 18:47:57 user nova-compute[74247]:         </nova:port>
Oct 16 18:47:57 user nova-compute[74247]:       </nova:ports>
Oct 16 18:47:57 user nova-compute[74247]:     </nova:instance>
Oct 16 18:47:57 user nova-compute[74247]:   </metadata>
Oct 16 18:47:57 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:47:57 user nova-compute[74247]:     <system>
Oct 16 18:47:57 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:47:57 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:47:57 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:47:57 user nova-compute[74247]:       <entry name="serial">075e943e-8f32-4be9-8d02-30584668c34b</entry>
Oct 16 18:47:57 user nova-compute[74247]:       <entry name="uuid">075e943e-8f32-4be9-8d02-30584668c34b</entry>
Oct 16 18:47:57 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:47:57 user nova-compute[74247]:     </system>
Oct 16 18:47:57 user nova-compute[74247]:   </sysinfo>
Oct 16 18:47:57 user nova-compute[74247]:   <os>
Oct 16 18:47:57 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:47:57 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:47:57 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:47:57 user nova-compute[74247]:   </os>
Oct 16 18:47:57 user nova-compute[74247]:   <features>
Oct 16 18:47:57 user nova-compute[74247]:     <acpi/>
Oct 16 18:47:57 user nova-compute[74247]:     <apic/>
Oct 16 18:47:57 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:47:57 user nova-compute[74247]:   </features>
Oct 16 18:47:57 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:47:57 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:47:57 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:47:57 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:47:57 user nova-compute[74247]:   </clock>
Oct 16 18:47:57 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:47:57 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:47:57 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:47:57 user nova-compute[74247]:   </cpu>
Oct 16 18:47:57 user nova-compute[74247]:   <devices>
Oct 16 18:47:57 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:47:57 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:47:57 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/075e943e-8f32-4be9-8d02-30584668c34b/disk"/>
Oct 16 18:47:57 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:47:57 user nova-compute[74247]:     </disk>
Oct 16 18:47:57 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:47:57 user nova-compute[74247]:       <mac address="fa:16:3e:fd:a6:1e"/>
Oct 16 18:47:57 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:47:57 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:47:57 user nova-compute[74247]:       <target dev="tap5297bf76-2e"/>
Oct 16 18:47:57 user nova-compute[74247]:     </interface>
Oct 16 18:47:57 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:47:57 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/075e943e-8f32-4be9-8d02-30584668c34b/console.log" append="off"/>
Oct 16 18:47:57 user nova-compute[74247]:     </serial>
Oct 16 18:47:57 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:47:57 user nova-compute[74247]:     <video>
Oct 16 18:47:57 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:47:57 user nova-compute[74247]:     </video>
Oct 16 18:47:57 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:47:57 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:47:57 user nova-compute[74247]:     </rng>
Oct 16 18:47:57 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:47:57 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:47:57 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:47:57 user nova-compute[74247]:     </memballoon>
Oct 16 18:47:57 user nova-compute[74247]:   </devices>
Oct 16 18:47:57 user nova-compute[74247]: </domain>
Oct 16 18:47:57 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T18:43:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-246997190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-246997190',id=34,image_ref='f01fb2f8-6382-4556-ab94-79b6d3ee1c10',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-873631301',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:44:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5204c1aec5764c298a206429645eb268',ramdisk_id='',reservation_id='r-7whme9zu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-537076068',owner_user_name='tempest-AttachVolumeShelveTestJSON-537076068-project-member',shelved_at='2023-10-16T18:46:01.297850',shelved_host='user',shelved_image_id='f01fb2f8-6382-4556-ab94-79b6d3ee1c10'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:47:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bda4c43b45347be96b152caba47b07d',uuid=075e943e-8f32-4be9-8d02-30584668c34b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5297bf76-2e6f-4240-819b-12b1594b0fe2", "address": "fa:16:3e:fd:a6:1e", "network": {"id": "88a1b265-5360-4362-90bc-3506f805688f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-620663417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5204c1aec5764c298a206429645eb268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5297bf76-2e", "ovs_interfaceid": "5297bf76-2e6f-4240-819b-12b1594b0fe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Converting VIF {"id": "5297bf76-2e6f-4240-819b-12b1594b0fe2", "address": "fa:16:3e:fd:a6:1e", "network": {"id": "88a1b265-5360-4362-90bc-3506f805688f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-620663417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5204c1aec5764c298a206429645eb268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5297bf76-2e", "ovs_interfaceid": "5297bf76-2e6f-4240-819b-12b1594b0fe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:a6:1e,bridge_name='br-int',has_traffic_filtering=True,id=5297bf76-2e6f-4240-819b-12b1594b0fe2,network=Network(88a1b265-5360-4362-90bc-3506f805688f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5297bf76-2e') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG os_vif [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:a6:1e,bridge_name='br-int',has_traffic_filtering=True,id=5297bf76-2e6f-4240-819b-12b1594b0fe2,network=Network(88a1b265-5360-4362-90bc-3506f805688f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5297bf76-2e') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '035f809c-280f-53e4-909a-434e0f824284', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5297bf76-2e, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5297bf76-2e, col_values=(('qos', UUID('e1c418b8-950b-40f7-a1d4-9ef2388b52c2')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5297bf76-2e, col_values=(('external_ids', {'iface-id': '5297bf76-2e6f-4240-819b-12b1594b0fe2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:a6:1e', 'vm-uuid': '075e943e-8f32-4be9-8d02-30584668c34b'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:57 user nova-compute[74247]: INFO os_vif [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:a6:1e,bridge_name='br-int',has_traffic_filtering=True,id=5297bf76-2e6f-4240-819b-12b1594b0fe2,network=Network(88a1b265-5360-4362-90bc-3506f805688f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5297bf76-2e')
Oct 16 18:47:57 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] No VIF found with MAC fa:16:3e:fd:a6:1e, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.759s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] <== connect_volume: return (1761ms) {'type': 'block', 'scsi_wwn': '26163376361336664', 'path': '/dev/sdd'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163376361336664', 'path': '/dev/sdd'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG nova.objects.instance [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lazy-loading 'flavor' on Instance uuid fa1dea31-91bc-4fda-8fb2-638628b66b3f {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:47:57 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Instance destroyed successfully.
Oct 16 18:47:57 user nova-compute[74247]: DEBUG nova.objects.instance [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lazy-loading 'resources' on Instance uuid 25d69a8d-98d5-4044-987a-f376aedfbe2a {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 18:47:57 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:47:57 user nova-compute[74247]:   <source dev="/dev/sdd"/>
Oct 16 18:47:57 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:47:57 user nova-compute[74247]:   <serial>45f2a888-7a58-4dfb-af98-407e583a6d33</serial>
Oct 16 18:47:57 user nova-compute[74247]: </disk>
Oct 16 18:47:57 user nova-compute[74247]:  {{(pid=74247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:42:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-580863586',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-580863586',id=32,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:44:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bce6164a392e4cc2a027d12c49145e6d',ramdisk_id='',reservation_id='r-gsrsluny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-656520712',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:46:10Z,user_data=None,user_id='b01d3e5d2fcb40bc92c3d2fe1236d509',uuid=25d69a8d-98d5-4044-987a-f376aedfbe2a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e2af952-39b5-4add-9542-925c9babc88c", "address": "fa:16:3e:32:37:ce", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2af952-39", "ovs_interfaceid": "1e2af952-39b5-4add-9542-925c9babc88c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Converting VIF {"id": "1e2af952-39b5-4add-9542-925c9babc88c", "address": "fa:16:3e:32:37:ce", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2af952-39", "ovs_interfaceid": "1e2af952-39b5-4add-9542-925c9babc88c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:37:ce,bridge_name='br-int',has_traffic_filtering=True,id=1e2af952-39b5-4add-9542-925c9babc88c,network=Network(2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e2af952-39') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG os_vif [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:37:ce,bridge_name='br-int',has_traffic_filtering=True,id=1e2af952-39b5-4add-9542-925c9babc88c,network=Network(2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e2af952-39') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e2af952-39, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=61e1edbf-fe33-4aa5-81d7-03fd1f5cd391) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:57 user nova-compute[74247]: INFO os_vif [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:37:ce,bridge_name='br-int',has_traffic_filtering=True,id=1e2af952-39b5-4add-9542-925c9babc88c,network=Network(2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e2af952-39')
Oct 16 18:47:57 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iBFLJvYf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:47:57 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:47:57 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a56cdd7-c879-4285-92ee-66a515a305fb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 18:47:57 user nova-compute[74247]: No targets found.
Oct 16 18:47:57 user nova-compute[74247]: iSNS:
Oct 16 18:47:57 user nova-compute[74247]: No targets found.
Oct 16 18:47:57 user nova-compute[74247]: STATIC:
Oct 16 18:47:57 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27
Oct 16 18:47:57 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:47:57 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:47:57 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc
Oct 16 18:47:57 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:47:57 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:47:57 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33
Oct 16 18:47:57 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:47:57 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:47:57 user nova-compute[74247]: FIRMWARE:
Oct 16 18:47:57 user nova-compute[74247]: No targets found.
Oct 16 18:47:57 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 18:47:57 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 18:47:57 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[be94c2a0-86bf-4fa2-98bb-349e27876680]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8788fb-087e-4706-85e2-f3033da8b84b]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:47:57 user nova-compute[74247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)
Oct 16 18:47:57 user nova-compute[74247]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 (non-flash)
Oct 16 18:47:57 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:47:57 user nova-compute[74247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 (non-flash)
Oct 16 18:47:57 user nova-compute[74247]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 (non-flash)
Oct 16 18:47:57 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe068388dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27'): ({'sdb'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Removing single pathed devices sdb {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3356bb4b-1b1d-4541-86aa-27fd7e316de5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[045b7f99-097b-4654-9e92-3c6a5670fde9]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Flushing IO for device /dev/sdb {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b502e00-535d-4bf4-8363-f0935708d04f]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5297cc71-3cf0-40dd-a2d1-dadcf916bb98]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] SCSI volumes sdb have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[878665db-d3bf-4df7-a1b7-8afa974fff3f]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:47:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:58 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc6585c-3674-4b5f-b830-279359e252b2]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:47:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27, portal: 172.16.0.220,3260]
Oct 16 18:47:58 user nova-compute[74247]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27, portal: 172.16.0.220,3260] successful.
Oct 16 18:47:58 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:47:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:47:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5cf78da-abe8-4880-bed2-72611b707a27 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:47:58 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabcbd2a-6e0f-4a46-bea4-75b47d83406e]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:47:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:47:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:47:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] <== disconnect_volume: return (321ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:47:58 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 18:47:58 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Deleting instance files /opt/stack/data/nova/instances/25d69a8d-98d5-4044-987a-f376aedfbe2a_del
Oct 16 18:47:58 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Deletion of /opt/stack/data/nova/instances/25d69a8d-98d5-4044-987a-f376aedfbe2a_del complete
Oct 16 18:47:58 user nova-compute[74247]: INFO nova.compute.manager [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Took 2.18 seconds to destroy the instance on the hypervisor.
Oct 16 18:47:58 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 18:47:58 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 18:47:58 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 18:47:58 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:47:58 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:47:58 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] No VIF found with MAC fa:16:3e:ea:29:cf, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:47:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-54a95ff8-a243-42b2-a2da-48af7d26a64f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.090s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:47:58 user nova-compute[74247]: DEBUG nova.compute.manager [req-9b9a22f8-93c2-4be3-91cf-8c83b4e42761 req-f8f50dd8-542f-4229-a9b8-bbf45d1d0822 service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Received event network-vif-plugged-1e2af952-39b5-4add-9542-925c9babc88c {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:47:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9b9a22f8-93c2-4be3-91cf-8c83b4e42761 req-f8f50dd8-542f-4229-a9b8-bbf45d1d0822 service nova] Acquiring lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:47:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9b9a22f8-93c2-4be3-91cf-8c83b4e42761 req-f8f50dd8-542f-4229-a9b8-bbf45d1d0822 service nova] Lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:47:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9b9a22f8-93c2-4be3-91cf-8c83b4e42761 req-f8f50dd8-542f-4229-a9b8-bbf45d1d0822 service nova] Lock "25d69a8d-98d5-4044-987a-f376aedfbe2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:47:58 user nova-compute[74247]: DEBUG nova.compute.manager [req-9b9a22f8-93c2-4be3-91cf-8c83b4e42761 req-f8f50dd8-542f-4229-a9b8-bbf45d1d0822 service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] No waiting events found dispatching network-vif-plugged-1e2af952-39b5-4add-9542-925c9babc88c {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:47:58 user nova-compute[74247]: WARNING nova.compute.manager [req-9b9a22f8-93c2-4be3-91cf-8c83b4e42761 req-f8f50dd8-542f-4229-a9b8-bbf45d1d0822 service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Received unexpected event network-vif-plugged-1e2af952-39b5-4add-9542-925c9babc88c for instance with vm_state active and task_state deleting.
Oct 16 18:47:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:59 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:47:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-b97e4704-33f9-4615-a6da-d3e991c3047d tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquiring lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:47:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-b97e4704-33f9-4615-a6da-d3e991c3047d tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:47:59 user nova-compute[74247]: DEBUG nova.compute.manager [None req-b97e4704-33f9-4615-a6da-d3e991c3047d tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:47:59 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Took 1.18 seconds to deallocate network for instance.
Oct 16 18:47:59 user nova-compute[74247]: DEBUG nova.compute.manager [req-dbbc4781-f2d1-41fe-b8f9-4440dc0fdf7f req-8e01dec3-1d4b-463a-8920-8617bbdb79b7 service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Received event network-vif-deleted-1e2af952-39b5-4add-9542-925c9babc88c {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:47:59 user nova-compute[74247]: INFO nova.compute.manager [req-dbbc4781-f2d1-41fe-b8f9-4440dc0fdf7f req-8e01dec3-1d4b-463a-8920-8617bbdb79b7 service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Neutron deleted interface 1e2af952-39b5-4add-9542-925c9babc88c; detaching it from the instance and deleting it from the info cache
Oct 16 18:47:59 user nova-compute[74247]: DEBUG nova.network.neutron [req-dbbc4781-f2d1-41fe-b8f9-4440dc0fdf7f req-8e01dec3-1d4b-463a-8920-8617bbdb79b7 service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:47:59 user nova-compute[74247]: DEBUG nova.compute.manager [None req-b97e4704-33f9-4615-a6da-d3e991c3047d tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74247) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 16 18:47:59 user nova-compute[74247]: DEBUG nova.objects.instance [None req-b97e4704-33f9-4615-a6da-d3e991c3047d tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lazy-loading 'flavor' on Instance uuid fa1dea31-91bc-4fda-8fb2-638628b66b3f {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:47:59 user nova-compute[74247]: DEBUG nova.compute.manager [req-a51a212e-64a7-44fd-82d4-74e0a58ba953 req-40395361-ccd7-472c-83a8-b5aad9999483 service nova] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Received event network-vif-plugged-5297bf76-2e6f-4240-819b-12b1594b0fe2 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:47:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a51a212e-64a7-44fd-82d4-74e0a58ba953 req-40395361-ccd7-472c-83a8-b5aad9999483 service nova] Acquiring lock "075e943e-8f32-4be9-8d02-30584668c34b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:47:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a51a212e-64a7-44fd-82d4-74e0a58ba953 req-40395361-ccd7-472c-83a8-b5aad9999483 service nova] Lock "075e943e-8f32-4be9-8d02-30584668c34b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:47:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a51a212e-64a7-44fd-82d4-74e0a58ba953 req-40395361-ccd7-472c-83a8-b5aad9999483 service nova] Lock "075e943e-8f32-4be9-8d02-30584668c34b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:47:59 user nova-compute[74247]: DEBUG nova.compute.manager [req-a51a212e-64a7-44fd-82d4-74e0a58ba953 req-40395361-ccd7-472c-83a8-b5aad9999483 service nova] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] No waiting events found dispatching network-vif-plugged-5297bf76-2e6f-4240-819b-12b1594b0fe2 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:47:59 user nova-compute[74247]: WARNING nova.compute.manager [req-a51a212e-64a7-44fd-82d4-74e0a58ba953 req-40395361-ccd7-472c-83a8-b5aad9999483 service nova] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Received unexpected event network-vif-plugged-5297bf76-2e6f-4240-819b-12b1594b0fe2 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 16 18:47:59 user nova-compute[74247]: DEBUG nova.compute.manager [req-dbbc4781-f2d1-41fe-b8f9-4440dc0fdf7f req-8e01dec3-1d4b-463a-8920-8617bbdb79b7 service nova] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Detach interface failed, port_id=1e2af952-39b5-4add-9542-925c9babc88c, reason: Instance 25d69a8d-98d5-4044-987a-f376aedfbe2a could not be found. {{(pid=74247) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 18:47:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:47:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:00 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Instance destroyed successfully.
Oct 16 18:48:00 user nova-compute[74247]: DEBUG nova.compute.manager [None req-b97e4704-33f9-4615-a6da-d3e991c3047d tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:48:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-b97e4704-33f9-4615-a6da-d3e991c3047d tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.976s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:48:00 user nova-compute[74247]: INFO nova.compute.manager [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 25d69a8d-98d5-4044-987a-f376aedfbe2a] Took 0.96 seconds to detach 1 volumes for instance.
Oct 16 18:48:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:48:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:48:00 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:48:00 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:48:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.340s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:48:00 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Deleted allocations for instance 25d69a8d-98d5-4044-987a-f376aedfbe2a
Oct 16 18:48:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-edabf96c-6984-4575-b86f-50d90602aabe tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "25d69a8d-98d5-4044-987a-f376aedfbe2a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.899s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:48:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:00 user nova-compute[74247]: DEBUG nova.compute.manager [req-2c163e25-bbe4-432b-bd89-1f1a69f97eba req-87967196-81ee-48a6-a218-a08c8cd6d8fd service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Received event network-vif-unplugged-77ca2d19-f745-461d-9f32-8d42469a6bfc {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:48:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-2c163e25-bbe4-432b-bd89-1f1a69f97eba req-87967196-81ee-48a6-a218-a08c8cd6d8fd service nova] Acquiring lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:48:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-2c163e25-bbe4-432b-bd89-1f1a69f97eba req-87967196-81ee-48a6-a218-a08c8cd6d8fd service nova] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:48:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-2c163e25-bbe4-432b-bd89-1f1a69f97eba req-87967196-81ee-48a6-a218-a08c8cd6d8fd service nova] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:48:00 user nova-compute[74247]: DEBUG nova.compute.manager [req-2c163e25-bbe4-432b-bd89-1f1a69f97eba req-87967196-81ee-48a6-a218-a08c8cd6d8fd service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] No waiting events found dispatching network-vif-unplugged-77ca2d19-f745-461d-9f32-8d42469a6bfc {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:48:00 user nova-compute[74247]: WARNING nova.compute.manager [req-2c163e25-bbe4-432b-bd89-1f1a69f97eba req-87967196-81ee-48a6-a218-a08c8cd6d8fd service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Received unexpected event network-vif-unplugged-77ca2d19-f745-461d-9f32-8d42469a6bfc for instance with vm_state stopped and task_state None.
Oct 16 18:48:00 user nova-compute[74247]: DEBUG nova.compute.manager [req-2c163e25-bbe4-432b-bd89-1f1a69f97eba req-87967196-81ee-48a6-a218-a08c8cd6d8fd service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Received event network-vif-plugged-77ca2d19-f745-461d-9f32-8d42469a6bfc {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:48:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-2c163e25-bbe4-432b-bd89-1f1a69f97eba req-87967196-81ee-48a6-a218-a08c8cd6d8fd service nova] Acquiring lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:48:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-2c163e25-bbe4-432b-bd89-1f1a69f97eba req-87967196-81ee-48a6-a218-a08c8cd6d8fd service nova] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:48:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-2c163e25-bbe4-432b-bd89-1f1a69f97eba req-87967196-81ee-48a6-a218-a08c8cd6d8fd service nova] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:48:00 user nova-compute[74247]: DEBUG nova.compute.manager [req-2c163e25-bbe4-432b-bd89-1f1a69f97eba req-87967196-81ee-48a6-a218-a08c8cd6d8fd service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] No waiting events found dispatching network-vif-plugged-77ca2d19-f745-461d-9f32-8d42469a6bfc {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:48:00 user nova-compute[74247]: WARNING nova.compute.manager [req-2c163e25-bbe4-432b-bd89-1f1a69f97eba req-87967196-81ee-48a6-a218-a08c8cd6d8fd service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Received unexpected event network-vif-plugged-77ca2d19-f745-461d-9f32-8d42469a6bfc for instance with vm_state stopped and task_state None.
Oct 16 18:48:00 user nova-compute[74247]: DEBUG nova.compute.manager [req-2c163e25-bbe4-432b-bd89-1f1a69f97eba req-87967196-81ee-48a6-a218-a08c8cd6d8fd service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Received event network-vif-plugged-77ca2d19-f745-461d-9f32-8d42469a6bfc {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:48:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-2c163e25-bbe4-432b-bd89-1f1a69f97eba req-87967196-81ee-48a6-a218-a08c8cd6d8fd service nova] Acquiring lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:48:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-2c163e25-bbe4-432b-bd89-1f1a69f97eba req-87967196-81ee-48a6-a218-a08c8cd6d8fd service nova] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:48:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-2c163e25-bbe4-432b-bd89-1f1a69f97eba req-87967196-81ee-48a6-a218-a08c8cd6d8fd service nova] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:48:00 user nova-compute[74247]: DEBUG nova.compute.manager [req-2c163e25-bbe4-432b-bd89-1f1a69f97eba req-87967196-81ee-48a6-a218-a08c8cd6d8fd service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] No waiting events found dispatching network-vif-plugged-77ca2d19-f745-461d-9f32-8d42469a6bfc {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:48:00 user nova-compute[74247]: WARNING nova.compute.manager [req-2c163e25-bbe4-432b-bd89-1f1a69f97eba req-87967196-81ee-48a6-a218-a08c8cd6d8fd service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Received unexpected event network-vif-plugged-77ca2d19-f745-461d-9f32-8d42469a6bfc for instance with vm_state stopped and task_state None.
Oct 16 18:48:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:01 user nova-compute[74247]: DEBUG nova.compute.manager [req-1af1cde5-148b-498a-8264-1288b628bcd1 req-da138cdb-ad64-44c3-b637-1e0cc8a6885c service nova] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Received event network-vif-plugged-5297bf76-2e6f-4240-819b-12b1594b0fe2 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:48:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1af1cde5-148b-498a-8264-1288b628bcd1 req-da138cdb-ad64-44c3-b637-1e0cc8a6885c service nova] Acquiring lock "075e943e-8f32-4be9-8d02-30584668c34b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:48:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1af1cde5-148b-498a-8264-1288b628bcd1 req-da138cdb-ad64-44c3-b637-1e0cc8a6885c service nova] Lock "075e943e-8f32-4be9-8d02-30584668c34b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:48:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1af1cde5-148b-498a-8264-1288b628bcd1 req-da138cdb-ad64-44c3-b637-1e0cc8a6885c service nova] Lock "075e943e-8f32-4be9-8d02-30584668c34b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:48:01 user nova-compute[74247]: DEBUG nova.compute.manager [req-1af1cde5-148b-498a-8264-1288b628bcd1 req-da138cdb-ad64-44c3-b637-1e0cc8a6885c service nova] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] No waiting events found dispatching network-vif-plugged-5297bf76-2e6f-4240-819b-12b1594b0fe2 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:48:01 user nova-compute[74247]: WARNING nova.compute.manager [req-1af1cde5-148b-498a-8264-1288b628bcd1 req-da138cdb-ad64-44c3-b637-1e0cc8a6885c service nova] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Received unexpected event network-vif-plugged-5297bf76-2e6f-4240-819b-12b1594b0fe2 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 16 18:48:01 user nova-compute[74247]: DEBUG nova.compute.manager [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:48:01 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:48:01 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Instance spawned successfully.
Oct 16 18:48:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:01 user nova-compute[74247]: DEBUG nova.compute.manager [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:48:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-1e7e55ee-8dd7-4cd0-820c-1d6289bc575a tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "075e943e-8f32-4be9-8d02-30584668c34b" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.399s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:48:02 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:02 user nova-compute[74247]: DEBUG nova.compute.manager [req-12f67c2b-4c9d-42d3-84d9-857fc4d08131 req-38827ed5-8cfd-4fa7-90a1-72f43ea79758 service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Received event network-vif-plugged-77ca2d19-f745-461d-9f32-8d42469a6bfc {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:48:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-12f67c2b-4c9d-42d3-84d9-857fc4d08131 req-38827ed5-8cfd-4fa7-90a1-72f43ea79758 service nova] Acquiring lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:48:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-12f67c2b-4c9d-42d3-84d9-857fc4d08131 req-38827ed5-8cfd-4fa7-90a1-72f43ea79758 service nova] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:48:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-12f67c2b-4c9d-42d3-84d9-857fc4d08131 req-38827ed5-8cfd-4fa7-90a1-72f43ea79758 service nova] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:48:02 user nova-compute[74247]: DEBUG nova.compute.manager [req-12f67c2b-4c9d-42d3-84d9-857fc4d08131 req-38827ed5-8cfd-4fa7-90a1-72f43ea79758 service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] No waiting events found dispatching network-vif-plugged-77ca2d19-f745-461d-9f32-8d42469a6bfc {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:48:02 user nova-compute[74247]: WARNING nova.compute.manager [req-12f67c2b-4c9d-42d3-84d9-857fc4d08131 req-38827ed5-8cfd-4fa7-90a1-72f43ea79758 service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Received unexpected event network-vif-plugged-77ca2d19-f745-461d-9f32-8d42469a6bfc for instance with vm_state stopped and task_state None.
Oct 16 18:48:02 user nova-compute[74247]: DEBUG nova.compute.manager [req-12f67c2b-4c9d-42d3-84d9-857fc4d08131 req-38827ed5-8cfd-4fa7-90a1-72f43ea79758 service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Received event network-vif-unplugged-77ca2d19-f745-461d-9f32-8d42469a6bfc {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:48:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-12f67c2b-4c9d-42d3-84d9-857fc4d08131 req-38827ed5-8cfd-4fa7-90a1-72f43ea79758 service nova] Acquiring lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:48:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-12f67c2b-4c9d-42d3-84d9-857fc4d08131 req-38827ed5-8cfd-4fa7-90a1-72f43ea79758 service nova] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:48:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-12f67c2b-4c9d-42d3-84d9-857fc4d08131 req-38827ed5-8cfd-4fa7-90a1-72f43ea79758 service nova] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:48:02 user nova-compute[74247]: DEBUG nova.compute.manager [req-12f67c2b-4c9d-42d3-84d9-857fc4d08131 req-38827ed5-8cfd-4fa7-90a1-72f43ea79758 service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] No waiting events found dispatching network-vif-unplugged-77ca2d19-f745-461d-9f32-8d42469a6bfc {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:48:02 user nova-compute[74247]: WARNING nova.compute.manager [req-12f67c2b-4c9d-42d3-84d9-857fc4d08131 req-38827ed5-8cfd-4fa7-90a1-72f43ea79758 service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Received unexpected event network-vif-unplugged-77ca2d19-f745-461d-9f32-8d42469a6bfc for instance with vm_state stopped and task_state None.
Oct 16 18:48:02 user nova-compute[74247]: DEBUG nova.compute.manager [req-12f67c2b-4c9d-42d3-84d9-857fc4d08131 req-38827ed5-8cfd-4fa7-90a1-72f43ea79758 service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Received event network-vif-plugged-77ca2d19-f745-461d-9f32-8d42469a6bfc {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:48:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-12f67c2b-4c9d-42d3-84d9-857fc4d08131 req-38827ed5-8cfd-4fa7-90a1-72f43ea79758 service nova] Acquiring lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:48:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-12f67c2b-4c9d-42d3-84d9-857fc4d08131 req-38827ed5-8cfd-4fa7-90a1-72f43ea79758 service nova] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:48:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-12f67c2b-4c9d-42d3-84d9-857fc4d08131 req-38827ed5-8cfd-4fa7-90a1-72f43ea79758 service nova] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:48:02 user nova-compute[74247]: DEBUG nova.compute.manager [req-12f67c2b-4c9d-42d3-84d9-857fc4d08131 req-38827ed5-8cfd-4fa7-90a1-72f43ea79758 service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] No waiting events found dispatching network-vif-plugged-77ca2d19-f745-461d-9f32-8d42469a6bfc {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:48:02 user nova-compute[74247]: WARNING nova.compute.manager [req-12f67c2b-4c9d-42d3-84d9-857fc4d08131 req-38827ed5-8cfd-4fa7-90a1-72f43ea79758 service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Received unexpected event network-vif-plugged-77ca2d19-f745-461d-9f32-8d42469a6bfc for instance with vm_state stopped and task_state None.
Oct 16 18:48:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Acquiring lock "50907e5b-73fe-4bd6-9b66-a06cc937acfb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:48:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "50907e5b-73fe-4bd6-9b66-a06cc937acfb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:48:04 user nova-compute[74247]: DEBUG nova.compute.manager [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 18:48:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:48:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:48:04 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:48:04 user nova-compute[74247]: INFO nova.compute.claims [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Claim successful on node user
Oct 16 18:48:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:05 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:48:05 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:48:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.534s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:48:05 user nova-compute[74247]: DEBUG nova.compute.manager [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 18:48:05 user nova-compute[74247]: DEBUG nova.compute.manager [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 18:48:05 user nova-compute[74247]: DEBUG nova.network.neutron [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 18:48:05 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 18:48:05 user nova-compute[74247]: DEBUG nova.compute.manager [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 18:48:05 user nova-compute[74247]: DEBUG nova.policy [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb73af6700c1406994dab6331939fe1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf6596e67794e1794dc93e8e8523ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 18:48:05 user nova-compute[74247]: DEBUG nova.compute.manager [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 18:48:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:48:05 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Creating image(s)
Oct 16 18:48:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Acquiring lock "/opt/stack/data/nova/instances/50907e5b-73fe-4bd6-9b66-a06cc937acfb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:48:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "/opt/stack/data/nova/instances/50907e5b-73fe-4bd6-9b66-a06cc937acfb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:48:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "/opt/stack/data/nova/instances/50907e5b-73fe-4bd6-9b66-a06cc937acfb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:48:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:48:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.211s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:48:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Acquiring lock "37399febbd18f60b85fd0f833558f6a3539ab231" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:48:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:48:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:48:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.236s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:48:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/50907e5b-73fe-4bd6-9b66-a06cc937acfb/disk 1073741824 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:48:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/50907e5b-73fe-4bd6-9b66-a06cc937acfb/disk 1073741824" returned: 0 in 0.087s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:48:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.333s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:48:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:48:06 user nova-compute[74247]: DEBUG nova.network.neutron [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Successfully created port: e42ea480-0315-4ff3-b72a-20c95dd2f615 {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:48:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.258s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:48:06 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Checking if we can resize image /opt/stack/data/nova/instances/50907e5b-73fe-4bd6-9b66-a06cc937acfb/disk. size=1073741824 {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 18:48:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50907e5b-73fe-4bd6-9b66-a06cc937acfb/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:48:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50907e5b-73fe-4bd6-9b66-a06cc937acfb/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:48:06 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Cannot resize image /opt/stack/data/nova/instances/50907e5b-73fe-4bd6-9b66-a06cc937acfb/disk to a smaller size. {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 18:48:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 18:48:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Ensure instance console log exists: /opt/stack/data/nova/instances/50907e5b-73fe-4bd6-9b66-a06cc937acfb/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:48:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:48:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:48:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:48:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:06 user nova-compute[74247]: DEBUG nova.network.neutron [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Successfully updated port: e42ea480-0315-4ff3-b72a-20c95dd2f615 {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:48:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Acquiring lock "refresh_cache-50907e5b-73fe-4bd6-9b66-a06cc937acfb" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:48:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Acquired lock "refresh_cache-50907e5b-73fe-4bd6-9b66-a06cc937acfb" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:48:06 user nova-compute[74247]: DEBUG nova.network.neutron [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:48:06 user nova-compute[74247]: DEBUG nova.compute.manager [req-d9ee3342-e235-471e-8fda-14aae11e249f req-3b48d579-8cec-47bb-9708-5ea504ff0b20 service nova] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Received event network-changed-e42ea480-0315-4ff3-b72a-20c95dd2f615 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:48:06 user nova-compute[74247]: DEBUG nova.compute.manager [req-d9ee3342-e235-471e-8fda-14aae11e249f req-3b48d579-8cec-47bb-9708-5ea504ff0b20 service nova] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Refreshing instance network info cache due to event network-changed-e42ea480-0315-4ff3-b72a-20c95dd2f615. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:48:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d9ee3342-e235-471e-8fda-14aae11e249f req-3b48d579-8cec-47bb-9708-5ea504ff0b20 service nova] Acquiring lock "refresh_cache-50907e5b-73fe-4bd6-9b66-a06cc937acfb" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG nova.network.neutron [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG nova.network.neutron [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Updating instance_info_cache with network_info: [{"id": "e42ea480-0315-4ff3-b72a-20c95dd2f615", "address": "fa:16:3e:aa:e7:5c", "network": {"id": "8e0ea38d-892f-4f82-a321-93292d5bea90", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-201299230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf6596e67794e1794dc93e8e8523ae7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape42ea480-03", "ovs_interfaceid": "e42ea480-0315-4ff3-b72a-20c95dd2f615", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Releasing lock "refresh_cache-50907e5b-73fe-4bd6-9b66-a06cc937acfb" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG nova.compute.manager [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Instance network_info: |[{"id": "e42ea480-0315-4ff3-b72a-20c95dd2f615", "address": "fa:16:3e:aa:e7:5c", "network": {"id": "8e0ea38d-892f-4f82-a321-93292d5bea90", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-201299230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf6596e67794e1794dc93e8e8523ae7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape42ea480-03", "ovs_interfaceid": "e42ea480-0315-4ff3-b72a-20c95dd2f615", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d9ee3342-e235-471e-8fda-14aae11e249f req-3b48d579-8cec-47bb-9708-5ea504ff0b20 service nova] Acquired lock "refresh_cache-50907e5b-73fe-4bd6-9b66-a06cc937acfb" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG nova.network.neutron [req-d9ee3342-e235-471e-8fda-14aae11e249f req-3b48d579-8cec-47bb-9708-5ea504ff0b20 service nova] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Refreshing network info cache for port e42ea480-0315-4ff3-b72a-20c95dd2f615 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Start _get_guest_xml network_info=[{"id": "e42ea480-0315-4ff3-b72a-20c95dd2f615", "address": "fa:16:3e:aa:e7:5c", "network": {"id": "8e0ea38d-892f-4f82-a321-93292d5bea90", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-201299230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf6596e67794e1794dc93e8e8523ae7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape42ea480-03", "ovs_interfaceid": "e42ea480-0315-4ff3-b72a-20c95dd2f615", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': '83126bb1-29f5-42fe-8620-72ab0797f776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:48:07 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:48:07 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:48:07 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:48:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2056155157',display_name='tempest-VolumesSnapshotTestJSON-instance-2056155157',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2056155157',id=36,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9w/aStmWdadF47Ios/TLgR9mBghK2GMSEIpPs7I1XHFa4KMvBmPXSKG0t+PuA3rdLNlkC0jk5rximJcKm4af0COV8gLCum0Q8FAkjTHudAdELIYMKURPtrvGbpo+HAFw==',key_name='tempest-keypair-1153482716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eaf6596e67794e1794dc93e8e8523ae7',ramdisk_id='',reservation_id='r-cpoovi0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-730943931',owner_user_name='tempest-VolumesSnapshotTestJSON-730943931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:48:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb73af6700c1406994dab6331939fe1b',uuid=50907e5b-73fe-4bd6-9b66-a06cc937acfb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e42ea480-0315-4ff3-b72a-20c95dd2f615", "address": "fa:16:3e:aa:e7:5c", "network": {"id": "8e0ea38d-892f-4f82-a321-93292d5bea90", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-201299230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf6596e67794e1794dc93e8e8523ae7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape42ea480-03", "ovs_interfaceid": "e42ea480-0315-4ff3-b72a-20c95dd2f615", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Converting VIF {"id": "e42ea480-0315-4ff3-b72a-20c95dd2f615", "address": "fa:16:3e:aa:e7:5c", "network": {"id": "8e0ea38d-892f-4f82-a321-93292d5bea90", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-201299230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf6596e67794e1794dc93e8e8523ae7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape42ea480-03", "ovs_interfaceid": "e42ea480-0315-4ff3-b72a-20c95dd2f615", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:e7:5c,bridge_name='br-int',has_traffic_filtering=True,id=e42ea480-0315-4ff3-b72a-20c95dd2f615,network=Network(8e0ea38d-892f-4f82-a321-93292d5bea90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape42ea480-03') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG nova.objects.instance [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lazy-loading 'pci_devices' on Instance uuid 50907e5b-73fe-4bd6-9b66-a06cc937acfb {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:48:07 user nova-compute[74247]:   <uuid>50907e5b-73fe-4bd6-9b66-a06cc937acfb</uuid>
Oct 16 18:48:07 user nova-compute[74247]:   <name>instance-00000024</name>
Oct 16 18:48:07 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:48:07 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:48:07 user nova-compute[74247]:   <metadata>
Oct 16 18:48:07 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:48:07 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:48:07 user nova-compute[74247]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2056155157</nova:name>
Oct 16 18:48:07 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:48:07</nova:creationTime>
Oct 16 18:48:07 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:48:07 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:48:07 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:48:07 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:48:07 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:48:07 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:48:07 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:48:07 user nova-compute[74247]:       <nova:owner>
Oct 16 18:48:07 user nova-compute[74247]:         <nova:user uuid="bb73af6700c1406994dab6331939fe1b">tempest-VolumesSnapshotTestJSON-730943931-project-member</nova:user>
Oct 16 18:48:07 user nova-compute[74247]:         <nova:project uuid="eaf6596e67794e1794dc93e8e8523ae7">tempest-VolumesSnapshotTestJSON-730943931</nova:project>
Oct 16 18:48:07 user nova-compute[74247]:       </nova:owner>
Oct 16 18:48:07 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:48:07 user nova-compute[74247]:       <nova:ports>
Oct 16 18:48:07 user nova-compute[74247]:         <nova:port uuid="e42ea480-0315-4ff3-b72a-20c95dd2f615">
Oct 16 18:48:07 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 16 18:48:07 user nova-compute[74247]:         </nova:port>
Oct 16 18:48:07 user nova-compute[74247]:       </nova:ports>
Oct 16 18:48:07 user nova-compute[74247]:     </nova:instance>
Oct 16 18:48:07 user nova-compute[74247]:   </metadata>
Oct 16 18:48:07 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:48:07 user nova-compute[74247]:     <system>
Oct 16 18:48:07 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:48:07 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:48:07 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:48:07 user nova-compute[74247]:       <entry name="serial">50907e5b-73fe-4bd6-9b66-a06cc937acfb</entry>
Oct 16 18:48:07 user nova-compute[74247]:       <entry name="uuid">50907e5b-73fe-4bd6-9b66-a06cc937acfb</entry>
Oct 16 18:48:07 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:48:07 user nova-compute[74247]:     </system>
Oct 16 18:48:07 user nova-compute[74247]:   </sysinfo>
Oct 16 18:48:07 user nova-compute[74247]:   <os>
Oct 16 18:48:07 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:48:07 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:48:07 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:48:07 user nova-compute[74247]:   </os>
Oct 16 18:48:07 user nova-compute[74247]:   <features>
Oct 16 18:48:07 user nova-compute[74247]:     <acpi/>
Oct 16 18:48:07 user nova-compute[74247]:     <apic/>
Oct 16 18:48:07 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:48:07 user nova-compute[74247]:   </features>
Oct 16 18:48:07 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:48:07 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:48:07 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:48:07 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:48:07 user nova-compute[74247]:   </clock>
Oct 16 18:48:07 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:48:07 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:48:07 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:48:07 user nova-compute[74247]:   </cpu>
Oct 16 18:48:07 user nova-compute[74247]:   <devices>
Oct 16 18:48:07 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:48:07 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:48:07 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/50907e5b-73fe-4bd6-9b66-a06cc937acfb/disk"/>
Oct 16 18:48:07 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:48:07 user nova-compute[74247]:     </disk>
Oct 16 18:48:07 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:48:07 user nova-compute[74247]:       <mac address="fa:16:3e:aa:e7:5c"/>
Oct 16 18:48:07 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:48:07 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:48:07 user nova-compute[74247]:       <target dev="tape42ea480-03"/>
Oct 16 18:48:07 user nova-compute[74247]:     </interface>
Oct 16 18:48:07 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:48:07 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/50907e5b-73fe-4bd6-9b66-a06cc937acfb/console.log" append="off"/>
Oct 16 18:48:07 user nova-compute[74247]:     </serial>
Oct 16 18:48:07 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:48:07 user nova-compute[74247]:     <video>
Oct 16 18:48:07 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:48:07 user nova-compute[74247]:     </video>
Oct 16 18:48:07 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:48:07 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:48:07 user nova-compute[74247]:     </rng>
Oct 16 18:48:07 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:48:07 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:48:07 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:48:07 user nova-compute[74247]:     </memballoon>
Oct 16 18:48:07 user nova-compute[74247]:   </devices>
Oct 16 18:48:07 user nova-compute[74247]: </domain>
Oct 16 18:48:07 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:48:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2056155157',display_name='tempest-VolumesSnapshotTestJSON-instance-2056155157',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2056155157',id=36,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9w/aStmWdadF47Ios/TLgR9mBghK2GMSEIpPs7I1XHFa4KMvBmPXSKG0t+PuA3rdLNlkC0jk5rximJcKm4af0COV8gLCum0Q8FAkjTHudAdELIYMKURPtrvGbpo+HAFw==',key_name='tempest-keypair-1153482716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eaf6596e67794e1794dc93e8e8523ae7',ramdisk_id='',reservation_id='r-cpoovi0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-730943931',owner_user_name='tempest-VolumesSnapshotTestJSON-730943931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:48:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb73af6700c1406994dab6331939fe1b',uuid=50907e5b-73fe-4bd6-9b66-a06cc937acfb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e42ea480-0315-4ff3-b72a-20c95dd2f615", "address": "fa:16:3e:aa:e7:5c", "network": {"id": "8e0ea38d-892f-4f82-a321-93292d5bea90", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-201299230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf6596e67794e1794dc93e8e8523ae7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape42ea480-03", "ovs_interfaceid": "e42ea480-0315-4ff3-b72a-20c95dd2f615", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Converting VIF {"id": "e42ea480-0315-4ff3-b72a-20c95dd2f615", "address": "fa:16:3e:aa:e7:5c", "network": {"id": "8e0ea38d-892f-4f82-a321-93292d5bea90", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-201299230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf6596e67794e1794dc93e8e8523ae7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape42ea480-03", "ovs_interfaceid": "e42ea480-0315-4ff3-b72a-20c95dd2f615", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:e7:5c,bridge_name='br-int',has_traffic_filtering=True,id=e42ea480-0315-4ff3-b72a-20c95dd2f615,network=Network(8e0ea38d-892f-4f82-a321-93292d5bea90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape42ea480-03') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG os_vif [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:e7:5c,bridge_name='br-int',has_traffic_filtering=True,id=e42ea480-0315-4ff3-b72a-20c95dd2f615,network=Network(8e0ea38d-892f-4f82-a321-93292d5bea90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape42ea480-03') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4038c0b2-f8b4-512d-bb34-24f8ede1553d', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape42ea480-03, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape42ea480-03, col_values=(('qos', UUID('7264fd58-90d6-4a01-870f-663db6e4cd62')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape42ea480-03, col_values=(('external_ids', {'iface-id': 'e42ea480-0315-4ff3-b72a-20c95dd2f615', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:e7:5c', 'vm-uuid': '50907e5b-73fe-4bd6-9b66-a06cc937acfb'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:07 user nova-compute[74247]: INFO os_vif [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:e7:5c,bridge_name='br-int',has_traffic_filtering=True,id=e42ea480-0315-4ff3-b72a-20c95dd2f615,network=Network(8e0ea38d-892f-4f82-a321-93292d5bea90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape42ea480-03')
Oct 16 18:48:07 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] No VIF found with MAC fa:16:3e:aa:e7:5c, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG nova.network.neutron [req-d9ee3342-e235-471e-8fda-14aae11e249f req-3b48d579-8cec-47bb-9708-5ea504ff0b20 service nova] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Updated VIF entry in instance network info cache for port e42ea480-0315-4ff3-b72a-20c95dd2f615. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG nova.network.neutron [req-d9ee3342-e235-471e-8fda-14aae11e249f req-3b48d579-8cec-47bb-9708-5ea504ff0b20 service nova] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Updating instance_info_cache with network_info: [{"id": "e42ea480-0315-4ff3-b72a-20c95dd2f615", "address": "fa:16:3e:aa:e7:5c", "network": {"id": "8e0ea38d-892f-4f82-a321-93292d5bea90", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-201299230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf6596e67794e1794dc93e8e8523ae7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape42ea480-03", "ovs_interfaceid": "e42ea480-0315-4ff3-b72a-20c95dd2f615", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:48:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d9ee3342-e235-471e-8fda-14aae11e249f req-3b48d579-8cec-47bb-9708-5ea504ff0b20 service nova] Releasing lock "refresh_cache-50907e5b-73fe-4bd6-9b66-a06cc937acfb" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:48:08 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:48:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:09 user nova-compute[74247]: DEBUG nova.compute.manager [req-28dd5d88-285e-446d-82b2-95e7b8891b87 req-18721e76-aca6-4003-a4a7-66c9e075db2a service nova] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Received event network-vif-plugged-e42ea480-0315-4ff3-b72a-20c95dd2f615 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:48:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-28dd5d88-285e-446d-82b2-95e7b8891b87 req-18721e76-aca6-4003-a4a7-66c9e075db2a service nova] Acquiring lock "50907e5b-73fe-4bd6-9b66-a06cc937acfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:48:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-28dd5d88-285e-446d-82b2-95e7b8891b87 req-18721e76-aca6-4003-a4a7-66c9e075db2a service nova] Lock "50907e5b-73fe-4bd6-9b66-a06cc937acfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:48:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-28dd5d88-285e-446d-82b2-95e7b8891b87 req-18721e76-aca6-4003-a4a7-66c9e075db2a service nova] Lock "50907e5b-73fe-4bd6-9b66-a06cc937acfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:48:09 user nova-compute[74247]: DEBUG nova.compute.manager [req-28dd5d88-285e-446d-82b2-95e7b8891b87 req-18721e76-aca6-4003-a4a7-66c9e075db2a service nova] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] No waiting events found dispatching network-vif-plugged-e42ea480-0315-4ff3-b72a-20c95dd2f615 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:48:09 user nova-compute[74247]: WARNING nova.compute.manager [req-28dd5d88-285e-446d-82b2-95e7b8891b87 req-18721e76-aca6-4003-a4a7-66c9e075db2a service nova] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Received unexpected event network-vif-plugged-e42ea480-0315-4ff3-b72a-20c95dd2f615 for instance with vm_state building and task_state spawning.
Oct 16 18:48:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:09 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:48:10 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:48:11 user nova-compute[74247]: DEBUG nova.compute.manager [req-9168dd93-d47c-4233-b22d-a3d8345da438 req-d0c7e1be-5c35-4d1b-883b-1ff9182a9465 service nova] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Received event network-vif-plugged-e42ea480-0315-4ff3-b72a-20c95dd2f615 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:48:11 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9168dd93-d47c-4233-b22d-a3d8345da438 req-d0c7e1be-5c35-4d1b-883b-1ff9182a9465 service nova] Acquiring lock "50907e5b-73fe-4bd6-9b66-a06cc937acfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:48:11 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9168dd93-d47c-4233-b22d-a3d8345da438 req-d0c7e1be-5c35-4d1b-883b-1ff9182a9465 service nova] Lock "50907e5b-73fe-4bd6-9b66-a06cc937acfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:48:11 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9168dd93-d47c-4233-b22d-a3d8345da438 req-d0c7e1be-5c35-4d1b-883b-1ff9182a9465 service nova] Lock "50907e5b-73fe-4bd6-9b66-a06cc937acfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:48:11 user nova-compute[74247]: DEBUG nova.compute.manager [req-9168dd93-d47c-4233-b22d-a3d8345da438 req-d0c7e1be-5c35-4d1b-883b-1ff9182a9465 service nova] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] No waiting events found dispatching network-vif-plugged-e42ea480-0315-4ff3-b72a-20c95dd2f615 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:48:11 user nova-compute[74247]: WARNING nova.compute.manager [req-9168dd93-d47c-4233-b22d-a3d8345da438 req-d0c7e1be-5c35-4d1b-883b-1ff9182a9465 service nova] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Received unexpected event network-vif-plugged-e42ea480-0315-4ff3-b72a-20c95dd2f615 for instance with vm_state building and task_state spawning.
Oct 16 18:48:11 user nova-compute[74247]: DEBUG nova.compute.manager [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:48:11 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:48:11 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Instance spawned successfully.
Oct 16 18:48:11 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 18:48:11 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:48:11 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:48:11 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:48:11 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:48:11 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:48:11 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:48:11 user nova-compute[74247]: INFO nova.compute.manager [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Took 5.76 seconds to spawn the instance on the hypervisor.
Oct 16 18:48:11 user nova-compute[74247]: DEBUG nova.compute.manager [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:48:11 user nova-compute[74247]: INFO nova.compute.manager [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Took 6.71 seconds to build instance.
Oct 16 18:48:11 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8bd6983b-0c93-4d6a-b3aa-4ffe450e86ec tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "50907e5b-73fe-4bd6-9b66-a06cc937acfb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.862s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:48:11 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:48:11 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 18:48:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:11 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Didn't find any instances for network info cache update. {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 18:48:11 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:48:12 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:12 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:15 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:48:15 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:48:15 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 18:48:15 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:48:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:48:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:48:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:48:15 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 18:48:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:48:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:48:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:48:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:48:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50907e5b-73fe-4bd6-9b66-a06cc937acfb/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:48:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50907e5b-73fe-4bd6-9b66-a06cc937acfb/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:48:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50907e5b-73fe-4bd6-9b66-a06cc937acfb/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:48:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50907e5b-73fe-4bd6-9b66-a06cc937acfb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:48:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:48:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:48:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:48:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:48:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:48:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:48:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:48:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:48:17 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:48:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:48:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:48:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:48:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:48:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:48:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:48:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:48:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:48:18 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:48:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075e943e-8f32-4be9-8d02-30584668c34b/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:48:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075e943e-8f32-4be9-8d02-30584668c34b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:48:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075e943e-8f32-4be9-8d02-30584668c34b/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:48:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075e943e-8f32-4be9-8d02-30584668c34b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:48:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:48:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:48:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:48:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:48:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:19 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:48:19 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:48:19 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=8333MB free_disk=24.747390747070312GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 18:48:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:48:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:48:19 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance cddf4842-1c25-4cc8-914e-af30849e4d6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:48:19 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 958af87e-69d0-4da1-8fcf-90e0f275d62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:48:19 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance d775101d-53a1-48c7-af24-91480be6af61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:48:19 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 7dcc08e9-7439-436b-8d9f-facaf04e22c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:48:19 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 220798e9-aea4-4c79-9737-175ab0598e7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:48:19 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance fa1dea31-91bc-4fda-8fb2-638628b66b3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:48:19 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 075e943e-8f32-4be9-8d02-30584668c34b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:48:19 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 50907e5b-73fe-4bd6-9b66-a06cc937acfb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:48:19 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 18:48:19 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 18:48:19 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:48:19 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:48:19 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 18:48:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.378s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:48:20 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:48:20 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:48:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:37 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:40 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:43 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "15d7f371-8d29-4d34-bafa-3bd3fc1e635a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:48:43 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "15d7f371-8d29-4d34-bafa-3bd3fc1e635a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:48:43 user nova-compute[74247]: DEBUG nova.compute.manager [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 18:48:43 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:48:43 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:48:43 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:48:43 user nova-compute[74247]: INFO nova.compute.claims [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Claim successful on node user
Oct 16 18:48:43 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:48:43 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:48:43 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.343s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:48:43 user nova-compute[74247]: DEBUG nova.compute.manager [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 18:48:43 user nova-compute[74247]: DEBUG nova.compute.manager [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 18:48:43 user nova-compute[74247]: DEBUG nova.network.neutron [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 18:48:43 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 18:48:43 user nova-compute[74247]: DEBUG nova.compute.manager [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 18:48:44 user nova-compute[74247]: INFO nova.virt.block_device [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Booting with volume snapshot 6193cb39-b90f-4217-a6e4-178672c470d2 at /dev/vda
Oct 16 18:48:44 user nova-compute[74247]: DEBUG nova.policy [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9608bf58b70248439dbbcc9db38fba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6144ea4e14c28b085e271175bbf67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 18:48:44 user nova-compute[74247]: DEBUG nova.network.neutron [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Successfully created port: 4e99124d-afd3-48aa-85d8-f1fd277c7842 {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:48:45 user nova-compute[74247]: DEBUG nova.network.neutron [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Successfully updated port: 4e99124d-afd3-48aa-85d8-f1fd277c7842 {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:48:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "refresh_cache-15d7f371-8d29-4d34-bafa-3bd3fc1e635a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:48:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquired lock "refresh_cache-15d7f371-8d29-4d34-bafa-3bd3fc1e635a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:48:45 user nova-compute[74247]: DEBUG nova.network.neutron [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:48:45 user nova-compute[74247]: DEBUG nova.compute.manager [req-66af0e58-edc5-4f16-9a22-38303bdb1eb8 req-54e51889-607b-406f-805b-07b714f201aa service nova] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Received event network-changed-4e99124d-afd3-48aa-85d8-f1fd277c7842 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:48:45 user nova-compute[74247]: DEBUG nova.compute.manager [req-66af0e58-edc5-4f16-9a22-38303bdb1eb8 req-54e51889-607b-406f-805b-07b714f201aa service nova] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Refreshing instance network info cache due to event network-changed-4e99124d-afd3-48aa-85d8-f1fd277c7842. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:48:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-66af0e58-edc5-4f16-9a22-38303bdb1eb8 req-54e51889-607b-406f-805b-07b714f201aa service nova] Acquiring lock "refresh_cache-15d7f371-8d29-4d34-bafa-3bd3fc1e635a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:48:45 user nova-compute[74247]: DEBUG nova.network.neutron [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:48:45 user nova-compute[74247]: DEBUG nova.network.neutron [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Updating instance_info_cache with network_info: [{"id": "4e99124d-afd3-48aa-85d8-f1fd277c7842", "address": "fa:16:3e:29:cc:52", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e99124d-af", "ovs_interfaceid": "4e99124d-afd3-48aa-85d8-f1fd277c7842", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:48:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Releasing lock "refresh_cache-15d7f371-8d29-4d34-bafa-3bd3fc1e635a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:48:45 user nova-compute[74247]: DEBUG nova.compute.manager [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Instance network_info: |[{"id": "4e99124d-afd3-48aa-85d8-f1fd277c7842", "address": "fa:16:3e:29:cc:52", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e99124d-af", "ovs_interfaceid": "4e99124d-afd3-48aa-85d8-f1fd277c7842", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 18:48:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-66af0e58-edc5-4f16-9a22-38303bdb1eb8 req-54e51889-607b-406f-805b-07b714f201aa service nova] Acquired lock "refresh_cache-15d7f371-8d29-4d34-bafa-3bd3fc1e635a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:48:45 user nova-compute[74247]: DEBUG nova.network.neutron [req-66af0e58-edc5-4f16-9a22-38303bdb1eb8 req-54e51889-607b-406f-805b-07b714f201aa service nova] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Refreshing network info cache for port 4e99124d-afd3-48aa-85d8-f1fd277c7842 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:48:45 user nova-compute[74247]: DEBUG nova.network.neutron [req-66af0e58-edc5-4f16-9a22-38303bdb1eb8 req-54e51889-607b-406f-805b-07b714f201aa service nova] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Updated VIF entry in instance network info cache for port 4e99124d-afd3-48aa-85d8-f1fd277c7842. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:48:45 user nova-compute[74247]: DEBUG nova.network.neutron [req-66af0e58-edc5-4f16-9a22-38303bdb1eb8 req-54e51889-607b-406f-805b-07b714f201aa service nova] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Updating instance_info_cache with network_info: [{"id": "4e99124d-afd3-48aa-85d8-f1fd277c7842", "address": "fa:16:3e:29:cc:52", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e99124d-af", "ovs_interfaceid": "4e99124d-afd3-48aa-85d8-f1fd277c7842", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:48:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-66af0e58-edc5-4f16-9a22-38303bdb1eb8 req-54e51889-607b-406f-805b-07b714f201aa service nova] Releasing lock "refresh_cache-15d7f371-8d29-4d34-bafa-3bd3fc1e635a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:48:46 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c6be8c87-2ff3-481f-b1bc-ab7703f8c00a tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "220798e9-aea4-4c79-9737-175ab0598e7e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:48:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c6be8c87-2ff3-481f-b1bc-ab7703f8c00a tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "220798e9-aea4-4c79-9737-175ab0598e7e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:48:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c6be8c87-2ff3-481f-b1bc-ab7703f8c00a tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "220798e9-aea4-4c79-9737-175ab0598e7e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:48:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c6be8c87-2ff3-481f-b1bc-ab7703f8c00a tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "220798e9-aea4-4c79-9737-175ab0598e7e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:48:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c6be8c87-2ff3-481f-b1bc-ab7703f8c00a tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "220798e9-aea4-4c79-9737-175ab0598e7e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:48:47 user nova-compute[74247]: INFO nova.compute.manager [None req-c6be8c87-2ff3-481f-b1bc-ab7703f8c00a tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Terminating instance
Oct 16 18:48:47 user nova-compute[74247]: DEBUG nova.compute.manager [None req-c6be8c87-2ff3-481f-b1bc-ab7703f8c00a tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 18:48:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:47 user nova-compute[74247]: DEBUG nova.compute.manager [req-a7f13fa5-75bc-4a33-902c-4d0d6e9c41b9 req-59daa831-f72c-4beb-95ba-d481c123b41b service nova] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Received event network-vif-unplugged-2d83e040-9c34-466f-8a75-19b3710af8ea {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:48:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a7f13fa5-75bc-4a33-902c-4d0d6e9c41b9 req-59daa831-f72c-4beb-95ba-d481c123b41b service nova] Acquiring lock "220798e9-aea4-4c79-9737-175ab0598e7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:48:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a7f13fa5-75bc-4a33-902c-4d0d6e9c41b9 req-59daa831-f72c-4beb-95ba-d481c123b41b service nova] Lock "220798e9-aea4-4c79-9737-175ab0598e7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:48:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a7f13fa5-75bc-4a33-902c-4d0d6e9c41b9 req-59daa831-f72c-4beb-95ba-d481c123b41b service nova] Lock "220798e9-aea4-4c79-9737-175ab0598e7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:48:47 user nova-compute[74247]: DEBUG nova.compute.manager [req-a7f13fa5-75bc-4a33-902c-4d0d6e9c41b9 req-59daa831-f72c-4beb-95ba-d481c123b41b service nova] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] No waiting events found dispatching network-vif-unplugged-2d83e040-9c34-466f-8a75-19b3710af8ea {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:48:47 user nova-compute[74247]: DEBUG nova.compute.manager [req-a7f13fa5-75bc-4a33-902c-4d0d6e9c41b9 req-59daa831-f72c-4beb-95ba-d481c123b41b service nova] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Received event network-vif-unplugged-2d83e040-9c34-466f-8a75-19b3710af8ea for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:48:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:47 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Instance destroyed successfully.
Oct 16 18:48:47 user nova-compute[74247]: DEBUG nova.objects.instance [None req-c6be8c87-2ff3-481f-b1bc-ab7703f8c00a tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lazy-loading 'resources' on Instance uuid 220798e9-aea4-4c79-9737-175ab0598e7e {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:48:47 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-c6be8c87-2ff3-481f-b1bc-ab7703f8c00a tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:39:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1560515371',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1560515371',id=29,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:39:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bce6164a392e4cc2a027d12c49145e6d',ramdisk_id='',reservation_id='r-yq4dqw9f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-656520712',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:41:21Z,user_data=None,user_id='b01d3e5d2fcb40bc92c3d2fe1236d509',uuid=220798e9-aea4-4c79-9737-175ab0598e7e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d83e040-9c34-466f-8a75-19b3710af8ea", "address": "fa:16:3e:25:a7:be", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d83e040-9c", "ovs_interfaceid": "2d83e040-9c34-466f-8a75-19b3710af8ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:48:47 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-c6be8c87-2ff3-481f-b1bc-ab7703f8c00a tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Converting VIF {"id": "2d83e040-9c34-466f-8a75-19b3710af8ea", "address": "fa:16:3e:25:a7:be", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d83e040-9c", "ovs_interfaceid": "2d83e040-9c34-466f-8a75-19b3710af8ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:48:47 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-c6be8c87-2ff3-481f-b1bc-ab7703f8c00a tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:a7:be,bridge_name='br-int',has_traffic_filtering=True,id=2d83e040-9c34-466f-8a75-19b3710af8ea,network=Network(2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d83e040-9c') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:48:47 user nova-compute[74247]: DEBUG os_vif [None req-c6be8c87-2ff3-481f-b1bc-ab7703f8c00a tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:a7:be,bridge_name='br-int',has_traffic_filtering=True,id=2d83e040-9c34-466f-8a75-19b3710af8ea,network=Network(2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d83e040-9c') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:48:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d83e040-9c, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:48:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:48:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2f7cacb6-ede4-40b5-ae65-755f8a157062) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:48:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:48:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:47 user nova-compute[74247]: INFO os_vif [None req-c6be8c87-2ff3-481f-b1bc-ab7703f8c00a tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:a7:be,bridge_name='br-int',has_traffic_filtering=True,id=2d83e040-9c34-466f-8a75-19b3710af8ea,network=Network(2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d83e040-9c')
Oct 16 18:48:47 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-c6be8c87-2ff3-481f-b1bc-ab7703f8c00a tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Deleting instance files /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e_del
Oct 16 18:48:47 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-c6be8c87-2ff3-481f-b1bc-ab7703f8c00a tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Deletion of /opt/stack/data/nova/instances/220798e9-aea4-4c79-9737-175ab0598e7e_del complete
Oct 16 18:48:47 user nova-compute[74247]: INFO nova.compute.manager [None req-c6be8c87-2ff3-481f-b1bc-ab7703f8c00a tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Took 0.74 seconds to destroy the instance on the hypervisor.
Oct 16 18:48:47 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-c6be8c87-2ff3-481f-b1bc-ab7703f8c00a tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 18:48:47 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 18:48:47 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 18:48:48 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:48:48 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Took 0.55 seconds to deallocate network for instance.
Oct 16 18:48:48 user nova-compute[74247]: DEBUG nova.compute.manager [req-06f1933a-8214-4014-9049-cbd5efe7513a req-7019f516-17d1-4130-a6d5-2e736283287b service nova] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Received event network-vif-deleted-2d83e040-9c34-466f-8a75-19b3710af8ea {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:48:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c6be8c87-2ff3-481f-b1bc-ab7703f8c00a tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:48:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c6be8c87-2ff3-481f-b1bc-ab7703f8c00a tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:48:48 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-c6be8c87-2ff3-481f-b1bc-ab7703f8c00a tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:48:48 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-c6be8c87-2ff3-481f-b1bc-ab7703f8c00a tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:48:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c6be8c87-2ff3-481f-b1bc-ab7703f8c00a tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.273s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:48:48 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-c6be8c87-2ff3-481f-b1bc-ab7703f8c00a tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Deleted allocations for instance 220798e9-aea4-4c79-9737-175ab0598e7e
Oct 16 18:48:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c6be8c87-2ff3-481f-b1bc-ab7703f8c00a tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "220798e9-aea4-4c79-9737-175ab0598e7e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.752s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:48:49 user nova-compute[74247]: DEBUG nova.compute.manager [req-27b60e62-467e-48c1-bd8d-a696f217d94c req-ff2c2269-9121-4a07-a364-8b5b052fcf60 service nova] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Received event network-vif-plugged-2d83e040-9c34-466f-8a75-19b3710af8ea {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:48:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-27b60e62-467e-48c1-bd8d-a696f217d94c req-ff2c2269-9121-4a07-a364-8b5b052fcf60 service nova] Acquiring lock "220798e9-aea4-4c79-9737-175ab0598e7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:48:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-27b60e62-467e-48c1-bd8d-a696f217d94c req-ff2c2269-9121-4a07-a364-8b5b052fcf60 service nova] Lock "220798e9-aea4-4c79-9737-175ab0598e7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:48:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-27b60e62-467e-48c1-bd8d-a696f217d94c req-ff2c2269-9121-4a07-a364-8b5b052fcf60 service nova] Lock "220798e9-aea4-4c79-9737-175ab0598e7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:48:49 user nova-compute[74247]: DEBUG nova.compute.manager [req-27b60e62-467e-48c1-bd8d-a696f217d94c req-ff2c2269-9121-4a07-a364-8b5b052fcf60 service nova] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] No waiting events found dispatching network-vif-plugged-2d83e040-9c34-466f-8a75-19b3710af8ea {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:48:49 user nova-compute[74247]: WARNING nova.compute.manager [req-27b60e62-467e-48c1-bd8d-a696f217d94c req-ff2c2269-9121-4a07-a364-8b5b052fcf60 service nova] [instance: 220798e9-aea4-4c79-9737-175ab0598e7e] Received unexpected event network-vif-plugged-2d83e040-9c34-466f-8a75-19b3710af8ea for instance with vm_state deleted and task_state None.
Oct 16 18:48:49 user nova-compute[74247]: DEBUG os_brick.utils [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:48:49 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:48:49 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:48:49 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[972c2cfd-a494-4261-abbe-23ea5f433148]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:48:49 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:48:49 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:48:49 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cfed1a-94bc-4565-a812-53a2bcd86263]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:48:49 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:48:49 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:48:49 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aafd3cc-fcbd-40d0-afc2-54ac2e0f7662]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:48:49 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[214f6b4d-4eb0-4ae0-aa8f-56aa1c79cc51]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:48:49 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:48:49 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:48:49 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 18:48:49 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:48:49 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:48:49 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 18:48:49 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6295a4-33cd-4edc-8ac5-c0241c874a5e]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:48:49 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 18:48:49 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 18:48:49 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 18:48:49 user nova-compute[74247]: DEBUG os_brick.utils [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:48:49 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Updating existing volume attachment record: 7fe9ce5b-0207-4dc1-afd1-472b35b36fde {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 18:48:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:52 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-d527887f-e027-443d-8780-8b882f322e2a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquiring lock "d775101d-53a1-48c7-af24-91480be6af61" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:48:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-d527887f-e027-443d-8780-8b882f322e2a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "d775101d-53a1-48c7-af24-91480be6af61" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:48:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-d527887f-e027-443d-8780-8b882f322e2a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquiring lock "d775101d-53a1-48c7-af24-91480be6af61-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:48:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-d527887f-e027-443d-8780-8b882f322e2a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "d775101d-53a1-48c7-af24-91480be6af61-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:48:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-d527887f-e027-443d-8780-8b882f322e2a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "d775101d-53a1-48c7-af24-91480be6af61-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:48:59 user nova-compute[74247]: INFO nova.compute.manager [None req-d527887f-e027-443d-8780-8b882f322e2a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] Terminating instance
Oct 16 18:48:59 user nova-compute[74247]: DEBUG nova.compute.manager [None req-d527887f-e027-443d-8780-8b882f322e2a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 18:48:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:59 user nova-compute[74247]: DEBUG nova.compute.manager [req-c2b493d7-5d51-4304-9e04-1baf3e8bf737 req-9bc5bc12-6c04-414a-a0e4-673ac1277fea service nova] [instance: d775101d-53a1-48c7-af24-91480be6af61] Received event network-vif-unplugged-646f5b58-acad-402e-bdf5-e5bd423c69e8 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:48:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c2b493d7-5d51-4304-9e04-1baf3e8bf737 req-9bc5bc12-6c04-414a-a0e4-673ac1277fea service nova] Acquiring lock "d775101d-53a1-48c7-af24-91480be6af61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:48:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c2b493d7-5d51-4304-9e04-1baf3e8bf737 req-9bc5bc12-6c04-414a-a0e4-673ac1277fea service nova] Lock "d775101d-53a1-48c7-af24-91480be6af61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:48:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c2b493d7-5d51-4304-9e04-1baf3e8bf737 req-9bc5bc12-6c04-414a-a0e4-673ac1277fea service nova] Lock "d775101d-53a1-48c7-af24-91480be6af61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:48:59 user nova-compute[74247]: DEBUG nova.compute.manager [req-c2b493d7-5d51-4304-9e04-1baf3e8bf737 req-9bc5bc12-6c04-414a-a0e4-673ac1277fea service nova] [instance: d775101d-53a1-48c7-af24-91480be6af61] No waiting events found dispatching network-vif-unplugged-646f5b58-acad-402e-bdf5-e5bd423c69e8 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:48:59 user nova-compute[74247]: DEBUG nova.compute.manager [req-c2b493d7-5d51-4304-9e04-1baf3e8bf737 req-9bc5bc12-6c04-414a-a0e4-673ac1277fea service nova] [instance: d775101d-53a1-48c7-af24-91480be6af61] Received event network-vif-unplugged-646f5b58-acad-402e-bdf5-e5bd423c69e8 for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:48:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:48:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:00 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: d775101d-53a1-48c7-af24-91480be6af61] Instance destroyed successfully.
Oct 16 18:49:00 user nova-compute[74247]: DEBUG nova.objects.instance [None req-d527887f-e027-443d-8780-8b882f322e2a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lazy-loading 'resources' on Instance uuid d775101d-53a1-48c7-af24-91480be6af61 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:49:00 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-d527887f-e027-443d-8780-8b882f322e2a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:32:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-456531951',display_name='tempest-ServerRescueNegativeTestJSON-server-456531951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-456531951',id=20,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:34:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16160dad45544c6e8d9758e883089822',ramdisk_id='',reservation_id='r-p6ml07y9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2007731322',owner_user_name='tempest-ServerRescueNegativeTestJSON-2007731322-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:34:21Z,user_data=None,user_id='51026968ba1f49eaa8e0cc27a81855db',uuid=d775101d-53a1-48c7-af24-91480be6af61,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "646f5b58-acad-402e-bdf5-e5bd423c69e8", "address": "fa:16:3e:45:9e:7d", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap646f5b58-ac", "ovs_interfaceid": "646f5b58-acad-402e-bdf5-e5bd423c69e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:49:00 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-d527887f-e027-443d-8780-8b882f322e2a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Converting VIF {"id": "646f5b58-acad-402e-bdf5-e5bd423c69e8", "address": "fa:16:3e:45:9e:7d", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap646f5b58-ac", "ovs_interfaceid": "646f5b58-acad-402e-bdf5-e5bd423c69e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:49:00 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-d527887f-e027-443d-8780-8b882f322e2a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:9e:7d,bridge_name='br-int',has_traffic_filtering=True,id=646f5b58-acad-402e-bdf5-e5bd423c69e8,network=Network(57ee1ccc-d7df-4a86-9234-c3c5f447e051),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap646f5b58-ac') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:49:00 user nova-compute[74247]: DEBUG os_vif [None req-d527887f-e027-443d-8780-8b882f322e2a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:9e:7d,bridge_name='br-int',has_traffic_filtering=True,id=646f5b58-acad-402e-bdf5-e5bd423c69e8,network=Network(57ee1ccc-d7df-4a86-9234-c3c5f447e051),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap646f5b58-ac') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:49:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap646f5b58-ac, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:49:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:49:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f30f72a2-6c54-46fa-8eeb-c7b4cfedd5dc) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:49:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:49:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:00 user nova-compute[74247]: INFO os_vif [None req-d527887f-e027-443d-8780-8b882f322e2a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:9e:7d,bridge_name='br-int',has_traffic_filtering=True,id=646f5b58-acad-402e-bdf5-e5bd423c69e8,network=Network(57ee1ccc-d7df-4a86-9234-c3c5f447e051),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap646f5b58-ac')
Oct 16 18:49:00 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-d527887f-e027-443d-8780-8b882f322e2a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] Deleting instance files /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61_del
Oct 16 18:49:00 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-d527887f-e027-443d-8780-8b882f322e2a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] Deletion of /opt/stack/data/nova/instances/d775101d-53a1-48c7-af24-91480be6af61_del complete
Oct 16 18:49:00 user nova-compute[74247]: INFO nova.compute.manager [None req-d527887f-e027-443d-8780-8b882f322e2a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: d775101d-53a1-48c7-af24-91480be6af61] Took 0.70 seconds to destroy the instance on the hypervisor.
Oct 16 18:49:00 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-d527887f-e027-443d-8780-8b882f322e2a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 18:49:00 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: d775101d-53a1-48c7-af24-91480be6af61] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 18:49:00 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: d775101d-53a1-48c7-af24-91480be6af61] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 18:49:00 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: d775101d-53a1-48c7-af24-91480be6af61] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:49:00 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: d775101d-53a1-48c7-af24-91480be6af61] Took 0.37 seconds to deallocate network for instance.
Oct 16 18:49:00 user nova-compute[74247]: DEBUG nova.compute.manager [req-f2c87e86-ea24-45df-bf52-3615bd204d7d req-c437e964-85b1-4d36-b8b1-7e22b6793d84 service nova] [instance: d775101d-53a1-48c7-af24-91480be6af61] Received event network-vif-deleted-646f5b58-acad-402e-bdf5-e5bd423c69e8 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:49:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-d527887f-e027-443d-8780-8b882f322e2a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:49:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-d527887f-e027-443d-8780-8b882f322e2a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:49:00 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-d527887f-e027-443d-8780-8b882f322e2a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:49:00 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-d527887f-e027-443d-8780-8b882f322e2a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:49:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-d527887f-e027-443d-8780-8b882f322e2a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.281s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:49:00 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-d527887f-e027-443d-8780-8b882f322e2a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Deleted allocations for instance d775101d-53a1-48c7-af24-91480be6af61
Oct 16 18:49:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-d527887f-e027-443d-8780-8b882f322e2a tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "d775101d-53a1-48c7-af24-91480be6af61" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.541s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:49:01 user nova-compute[74247]: DEBUG nova.compute.manager [req-63942ce2-f4fc-4ae4-9d8d-0df5b272edd6 req-f2a9cd4b-eb42-4e81-854a-137de47837f6 service nova] [instance: d775101d-53a1-48c7-af24-91480be6af61] Received event network-vif-plugged-646f5b58-acad-402e-bdf5-e5bd423c69e8 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:49:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-63942ce2-f4fc-4ae4-9d8d-0df5b272edd6 req-f2a9cd4b-eb42-4e81-854a-137de47837f6 service nova] Acquiring lock "d775101d-53a1-48c7-af24-91480be6af61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:49:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-63942ce2-f4fc-4ae4-9d8d-0df5b272edd6 req-f2a9cd4b-eb42-4e81-854a-137de47837f6 service nova] Lock "d775101d-53a1-48c7-af24-91480be6af61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:49:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-63942ce2-f4fc-4ae4-9d8d-0df5b272edd6 req-f2a9cd4b-eb42-4e81-854a-137de47837f6 service nova] Lock "d775101d-53a1-48c7-af24-91480be6af61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:49:01 user nova-compute[74247]: DEBUG nova.compute.manager [req-63942ce2-f4fc-4ae4-9d8d-0df5b272edd6 req-f2a9cd4b-eb42-4e81-854a-137de47837f6 service nova] [instance: d775101d-53a1-48c7-af24-91480be6af61] No waiting events found dispatching network-vif-plugged-646f5b58-acad-402e-bdf5-e5bd423c69e8 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:49:01 user nova-compute[74247]: WARNING nova.compute.manager [req-63942ce2-f4fc-4ae4-9d8d-0df5b272edd6 req-f2a9cd4b-eb42-4e81-854a-137de47837f6 service nova] [instance: d775101d-53a1-48c7-af24-91480be6af61] Received unexpected event network-vif-plugged-646f5b58-acad-402e-bdf5-e5bd423c69e8 for instance with vm_state deleted and task_state None.
Oct 16 18:49:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG nova.compute.manager [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:49:06 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Creating image(s)
Oct 16 18:49:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Did not create local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Ensure instance console log exists: /opt/stack/data/nova/instances/15d7f371-8d29-4d34-bafa-3bd3fc1e635a/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Start _get_guest_xml network_info=[{"id": "4e99124d-afd3-48aa-85d8-f1fd277c7842", "address": "fa:16:3e:29:cc:52", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e99124d-af", "ovs_interfaceid": "4e99124d-afd3-48aa-85d8-f1fd277c7842", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pELKRICs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '15d7f371-8d29-4d34-bafa-3bd3fc1e635a', 'attached_at': '', 'detached_at': '', 'volume_id': '75b78bf5-051d-4b0b-ac05-23ad92dced2a', 'serial': '75b78bf5-051d-4b0b-ac05-23ad92dced2a'}, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '7fe9ce5b-0207-4dc1-afd1-472b35b36fde', 'guest_format': None, 'volume_type': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:49:06 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:49:06 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:49:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pELKRICs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:49:06 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:49:06 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:49:06 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:49:06 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:49:06 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:49:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[031c4c94-9b33-407b-b69f-5c4cce10258d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 18:49:06 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48d3a97-b981-4a05-a025-20311f223676]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a] added
Oct 16 18:49:06 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[717d274a-644e-43e2-a1a4-11bcd28269f7]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae122081-b0d4-4f62-be82-054672bcfab3]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pELKRICs {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pELKRICs" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4bc5dd-79d4-4702-a856-07887263154f]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pELKRICs'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb7353e-b9bb-47ae-a47c-741884d52f1d]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6df63ee-7e43-4358-85b7-faae2f0457d1]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:49:06 user nova-compute[74247]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 (non-flash)
Oct 16 18:49:06 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:49:06 user nova-compute[74247]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 (non-flash)
Oct 16 18:49:06 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[89566ce8-ef03-4f1d-975a-171036dff32e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a, portal: 172.16.0.220,3260]
Oct 16 18:49:06 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a, portal: 172.16.0.220,3260] successful.
Oct 16 18:49:06 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8f170e-c5f8-4d34-904d-56c8eb5d4a54]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef77d2c-27f4-43f1-b55c-a3b7937bae49]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:49:06 user nova-compute[74247]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 (non-flash)
Oct 16 18:49:06 user nova-compute[74247]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a (non-flash)
Oct 16 18:49:06 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:49:06 user nova-compute[74247]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 (non-flash)
Oct 16 18:49:06 user nova-compute[74247]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a (non-flash)
Oct 16 18:49:06 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b470eb-845f-4f54-aa47-cf6d64c7298d]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:06 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: None {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:49:07 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:49:07 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pELKRICs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:49:07 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:49:07 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23433356263373066', 'path': '/dev/sdb'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:49:07 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433356263373066', 'path': '/dev/sdb'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:49:07 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:48:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1356379338',display_name='tempest-TestVolumeBootPattern-server-1356379338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1356379338',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dca6144ea4e14c28b085e271175bbf67',ramdisk_id='',reservation_id='r-ngb5371n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1733357121',owner_user_name='tempest-TestVolumeBootPattern-1733357121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:48:44Z,user_data=None,user_id='9608bf58b70248439dbbcc9db38fba08',uuid=15d7f371-8d29-4d34-bafa-3bd3fc1e635a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e99124d-afd3-48aa-85d8-f1fd277c7842", "address": "fa:16:3e:29:cc:52", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e99124d-af", "ovs_interfaceid": "4e99124d-afd3-48aa-85d8-f1fd277c7842", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:49:07 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Converting VIF {"id": "4e99124d-afd3-48aa-85d8-f1fd277c7842", "address": "fa:16:3e:29:cc:52", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e99124d-af", "ovs_interfaceid": "4e99124d-afd3-48aa-85d8-f1fd277c7842", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:49:07 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:cc:52,bridge_name='br-int',has_traffic_filtering=True,id=4e99124d-afd3-48aa-85d8-f1fd277c7842,network=Network(9688c665-d4b7-4179-9a76-fdf6c3013b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e99124d-af') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:49:07 user nova-compute[74247]: DEBUG nova.objects.instance [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lazy-loading 'pci_devices' on Instance uuid 15d7f371-8d29-4d34-bafa-3bd3fc1e635a {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:49:07 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:49:07 user nova-compute[74247]:   <uuid>15d7f371-8d29-4d34-bafa-3bd3fc1e635a</uuid>
Oct 16 18:49:07 user nova-compute[74247]:   <name>instance-00000025</name>
Oct 16 18:49:07 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:49:07 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:49:07 user nova-compute[74247]:   <metadata>
Oct 16 18:49:07 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:49:07 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:49:07 user nova-compute[74247]:       <nova:name>tempest-TestVolumeBootPattern-server-1356379338</nova:name>
Oct 16 18:49:07 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:49:06</nova:creationTime>
Oct 16 18:49:07 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:49:07 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:49:07 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:49:07 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:49:07 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:49:07 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:49:07 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:49:07 user nova-compute[74247]:       <nova:owner>
Oct 16 18:49:07 user nova-compute[74247]:         <nova:user uuid="9608bf58b70248439dbbcc9db38fba08">tempest-TestVolumeBootPattern-1733357121-project-member</nova:user>
Oct 16 18:49:07 user nova-compute[74247]:         <nova:project uuid="dca6144ea4e14c28b085e271175bbf67">tempest-TestVolumeBootPattern-1733357121</nova:project>
Oct 16 18:49:07 user nova-compute[74247]:       </nova:owner>
Oct 16 18:49:07 user nova-compute[74247]:       <nova:ports>
Oct 16 18:49:07 user nova-compute[74247]:         <nova:port uuid="4e99124d-afd3-48aa-85d8-f1fd277c7842">
Oct 16 18:49:07 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 16 18:49:07 user nova-compute[74247]:         </nova:port>
Oct 16 18:49:07 user nova-compute[74247]:       </nova:ports>
Oct 16 18:49:07 user nova-compute[74247]:     </nova:instance>
Oct 16 18:49:07 user nova-compute[74247]:   </metadata>
Oct 16 18:49:07 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:49:07 user nova-compute[74247]:     <system>
Oct 16 18:49:07 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:49:07 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:49:07 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:49:07 user nova-compute[74247]:       <entry name="serial">15d7f371-8d29-4d34-bafa-3bd3fc1e635a</entry>
Oct 16 18:49:07 user nova-compute[74247]:       <entry name="uuid">15d7f371-8d29-4d34-bafa-3bd3fc1e635a</entry>
Oct 16 18:49:07 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:49:07 user nova-compute[74247]:     </system>
Oct 16 18:49:07 user nova-compute[74247]:   </sysinfo>
Oct 16 18:49:07 user nova-compute[74247]:   <os>
Oct 16 18:49:07 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:49:07 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:49:07 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:49:07 user nova-compute[74247]:   </os>
Oct 16 18:49:07 user nova-compute[74247]:   <features>
Oct 16 18:49:07 user nova-compute[74247]:     <acpi/>
Oct 16 18:49:07 user nova-compute[74247]:     <apic/>
Oct 16 18:49:07 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:49:07 user nova-compute[74247]:   </features>
Oct 16 18:49:07 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:49:07 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:49:07 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:49:07 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:49:07 user nova-compute[74247]:   </clock>
Oct 16 18:49:07 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:49:07 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:49:07 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:49:07 user nova-compute[74247]:   </cpu>
Oct 16 18:49:07 user nova-compute[74247]:   <devices>
Oct 16 18:49:07 user nova-compute[74247]:     <disk type="block" device="disk">
Oct 16 18:49:07 user nova-compute[74247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:49:07 user nova-compute[74247]:       <source dev="/dev/sdb"/>
Oct 16 18:49:07 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:49:07 user nova-compute[74247]:       <serial>75b78bf5-051d-4b0b-ac05-23ad92dced2a</serial>
Oct 16 18:49:07 user nova-compute[74247]:     </disk>
Oct 16 18:49:07 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:49:07 user nova-compute[74247]:       <mac address="fa:16:3e:29:cc:52"/>
Oct 16 18:49:07 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:49:07 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:49:07 user nova-compute[74247]:       <target dev="tap4e99124d-af"/>
Oct 16 18:49:07 user nova-compute[74247]:     </interface>
Oct 16 18:49:07 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:49:07 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/15d7f371-8d29-4d34-bafa-3bd3fc1e635a/console.log" append="off"/>
Oct 16 18:49:07 user nova-compute[74247]:     </serial>
Oct 16 18:49:07 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:49:07 user nova-compute[74247]:     <video>
Oct 16 18:49:07 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:49:07 user nova-compute[74247]:     </video>
Oct 16 18:49:07 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:49:07 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:49:07 user nova-compute[74247]:     </rng>
Oct 16 18:49:07 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:49:07 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:49:07 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:49:07 user nova-compute[74247]:     </memballoon>
Oct 16 18:49:07 user nova-compute[74247]:   </devices>
Oct 16 18:49:07 user nova-compute[74247]: </domain>
Oct 16 18:49:07 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:49:07 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:48:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1356379338',display_name='tempest-TestVolumeBootPattern-server-1356379338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1356379338',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dca6144ea4e14c28b085e271175bbf67',ramdisk_id='',reservation_id='r-ngb5371n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1733357121',owner_user_name='tempest-TestVolumeBootPattern-1733357121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:48:44Z,user_data=None,user_id='9608bf58b70248439dbbcc9db38fba08',uuid=15d7f371-8d29-4d34-bafa-3bd3fc1e635a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e99124d-afd3-48aa-85d8-f1fd277c7842", "address": "fa:16:3e:29:cc:52", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e99124d-af", "ovs_interfaceid": "4e99124d-afd3-48aa-85d8-f1fd277c7842", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:49:07 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Converting VIF {"id": "4e99124d-afd3-48aa-85d8-f1fd277c7842", "address": "fa:16:3e:29:cc:52", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e99124d-af", "ovs_interfaceid": "4e99124d-afd3-48aa-85d8-f1fd277c7842", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:49:07 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:cc:52,bridge_name='br-int',has_traffic_filtering=True,id=4e99124d-afd3-48aa-85d8-f1fd277c7842,network=Network(9688c665-d4b7-4179-9a76-fdf6c3013b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e99124d-af') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:49:07 user nova-compute[74247]: DEBUG os_vif [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:cc:52,bridge_name='br-int',has_traffic_filtering=True,id=4e99124d-afd3-48aa-85d8-f1fd277c7842,network=Network(9688c665-d4b7-4179-9a76-fdf6c3013b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e99124d-af') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:49:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:49:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:49:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '548d621e-7adb-5fba-b899-d6b2b8d729ac', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:49:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:49:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e99124d-af, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:49:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4e99124d-af, col_values=(('qos', UUID('8e29e168-1983-4cbe-a758-98b7ea14de22')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:49:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4e99124d-af, col_values=(('external_ids', {'iface-id': '4e99124d-afd3-48aa-85d8-f1fd277c7842', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:cc:52', 'vm-uuid': '15d7f371-8d29-4d34-bafa-3bd3fc1e635a'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:49:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:49:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:07 user nova-compute[74247]: INFO os_vif [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:cc:52,bridge_name='br-int',has_traffic_filtering=True,id=4e99124d-afd3-48aa-85d8-f1fd277c7842,network=Network(9688c665-d4b7-4179-9a76-fdf6c3013b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e99124d-af')
Oct 16 18:49:07 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:49:07 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] No VIF found with MAC fa:16:3e:29:cc:52, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:49:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:09 user nova-compute[74247]: DEBUG nova.compute.manager [req-0dc857d2-6093-4268-9455-eb99498e4582 req-a1758211-72b2-458b-8579-76c56d5c0e09 service nova] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Received event network-vif-plugged-4e99124d-afd3-48aa-85d8-f1fd277c7842 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:49:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0dc857d2-6093-4268-9455-eb99498e4582 req-a1758211-72b2-458b-8579-76c56d5c0e09 service nova] Acquiring lock "15d7f371-8d29-4d34-bafa-3bd3fc1e635a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:49:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0dc857d2-6093-4268-9455-eb99498e4582 req-a1758211-72b2-458b-8579-76c56d5c0e09 service nova] Lock "15d7f371-8d29-4d34-bafa-3bd3fc1e635a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:49:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0dc857d2-6093-4268-9455-eb99498e4582 req-a1758211-72b2-458b-8579-76c56d5c0e09 service nova] Lock "15d7f371-8d29-4d34-bafa-3bd3fc1e635a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:49:09 user nova-compute[74247]: DEBUG nova.compute.manager [req-0dc857d2-6093-4268-9455-eb99498e4582 req-a1758211-72b2-458b-8579-76c56d5c0e09 service nova] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] No waiting events found dispatching network-vif-plugged-4e99124d-afd3-48aa-85d8-f1fd277c7842 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:49:09 user nova-compute[74247]: WARNING nova.compute.manager [req-0dc857d2-6093-4268-9455-eb99498e4582 req-a1758211-72b2-458b-8579-76c56d5c0e09 service nova] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Received unexpected event network-vif-plugged-4e99124d-afd3-48aa-85d8-f1fd277c7842 for instance with vm_state building and task_state spawning.
Oct 16 18:49:09 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:49:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:11 user nova-compute[74247]: DEBUG nova.compute.manager [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:49:11 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:49:11 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Instance spawned successfully.
Oct 16 18:49:11 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 18:49:11 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:49:11 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:49:11 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:49:11 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:49:11 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:49:11 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:49:11 user nova-compute[74247]: INFO nova.compute.manager [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Took 4.94 seconds to spawn the instance on the hypervisor.
Oct 16 18:49:11 user nova-compute[74247]: DEBUG nova.compute.manager [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:49:11 user nova-compute[74247]: INFO nova.compute.manager [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Took 27.84 seconds to build instance.
Oct 16 18:49:11 user nova-compute[74247]: DEBUG nova.compute.manager [req-43c2bf2d-9970-4f21-abb5-ef3612617fcf req-823ae165-e12f-489e-885a-402f6514b4d5 service nova] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Received event network-vif-plugged-4e99124d-afd3-48aa-85d8-f1fd277c7842 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:49:11 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-43c2bf2d-9970-4f21-abb5-ef3612617fcf req-823ae165-e12f-489e-885a-402f6514b4d5 service nova] Acquiring lock "15d7f371-8d29-4d34-bafa-3bd3fc1e635a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:49:11 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-43c2bf2d-9970-4f21-abb5-ef3612617fcf req-823ae165-e12f-489e-885a-402f6514b4d5 service nova] Lock "15d7f371-8d29-4d34-bafa-3bd3fc1e635a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:49:11 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-43c2bf2d-9970-4f21-abb5-ef3612617fcf req-823ae165-e12f-489e-885a-402f6514b4d5 service nova] Lock "15d7f371-8d29-4d34-bafa-3bd3fc1e635a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:49:11 user nova-compute[74247]: DEBUG nova.compute.manager [req-43c2bf2d-9970-4f21-abb5-ef3612617fcf req-823ae165-e12f-489e-885a-402f6514b4d5 service nova] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] No waiting events found dispatching network-vif-plugged-4e99124d-afd3-48aa-85d8-f1fd277c7842 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:49:11 user nova-compute[74247]: WARNING nova.compute.manager [req-43c2bf2d-9970-4f21-abb5-ef3612617fcf req-823ae165-e12f-489e-885a-402f6514b4d5 service nova] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Received unexpected event network-vif-plugged-4e99124d-afd3-48aa-85d8-f1fd277c7842 for instance with vm_state active and task_state None.
Oct 16 18:49:11 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-d0b4047e-bd6c-47b0-a3d3-b49207639c2c tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "15d7f371-8d29-4d34-bafa-3bd3fc1e635a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.992s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:49:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:12 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:49:12 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 18:49:12 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Rebuilding the list of instances to heal {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 18:49:12 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "refresh_cache-cddf4842-1c25-4cc8-914e-af30849e4d6c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:49:12 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquired lock "refresh_cache-cddf4842-1c25-4cc8-914e-af30849e4d6c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:49:12 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Forcefully refreshing network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 18:49:12 user nova-compute[74247]: DEBUG nova.objects.instance [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lazy-loading 'info_cache' on Instance uuid cddf4842-1c25-4cc8-914e-af30849e4d6c {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:49:12 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:13 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Updating instance_info_cache with network_info: [{"id": "badc9f06-cef7-46bf-8b74-5d53401021f5", "address": "fa:16:3e:c8:ea:de", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbadc9f06-ce", "ovs_interfaceid": "badc9f06-cef7-46bf-8b74-5d53401021f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:49:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Releasing lock "refresh_cache-cddf4842-1c25-4cc8-914e-af30849e4d6c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:49:13 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Updated the network info_cache for instance {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 18:49:13 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:49:13 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:49:15 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:49:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:49:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:49:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:49:15 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 18:49:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50907e5b-73fe-4bd6-9b66-a06cc937acfb/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50907e5b-73fe-4bd6-9b66-a06cc937acfb/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50907e5b-73fe-4bd6-9b66-a06cc937acfb/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50907e5b-73fe-4bd6-9b66-a06cc937acfb/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:16 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:49:16 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:49:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:16 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:49:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075e943e-8f32-4be9-8d02-30584668c34b/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075e943e-8f32-4be9-8d02-30584668c34b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075e943e-8f32-4be9-8d02-30584668c34b/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075e943e-8f32-4be9-8d02-30584668c34b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:18 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:49:18 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:49:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=8272MB free_disk=24.870040893554688GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 18:49:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:49:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:49:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance cddf4842-1c25-4cc8-914e-af30849e4d6c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:49:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 958af87e-69d0-4da1-8fcf-90e0f275d62e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:49:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 7dcc08e9-7439-436b-8d9f-facaf04e22c1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:49:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance fa1dea31-91bc-4fda-8fb2-638628b66b3f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:49:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 075e943e-8f32-4be9-8d02-30584668c34b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:49:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 50907e5b-73fe-4bd6-9b66-a06cc937acfb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:49:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 15d7f371-8d29-4d34-bafa-3bd3fc1e635a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:49:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 18:49:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 18:49:18 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:49:18 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:49:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 18:49:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.418s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:49:19 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:49:19 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:49:19 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:49:19 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 18:49:19 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:49:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:49:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:28 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:49:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:49:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:49:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:49:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:49:37 user nova-compute[74247]: INFO nova.compute.manager [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Terminating instance
Oct 16 18:49:37 user nova-compute[74247]: DEBUG nova.compute.manager [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 18:49:37 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:37 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG nova.compute.manager [req-fe032b35-fd2f-40a8-a8ef-5fbba0bd0731 req-4cc32144-db5b-4c46-af6e-c6332464c9cb service nova] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Received event network-vif-unplugged-b7a0865a-62eb-4517-83ba-eb30ff219e50 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-fe032b35-fd2f-40a8-a8ef-5fbba0bd0731 req-4cc32144-db5b-4c46-af6e-c6332464c9cb service nova] Acquiring lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-fe032b35-fd2f-40a8-a8ef-5fbba0bd0731 req-4cc32144-db5b-4c46-af6e-c6332464c9cb service nova] Lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-fe032b35-fd2f-40a8-a8ef-5fbba0bd0731 req-4cc32144-db5b-4c46-af6e-c6332464c9cb service nova] Lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG nova.compute.manager [req-fe032b35-fd2f-40a8-a8ef-5fbba0bd0731 req-4cc32144-db5b-4c46-af6e-c6332464c9cb service nova] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] No waiting events found dispatching network-vif-unplugged-b7a0865a-62eb-4517-83ba-eb30ff219e50 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG nova.compute.manager [req-fe032b35-fd2f-40a8-a8ef-5fbba0bd0731 req-4cc32144-db5b-4c46-af6e-c6332464c9cb service nova] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Received event network-vif-unplugged-b7a0865a-62eb-4517-83ba-eb30ff219e50 for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:38 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Instance destroyed successfully.
Oct 16 18:49:38 user nova-compute[74247]: DEBUG nova.objects.instance [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lazy-loading 'resources' on Instance uuid 7dcc08e9-7439-436b-8d9f-facaf04e22c1 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:33:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1738372672',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1738372672',id=22,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:35:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bce6164a392e4cc2a027d12c49145e6d',ramdisk_id='',reservation_id='r-lqc3f0nm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-656520712',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:37:36Z,user_data=None,user_id='b01d3e5d2fcb40bc92c3d2fe1236d509',uuid=7dcc08e9-7439-436b-8d9f-facaf04e22c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7a0865a-62eb-4517-83ba-eb30ff219e50", "address": "fa:16:3e:47:07:5d", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a0865a-62", "ovs_interfaceid": "b7a0865a-62eb-4517-83ba-eb30ff219e50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Converting VIF {"id": "b7a0865a-62eb-4517-83ba-eb30ff219e50", "address": "fa:16:3e:47:07:5d", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a0865a-62", "ovs_interfaceid": "b7a0865a-62eb-4517-83ba-eb30ff219e50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:07:5d,bridge_name='br-int',has_traffic_filtering=True,id=b7a0865a-62eb-4517-83ba-eb30ff219e50,network=Network(2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7a0865a-62') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG os_vif [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:07:5d,bridge_name='br-int',has_traffic_filtering=True,id=b7a0865a-62eb-4517-83ba-eb30ff219e50,network=Network(2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7a0865a-62') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7a0865a-62, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=16ae8413-1cd5-4683-a847-b8017ffb425f) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:38 user nova-compute[74247]: INFO os_vif [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:07:5d,bridge_name='br-int',has_traffic_filtering=True,id=b7a0865a-62eb-4517-83ba-eb30ff219e50,network=Network(2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7a0865a-62')
Oct 16 18:49:38 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WMKTPjCc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:49:38 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:49:38 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb86f3d-78ea-4b09-b557-c68b4e778fb9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 18:49:38 user nova-compute[74247]: No targets found.
Oct 16 18:49:38 user nova-compute[74247]: iSNS:
Oct 16 18:49:38 user nova-compute[74247]: No targets found.
Oct 16 18:49:38 user nova-compute[74247]: STATIC:
Oct 16 18:49:38 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a
Oct 16 18:49:38 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:49:38 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:49:38 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc
Oct 16 18:49:38 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:49:38 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:49:38 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33
Oct 16 18:49:38 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:49:38 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:49:38 user nova-compute[74247]: FIRMWARE:
Oct 16 18:49:38 user nova-compute[74247]: No targets found.
Oct 16 18:49:38 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 18:49:38 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 18:49:38 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd341daf-18c5-41a0-b9c2-41c73cab5e93]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5642d0cd-6441-43cb-9bc2-a72538d4d411]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:49:38 user nova-compute[74247]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 (non-flash)
Oct 16 18:49:38 user nova-compute[74247]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a (non-flash)
Oct 16 18:49:38 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc (non-flash)
Oct 16 18:49:38 user nova-compute[74247]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 (non-flash)
Oct 16 18:49:38 user nova-compute[74247]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a (non-flash)
Oct 16 18:49:38 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe048413c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc'): ({'sdc'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Removing single pathed devices sdc {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3dd3b2-894c-494e-b2c0-ef6b5ef48be9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c22efcb-8316-440e-89ad-339a299a28c8]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Flushing IO for device /dev/sdc {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[286ad9db-6614-4a0d-a9aa-3396066ceca7]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.061s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ed8431-a3c4-40da-99f5-161980b264b8]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] SCSI volumes sdc have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.125s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b0e173-8da1-420d-aeca-d9cc27fac9f9]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff505bcc-46a1-4253-9da9-8a50985dc651]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc, portal: 172.16.0.220,3260]
Oct 16 18:49:38 user nova-compute[74247]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc, portal: 172.16.0.220,3260] successful.
Oct 16 18:49:38 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18ceae5-8693-41f8-b319-d937cd5052bc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50e3cf8-89f8-4940-ac47-f24bdb41c68c]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.414s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] <== disconnect_volume: return (415ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 18:49:38 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Deleting instance files /opt/stack/data/nova/instances/7dcc08e9-7439-436b-8d9f-facaf04e22c1_del
Oct 16 18:49:38 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Deletion of /opt/stack/data/nova/instances/7dcc08e9-7439-436b-8d9f-facaf04e22c1_del complete
Oct 16 18:49:38 user nova-compute[74247]: INFO nova.compute.manager [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Took 1.31 seconds to destroy the instance on the hypervisor.
Oct 16 18:49:38 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 18:49:38 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 18:49:39 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:49:39 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Took 0.41 seconds to deallocate network for instance.
Oct 16 18:49:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-72c82950-c52c-4f4e-ab1e-5f8001095084 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquiring lock "075e943e-8f32-4be9-8d02-30584668c34b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:49:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-72c82950-c52c-4f4e-ab1e-5f8001095084 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "075e943e-8f32-4be9-8d02-30584668c34b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:49:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-72c82950-c52c-4f4e-ab1e-5f8001095084 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquiring lock "075e943e-8f32-4be9-8d02-30584668c34b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:49:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-72c82950-c52c-4f4e-ab1e-5f8001095084 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "075e943e-8f32-4be9-8d02-30584668c34b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:49:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-72c82950-c52c-4f4e-ab1e-5f8001095084 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "075e943e-8f32-4be9-8d02-30584668c34b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:49:39 user nova-compute[74247]: INFO nova.compute.manager [None req-72c82950-c52c-4f4e-ab1e-5f8001095084 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Terminating instance
Oct 16 18:49:39 user nova-compute[74247]: DEBUG nova.compute.manager [None req-72c82950-c52c-4f4e-ab1e-5f8001095084 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 18:49:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:39 user nova-compute[74247]: DEBUG nova.compute.manager [req-be0808fd-0600-421b-af7d-a5c96694abfa req-64cfa619-b3cd-4c20-804c-c6f07e7d578a service nova] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Received event network-vif-unplugged-5297bf76-2e6f-4240-819b-12b1594b0fe2 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:49:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-be0808fd-0600-421b-af7d-a5c96694abfa req-64cfa619-b3cd-4c20-804c-c6f07e7d578a service nova] Acquiring lock "075e943e-8f32-4be9-8d02-30584668c34b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:49:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-be0808fd-0600-421b-af7d-a5c96694abfa req-64cfa619-b3cd-4c20-804c-c6f07e7d578a service nova] Lock "075e943e-8f32-4be9-8d02-30584668c34b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:49:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-be0808fd-0600-421b-af7d-a5c96694abfa req-64cfa619-b3cd-4c20-804c-c6f07e7d578a service nova] Lock "075e943e-8f32-4be9-8d02-30584668c34b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:49:39 user nova-compute[74247]: DEBUG nova.compute.manager [req-be0808fd-0600-421b-af7d-a5c96694abfa req-64cfa619-b3cd-4c20-804c-c6f07e7d578a service nova] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] No waiting events found dispatching network-vif-unplugged-5297bf76-2e6f-4240-819b-12b1594b0fe2 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:49:39 user nova-compute[74247]: DEBUG nova.compute.manager [req-be0808fd-0600-421b-af7d-a5c96694abfa req-64cfa619-b3cd-4c20-804c-c6f07e7d578a service nova] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Received event network-vif-unplugged-5297bf76-2e6f-4240-819b-12b1594b0fe2 for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:49:40 user nova-compute[74247]: INFO nova.compute.manager [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Took 0.82 seconds to detach 1 volumes for instance.
Oct 16 18:49:40 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Instance destroyed successfully.
Oct 16 18:49:40 user nova-compute[74247]: DEBUG nova.objects.instance [None req-72c82950-c52c-4f4e-ab1e-5f8001095084 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lazy-loading 'resources' on Instance uuid 075e943e-8f32-4be9-8d02-30584668c34b {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:49:40 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-72c82950-c52c-4f4e-ab1e-5f8001095084 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T18:43:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-246997190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-246997190',id=34,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIhrr+elGpfgxpvDxCYEg3TwFRm9479AxAze0wrEYlT36ZJD5juZ2Mgda1vXnfPW9D0eHXznG5lqW6nzlxRtDM9vSOVC+rVIUMbi26juPUHNHhtCjNg+9DevghtLuUxhQ==',key_name='tempest-keypair-873631301',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:48:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5204c1aec5764c298a206429645eb268',ramdisk_id='',reservation_id='r-7whme9zu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-537076068',owner_user_name='tempest-AttachVolumeShelveTestJSON-537076068-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:48:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bda4c43b45347be96b152caba47b07d',uuid=075e943e-8f32-4be9-8d02-30584668c34b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5297bf76-2e6f-4240-819b-12b1594b0fe2", "address": "fa:16:3e:fd:a6:1e", "network": {"id": "88a1b265-5360-4362-90bc-3506f805688f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-620663417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5204c1aec5764c298a206429645eb268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5297bf76-2e", "ovs_interfaceid": "5297bf76-2e6f-4240-819b-12b1594b0fe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:49:40 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-72c82950-c52c-4f4e-ab1e-5f8001095084 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Converting VIF {"id": "5297bf76-2e6f-4240-819b-12b1594b0fe2", "address": "fa:16:3e:fd:a6:1e", "network": {"id": "88a1b265-5360-4362-90bc-3506f805688f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-620663417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5204c1aec5764c298a206429645eb268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5297bf76-2e", "ovs_interfaceid": "5297bf76-2e6f-4240-819b-12b1594b0fe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:49:40 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-72c82950-c52c-4f4e-ab1e-5f8001095084 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:a6:1e,bridge_name='br-int',has_traffic_filtering=True,id=5297bf76-2e6f-4240-819b-12b1594b0fe2,network=Network(88a1b265-5360-4362-90bc-3506f805688f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5297bf76-2e') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:49:40 user nova-compute[74247]: DEBUG os_vif [None req-72c82950-c52c-4f4e-ab1e-5f8001095084 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:a6:1e,bridge_name='br-int',has_traffic_filtering=True,id=5297bf76-2e6f-4240-819b-12b1594b0fe2,network=Network(88a1b265-5360-4362-90bc-3506f805688f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5297bf76-2e') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:49:40 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:40 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5297bf76-2e, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:49:40 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:40 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:49:40 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:40 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:40 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e1c418b8-950b-40f7-a1d4-9ef2388b52c2) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:49:40 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:40 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:49:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:49:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:49:40 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:40 user nova-compute[74247]: INFO os_vif [None req-72c82950-c52c-4f4e-ab1e-5f8001095084 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:a6:1e,bridge_name='br-int',has_traffic_filtering=True,id=5297bf76-2e6f-4240-819b-12b1594b0fe2,network=Network(88a1b265-5360-4362-90bc-3506f805688f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5297bf76-2e')
Oct 16 18:49:40 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-72c82950-c52c-4f4e-ab1e-5f8001095084 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Deleting instance files /opt/stack/data/nova/instances/075e943e-8f32-4be9-8d02-30584668c34b_del
Oct 16 18:49:40 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-72c82950-c52c-4f4e-ab1e-5f8001095084 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Deletion of /opt/stack/data/nova/instances/075e943e-8f32-4be9-8d02-30584668c34b_del complete
Oct 16 18:49:40 user nova-compute[74247]: DEBUG nova.compute.manager [req-426fcf43-1f1a-4e08-8810-cad065489ec9 req-f0677ea6-34e2-4db3-9956-78c7639681b9 service nova] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Received event network-vif-plugged-b7a0865a-62eb-4517-83ba-eb30ff219e50 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:49:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-426fcf43-1f1a-4e08-8810-cad065489ec9 req-f0677ea6-34e2-4db3-9956-78c7639681b9 service nova] Acquiring lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:49:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-426fcf43-1f1a-4e08-8810-cad065489ec9 req-f0677ea6-34e2-4db3-9956-78c7639681b9 service nova] Lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:49:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-426fcf43-1f1a-4e08-8810-cad065489ec9 req-f0677ea6-34e2-4db3-9956-78c7639681b9 service nova] Lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:49:40 user nova-compute[74247]: DEBUG nova.compute.manager [req-426fcf43-1f1a-4e08-8810-cad065489ec9 req-f0677ea6-34e2-4db3-9956-78c7639681b9 service nova] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] No waiting events found dispatching network-vif-plugged-b7a0865a-62eb-4517-83ba-eb30ff219e50 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:49:40 user nova-compute[74247]: WARNING nova.compute.manager [req-426fcf43-1f1a-4e08-8810-cad065489ec9 req-f0677ea6-34e2-4db3-9956-78c7639681b9 service nova] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Received unexpected event network-vif-plugged-b7a0865a-62eb-4517-83ba-eb30ff219e50 for instance with vm_state deleted and task_state None.
Oct 16 18:49:40 user nova-compute[74247]: DEBUG nova.compute.manager [req-426fcf43-1f1a-4e08-8810-cad065489ec9 req-f0677ea6-34e2-4db3-9956-78c7639681b9 service nova] [instance: 7dcc08e9-7439-436b-8d9f-facaf04e22c1] Received event network-vif-deleted-b7a0865a-62eb-4517-83ba-eb30ff219e50 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:49:40 user nova-compute[74247]: INFO nova.compute.manager [None req-72c82950-c52c-4f4e-ab1e-5f8001095084 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Took 0.69 seconds to destroy the instance on the hypervisor.
Oct 16 18:49:40 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-72c82950-c52c-4f4e-ab1e-5f8001095084 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 18:49:40 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 18:49:40 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 18:49:40 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:49:40 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:49:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.271s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:49:40 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Deleted allocations for instance 7dcc08e9-7439-436b-8d9f-facaf04e22c1
Oct 16 18:49:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e73af6b3-14b9-4ef7-a4fa-be4051215a78 tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "7dcc08e9-7439-436b-8d9f-facaf04e22c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.008s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:49:41 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:49:41 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Took 0.74 seconds to deallocate network for instance.
Oct 16 18:49:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-72c82950-c52c-4f4e-ab1e-5f8001095084 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:49:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-72c82950-c52c-4f4e-ab1e-5f8001095084 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:49:41 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-72c82950-c52c-4f4e-ab1e-5f8001095084 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:49:41 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-72c82950-c52c-4f4e-ab1e-5f8001095084 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:49:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-72c82950-c52c-4f4e-ab1e-5f8001095084 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.239s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:49:41 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-72c82950-c52c-4f4e-ab1e-5f8001095084 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Deleted allocations for instance 075e943e-8f32-4be9-8d02-30584668c34b
Oct 16 18:49:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-72c82950-c52c-4f4e-ab1e-5f8001095084 tempest-AttachVolumeShelveTestJSON-537076068 tempest-AttachVolumeShelveTestJSON-537076068-project-member] Lock "075e943e-8f32-4be9-8d02-30584668c34b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.005s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:49:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:41 user nova-compute[74247]: DEBUG nova.compute.manager [req-37d05bdc-7b17-48f9-bfc0-fda26bfda808 req-4615c09b-2a22-4602-94ab-df1dbcb96c27 service nova] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Received event network-vif-plugged-5297bf76-2e6f-4240-819b-12b1594b0fe2 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:49:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-37d05bdc-7b17-48f9-bfc0-fda26bfda808 req-4615c09b-2a22-4602-94ab-df1dbcb96c27 service nova] Acquiring lock "075e943e-8f32-4be9-8d02-30584668c34b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:49:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-37d05bdc-7b17-48f9-bfc0-fda26bfda808 req-4615c09b-2a22-4602-94ab-df1dbcb96c27 service nova] Lock "075e943e-8f32-4be9-8d02-30584668c34b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:49:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-37d05bdc-7b17-48f9-bfc0-fda26bfda808 req-4615c09b-2a22-4602-94ab-df1dbcb96c27 service nova] Lock "075e943e-8f32-4be9-8d02-30584668c34b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:49:41 user nova-compute[74247]: DEBUG nova.compute.manager [req-37d05bdc-7b17-48f9-bfc0-fda26bfda808 req-4615c09b-2a22-4602-94ab-df1dbcb96c27 service nova] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] No waiting events found dispatching network-vif-plugged-5297bf76-2e6f-4240-819b-12b1594b0fe2 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:49:41 user nova-compute[74247]: WARNING nova.compute.manager [req-37d05bdc-7b17-48f9-bfc0-fda26bfda808 req-4615c09b-2a22-4602-94ab-df1dbcb96c27 service nova] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Received unexpected event network-vif-plugged-5297bf76-2e6f-4240-819b-12b1594b0fe2 for instance with vm_state deleted and task_state None.
Oct 16 18:49:42 user nova-compute[74247]: DEBUG nova.compute.manager [req-1a3cbf04-c6b6-4e08-aa42-7133f5397e1d req-d6df2d29-0829-4f97-a734-f09f7f0874c9 service nova] [instance: 075e943e-8f32-4be9-8d02-30584668c34b] Received event network-vif-deleted-5297bf76-2e6f-4240-819b-12b1594b0fe2 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:49:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4316c877-4efd-4470-9d7e-59d00ab003ba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquiring lock "958af87e-69d0-4da1-8fcf-90e0f275d62e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:49:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4316c877-4efd-4470-9d7e-59d00ab003ba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "958af87e-69d0-4da1-8fcf-90e0f275d62e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:49:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4316c877-4efd-4470-9d7e-59d00ab003ba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquiring lock "958af87e-69d0-4da1-8fcf-90e0f275d62e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:49:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4316c877-4efd-4470-9d7e-59d00ab003ba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "958af87e-69d0-4da1-8fcf-90e0f275d62e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:49:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4316c877-4efd-4470-9d7e-59d00ab003ba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "958af87e-69d0-4da1-8fcf-90e0f275d62e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:49:49 user nova-compute[74247]: INFO nova.compute.manager [None req-4316c877-4efd-4470-9d7e-59d00ab003ba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Terminating instance
Oct 16 18:49:49 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4316c877-4efd-4470-9d7e-59d00ab003ba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 18:49:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG nova.objects.instance [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lazy-loading 'flavor' on Instance uuid fa1dea31-91bc-4fda-8fb2-638628b66b3f {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquiring lock "refresh_cache-fa1dea31-91bc-4fda-8fb2-638628b66b3f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquired lock "refresh_cache-fa1dea31-91bc-4fda-8fb2-638628b66b3f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG nova.network.neutron [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG nova.objects.instance [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lazy-loading 'info_cache' on Instance uuid fa1dea31-91bc-4fda-8fb2-638628b66b3f {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG nova.objects.base [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Object Instance<fa1dea31-91bc-4fda-8fb2-638628b66b3f> lazy-loaded attributes: flavor,info_cache {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG nova.compute.manager [req-ffa37d8f-0a83-4dcb-90ea-d06caf68bb9a req-407caf31-5c6f-46e4-bcfc-91ae3a7d5c1c service nova] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Received event network-vif-unplugged-4457ec1e-80ee-4038-9838-3af879097230 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-ffa37d8f-0a83-4dcb-90ea-d06caf68bb9a req-407caf31-5c6f-46e4-bcfc-91ae3a7d5c1c service nova] Acquiring lock "958af87e-69d0-4da1-8fcf-90e0f275d62e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-ffa37d8f-0a83-4dcb-90ea-d06caf68bb9a req-407caf31-5c6f-46e4-bcfc-91ae3a7d5c1c service nova] Lock "958af87e-69d0-4da1-8fcf-90e0f275d62e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-ffa37d8f-0a83-4dcb-90ea-d06caf68bb9a req-407caf31-5c6f-46e4-bcfc-91ae3a7d5c1c service nova] Lock "958af87e-69d0-4da1-8fcf-90e0f275d62e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG nova.compute.manager [req-ffa37d8f-0a83-4dcb-90ea-d06caf68bb9a req-407caf31-5c6f-46e4-bcfc-91ae3a7d5c1c service nova] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] No waiting events found dispatching network-vif-unplugged-4457ec1e-80ee-4038-9838-3af879097230 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG nova.compute.manager [req-ffa37d8f-0a83-4dcb-90ea-d06caf68bb9a req-407caf31-5c6f-46e4-bcfc-91ae3a7d5c1c service nova] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Received event network-vif-unplugged-4457ec1e-80ee-4038-9838-3af879097230 for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:50 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Instance destroyed successfully.
Oct 16 18:49:50 user nova-compute[74247]: DEBUG nova.objects.instance [None req-4316c877-4efd-4470-9d7e-59d00ab003ba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lazy-loading 'resources' on Instance uuid 958af87e-69d0-4da1-8fcf-90e0f275d62e {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-4316c877-4efd-4470-9d7e-59d00ab003ba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:32:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1308192945',display_name='tempest-ServerRescueNegativeTestJSON-server-1308192945',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1308192945',id=19,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:37:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16160dad45544c6e8d9758e883089822',ramdisk_id='',reservation_id='r-6ds0qsic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2007731322',owner_user_name='tempest-ServerRescueNegativeTestJSON-2007731322-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:39:09Z,user_data=None,user_id='51026968ba1f49eaa8e0cc27a81855db',uuid=958af87e-69d0-4da1-8fcf-90e0f275d62e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4457ec1e-80ee-4038-9838-3af879097230", "address": "fa:16:3e:fb:7d:a8", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4457ec1e-80", "ovs_interfaceid": "4457ec1e-80ee-4038-9838-3af879097230", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-4316c877-4efd-4470-9d7e-59d00ab003ba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Converting VIF {"id": "4457ec1e-80ee-4038-9838-3af879097230", "address": "fa:16:3e:fb:7d:a8", "network": {"id": "57ee1ccc-d7df-4a86-9234-c3c5f447e051", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1440459658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16160dad45544c6e8d9758e883089822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4457ec1e-80", "ovs_interfaceid": "4457ec1e-80ee-4038-9838-3af879097230", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-4316c877-4efd-4470-9d7e-59d00ab003ba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:7d:a8,bridge_name='br-int',has_traffic_filtering=True,id=4457ec1e-80ee-4038-9838-3af879097230,network=Network(57ee1ccc-d7df-4a86-9234-c3c5f447e051),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4457ec1e-80') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG os_vif [None req-4316c877-4efd-4470-9d7e-59d00ab003ba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:7d:a8,bridge_name='br-int',has_traffic_filtering=True,id=4457ec1e-80ee-4038-9838-3af879097230,network=Network(57ee1ccc-d7df-4a86-9234-c3c5f447e051),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4457ec1e-80') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4457ec1e-80, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=44da4aed-4b87-4536-a8e0-d944974ab95e) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:50 user nova-compute[74247]: INFO os_vif [None req-4316c877-4efd-4470-9d7e-59d00ab003ba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:7d:a8,bridge_name='br-int',has_traffic_filtering=True,id=4457ec1e-80ee-4038-9838-3af879097230,network=Network(57ee1ccc-d7df-4a86-9234-c3c5f447e051),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4457ec1e-80')
Oct 16 18:49:50 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-4316c877-4efd-4470-9d7e-59d00ab003ba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Deleting instance files /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e_del
Oct 16 18:49:50 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-4316c877-4efd-4470-9d7e-59d00ab003ba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Deletion of /opt/stack/data/nova/instances/958af87e-69d0-4da1-8fcf-90e0f275d62e_del complete
Oct 16 18:49:50 user nova-compute[74247]: INFO nova.compute.manager [None req-4316c877-4efd-4470-9d7e-59d00ab003ba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Took 0.71 seconds to destroy the instance on the hypervisor.
Oct 16 18:49:50 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-4316c877-4efd-4470-9d7e-59d00ab003ba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG nova.network.neutron [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Updating instance_info_cache with network_info: [{"id": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "address": "fa:16:3e:ea:29:cf", "network": {"id": "14ee32da-d0e3-499f-bd47-721e882b2a57", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-700103883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6d2ba688434391b03a9f3320a360de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77ca2d19-f7", "ovs_interfaceid": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Releasing lock "refresh_cache-fa1dea31-91bc-4fda-8fb2-638628b66b3f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:49:50 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Instance destroyed successfully.
Oct 16 18:49:50 user nova-compute[74247]: DEBUG nova.objects.instance [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lazy-loading 'resources' on Instance uuid fa1dea31-91bc-4fda-8fb2-638628b66b3f {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG nova.objects.base [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Object Instance<fa1dea31-91bc-4fda-8fb2-638628b66b3f> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-659707189',display_name='tempest-AttachVolumeTestJSON-server-659707189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-659707189',id=35,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZNyKtinECwQEZs0xtAfyopWvuS0WcUALkCCqBfwO2f0LJvjht0xSFVuqtR8GKspliYK+mf0usf7lCpwlqMVzv4m9PsNpIcERNXyS11WNd3vgzvglK2WxbIqiF5MPTBmg==',key_name='tempest-keypair-1281053187',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:45:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='1d6d2ba688434391b03a9f3320a360de',ramdisk_id='',reservation_id='r-lyeae496',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1409761379',owner_user_name='tempest-AttachVolumeTestJSON-1409761379-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:48:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82c71a4cbbf8436dbfdc43bb4db65ef1',uuid=fa1dea31-91bc-4fda-8fb2-638628b66b3f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "address": "fa:16:3e:ea:29:cf", "network": {"id": "14ee32da-d0e3-499f-bd47-721e882b2a57", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-700103883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6d2ba688434391b03a9f3320a360de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77ca2d19-f7", "ovs_interfaceid": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Converting VIF {"id": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "address": "fa:16:3e:ea:29:cf", "network": {"id": "14ee32da-d0e3-499f-bd47-721e882b2a57", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-700103883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6d2ba688434391b03a9f3320a360de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77ca2d19-f7", "ovs_interfaceid": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:29:cf,bridge_name='br-int',has_traffic_filtering=True,id=77ca2d19-f745-461d-9f32-8d42469a6bfc,network=Network(14ee32da-d0e3-499f-bd47-721e882b2a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77ca2d19-f7') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG os_vif [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:29:cf,bridge_name='br-int',has_traffic_filtering=True,id=77ca2d19-f745-461d-9f32-8d42469a6bfc,network=Network(14ee32da-d0e3-499f-bd47-721e882b2a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77ca2d19-f7') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77ca2d19-f7, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ea4dc382-a084-44be-9a40-232ea5c24733) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:50 user nova-compute[74247]: INFO os_vif [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:29:cf,bridge_name='br-int',has_traffic_filtering=True,id=77ca2d19-f745-461d-9f32-8d42469a6bfc,network=Network(14ee32da-d0e3-499f-bd47-721e882b2a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77ca2d19-f7')
Oct 16 18:49:50 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jvtxomgk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:49:50 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:49:50 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ca066c-332c-494e-9d92-f84c83df4933]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 18:49:50 user nova-compute[74247]: No targets found.
Oct 16 18:49:50 user nova-compute[74247]: iSNS:
Oct 16 18:49:50 user nova-compute[74247]: No targets found.
Oct 16 18:49:50 user nova-compute[74247]: STATIC:
Oct 16 18:49:50 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a
Oct 16 18:49:50 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:49:50 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:49:50 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33
Oct 16 18:49:50 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:49:50 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:49:50 user nova-compute[74247]: FIRMWARE:
Oct 16 18:49:50 user nova-compute[74247]: No targets found.
Oct 16 18:49:50 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 18:49:50 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 18:49:50 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d214a1a-1543-4388-a038-7707922206ff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab86feea-581d-4dd4-b404-f4a3018b8055]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 (non-flash)
Oct 16 18:49:50 user nova-compute[74247]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a (non-flash)
Oct 16 18:49:50 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 (non-flash)
Oct 16 18:49:50 user nova-compute[74247]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a (non-flash)
Oct 16 18:49:50 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe07815c1f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33'): ({'sdd'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Removing single pathed devices sdd {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5852c4cb-4238-4295-b769-3a1ad950ea94]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd00e1e-6ab4-4c71-87e6-d370020d9311]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Flushing IO for device /dev/sdd {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9927f3d1-799a-41cf-9621-b807b984d738]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d08a6f1-ff63-4a59-8295-ee5f19bc5ae2]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] SCSI volumes sdd have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f4cee5-eb93-4e1a-b0dc-2e5604e20fb2]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:49:50 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[507f6dc5-8490-4331-ae10-96165d5cfa07]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33, portal: 172.16.0.220,3260]
Oct 16 18:49:51 user nova-compute[74247]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33, portal: 172.16.0.220,3260] successful.
Oct 16 18:49:51 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90f1240-2ba8-48fd-ae5a-279ef8e7f5d2]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] <== disconnect_volume: return (305ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Start _get_guest_xml network_info=[{"id": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "address": "fa:16:3e:ea:29:cf", "network": {"id": "14ee32da-d0e3-499f-bd47-721e882b2a57", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-700103883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6d2ba688434391b03a9f3320a360de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77ca2d19-f7", "ovs_interfaceid": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': '83126bb1-29f5-42fe-8620-72ab0797f776'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jvtxomgk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'fa1dea31-91bc-4fda-8fb2-638628b66b3f', 'attached_at': '', 'detached_at': '', 'volume_id': '45f2a888-7a58-4dfb-af98-407e583a6d33', 'serial': '45f2a888-7a58-4dfb-af98-407e583a6d33'}, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'a0300b28-d401-47de-a0d9-72d57d09c26a', 'guest_format': None, 'volume_type': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG nova.objects.instance [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lazy-loading 'numa_topology' on Instance uuid fa1dea31-91bc-4fda-8fb2-638628b66b3f {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:49:51 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Took 0.46 seconds to deallocate network for instance.
Oct 16 18:49:51 user nova-compute[74247]: DEBUG nova.objects.base [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Object Instance<fa1dea31-91bc-4fda-8fb2-638628b66b3f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:49:51 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:49:51 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:49:51 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG nova.objects.instance [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lazy-loading 'vcpu_model' on Instance uuid fa1dea31-91bc-4fda-8fb2-638628b66b3f {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG nova.objects.base [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Object Instance<fa1dea31-91bc-4fda-8fb2-638628b66b3f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jvtxomgk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:49:51 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:49:51 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:49:51 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:49:51 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:49:51 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:49:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4316c877-4efd-4470-9d7e-59d00ab003ba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4316c877-4efd-4470-9d7e-59d00ab003ba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34a5b99-18aa-4302-b2f0-ac799f3aeddd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 18:49:51 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[91dceb1e-fb59-4b70-8b1e-48bf8e2b39f2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33] added
Oct 16 18:49:51 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c398df03-ef3e-4ecd-93e0-c65daa44c055]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[390d23c0-6cf7-4059-b0cf-0271b4d57245]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jvtxomgk {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jvtxomgk" returned: 0 in 0.093s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f190efdb-7692-4d42-a6a5-eb91b1db0cf0]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jvtxomgk'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f349ee4f-1c48-442f-8c30-e80e77ebdbd8]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd8d7cd-f152-4288-a1ca-a895ee1ba565]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a (non-flash)
Oct 16 18:49:51 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a (non-flash)
Oct 16 18:49:51 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4316c877-4efd-4470-9d7e-59d00ab003ba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4316c877-4efd-4470-9d7e-59d00ab003ba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4316c877-4efd-4470-9d7e-59d00ab003ba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.286s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aca6555-65da-4567-8c2e-9f7cbf9ac5ce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33, portal: 172.16.0.220,3260]
Oct 16 18:49:51 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33, portal: 172.16.0.220,3260] successful.
Oct 16 18:49:51 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ceda78-b438-472e-8a7e-5e996b87187c]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:51 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-4316c877-4efd-4470-9d7e-59d00ab003ba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Deleted allocations for instance 958af87e-69d0-4da1-8fcf-90e0f275d62e
Oct 16 18:49:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c48598-aea9-4a9c-8537-c4f4db248853]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a (non-flash)
Oct 16 18:49:51 user nova-compute[74247]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 (non-flash)
Oct 16 18:49:51 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a (non-flash)
Oct 16 18:49:51 user nova-compute[74247]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 (non-flash)
Oct 16 18:49:51 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[792e2550-8a61-4e56-909e-5752ae17c16c]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jvtxomgk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:49:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4316c877-4efd-4470-9d7e-59d00ab003ba tempest-ServerRescueNegativeTestJSON-2007731322 tempest-ServerRescueNegativeTestJSON-2007731322-project-member] Lock "958af87e-69d0-4da1-8fcf-90e0f275d62e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.676s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:49:52 user nova-compute[74247]: DEBUG nova.compute.manager [req-0874c348-3061-43e0-bdd4-c6b96dd89ceb req-7ec3a4ab-dc98-4e95-9fe8-b9d74c12ee6e service nova] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Received event network-vif-plugged-4457ec1e-80ee-4038-9838-3af879097230 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:49:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0874c348-3061-43e0-bdd4-c6b96dd89ceb req-7ec3a4ab-dc98-4e95-9fe8-b9d74c12ee6e service nova] Acquiring lock "958af87e-69d0-4da1-8fcf-90e0f275d62e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:49:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0874c348-3061-43e0-bdd4-c6b96dd89ceb req-7ec3a4ab-dc98-4e95-9fe8-b9d74c12ee6e service nova] Lock "958af87e-69d0-4da1-8fcf-90e0f275d62e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:49:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0874c348-3061-43e0-bdd4-c6b96dd89ceb req-7ec3a4ab-dc98-4e95-9fe8-b9d74c12ee6e service nova] Lock "958af87e-69d0-4da1-8fcf-90e0f275d62e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:49:52 user nova-compute[74247]: DEBUG nova.compute.manager [req-0874c348-3061-43e0-bdd4-c6b96dd89ceb req-7ec3a4ab-dc98-4e95-9fe8-b9d74c12ee6e service nova] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] No waiting events found dispatching network-vif-plugged-4457ec1e-80ee-4038-9838-3af879097230 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:49:52 user nova-compute[74247]: WARNING nova.compute.manager [req-0874c348-3061-43e0-bdd4-c6b96dd89ceb req-7ec3a4ab-dc98-4e95-9fe8-b9d74c12ee6e service nova] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Received unexpected event network-vif-plugged-4457ec1e-80ee-4038-9838-3af879097230 for instance with vm_state deleted and task_state None.
Oct 16 18:49:52 user nova-compute[74247]: DEBUG nova.compute.manager [req-0874c348-3061-43e0-bdd4-c6b96dd89ceb req-7ec3a4ab-dc98-4e95-9fe8-b9d74c12ee6e service nova] [instance: 958af87e-69d0-4da1-8fcf-90e0f275d62e] Received event network-vif-deleted-4457ec1e-80ee-4038-9838-3af879097230 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:49:52 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:49:52 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '26163376361336664', 'path': '/dev/sdc'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:49:52 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163376361336664', 'path': '/dev/sdc'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:49:52 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-659707189',display_name='tempest-AttachVolumeTestJSON-server-659707189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-659707189',id=35,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZNyKtinECwQEZs0xtAfyopWvuS0WcUALkCCqBfwO2f0LJvjht0xSFVuqtR8GKspliYK+mf0usf7lCpwlqMVzv4m9PsNpIcERNXyS11WNd3vgzvglK2WxbIqiF5MPTBmg==',key_name='tempest-keypair-1281053187',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:45:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='1d6d2ba688434391b03a9f3320a360de',ramdisk_id='',reservation_id='r-lyeae496',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1409761379',owner_user_name='tempest-AttachVolumeTestJSON-1409761379-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:48:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82c71a4cbbf8436dbfdc43bb4db65ef1',uuid=fa1dea31-91bc-4fda-8fb2-638628b66b3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "address": "fa:16:3e:ea:29:cf", "network": {"id": "14ee32da-d0e3-499f-bd47-721e882b2a57", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-700103883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6d2ba688434391b03a9f3320a360de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77ca2d19-f7", "ovs_interfaceid": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:49:52 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Converting VIF {"id": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "address": "fa:16:3e:ea:29:cf", "network": {"id": "14ee32da-d0e3-499f-bd47-721e882b2a57", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-700103883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6d2ba688434391b03a9f3320a360de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77ca2d19-f7", "ovs_interfaceid": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:49:52 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:29:cf,bridge_name='br-int',has_traffic_filtering=True,id=77ca2d19-f745-461d-9f32-8d42469a6bfc,network=Network(14ee32da-d0e3-499f-bd47-721e882b2a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77ca2d19-f7') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:49:52 user nova-compute[74247]: DEBUG nova.objects.instance [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lazy-loading 'pci_devices' on Instance uuid fa1dea31-91bc-4fda-8fb2-638628b66b3f {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:49:52 user nova-compute[74247]: DEBUG nova.objects.base [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Object Instance<fa1dea31-91bc-4fda-8fb2-638628b66b3f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:49:52 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:49:52 user nova-compute[74247]:   <uuid>fa1dea31-91bc-4fda-8fb2-638628b66b3f</uuid>
Oct 16 18:49:52 user nova-compute[74247]:   <name>instance-00000023</name>
Oct 16 18:49:52 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:49:52 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:49:52 user nova-compute[74247]:   <metadata>
Oct 16 18:49:52 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:49:52 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:49:52 user nova-compute[74247]:       <nova:name>tempest-AttachVolumeTestJSON-server-659707189</nova:name>
Oct 16 18:49:52 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:49:51</nova:creationTime>
Oct 16 18:49:52 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:49:52 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:49:52 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:49:52 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:49:52 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:49:52 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:49:52 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:49:52 user nova-compute[74247]:       <nova:owner>
Oct 16 18:49:52 user nova-compute[74247]:         <nova:user uuid="82c71a4cbbf8436dbfdc43bb4db65ef1">tempest-AttachVolumeTestJSON-1409761379-project-member</nova:user>
Oct 16 18:49:52 user nova-compute[74247]:         <nova:project uuid="1d6d2ba688434391b03a9f3320a360de">tempest-AttachVolumeTestJSON-1409761379</nova:project>
Oct 16 18:49:52 user nova-compute[74247]:       </nova:owner>
Oct 16 18:49:52 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:49:52 user nova-compute[74247]:       <nova:ports>
Oct 16 18:49:52 user nova-compute[74247]:         <nova:port uuid="77ca2d19-f745-461d-9f32-8d42469a6bfc">
Oct 16 18:49:52 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 16 18:49:52 user nova-compute[74247]:         </nova:port>
Oct 16 18:49:52 user nova-compute[74247]:       </nova:ports>
Oct 16 18:49:52 user nova-compute[74247]:     </nova:instance>
Oct 16 18:49:52 user nova-compute[74247]:   </metadata>
Oct 16 18:49:52 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:49:52 user nova-compute[74247]:     <system>
Oct 16 18:49:52 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:49:52 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:49:52 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:49:52 user nova-compute[74247]:       <entry name="serial">fa1dea31-91bc-4fda-8fb2-638628b66b3f</entry>
Oct 16 18:49:52 user nova-compute[74247]:       <entry name="uuid">fa1dea31-91bc-4fda-8fb2-638628b66b3f</entry>
Oct 16 18:49:52 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:49:52 user nova-compute[74247]:     </system>
Oct 16 18:49:52 user nova-compute[74247]:   </sysinfo>
Oct 16 18:49:52 user nova-compute[74247]:   <os>
Oct 16 18:49:52 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:49:52 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:49:52 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:49:52 user nova-compute[74247]:   </os>
Oct 16 18:49:52 user nova-compute[74247]:   <features>
Oct 16 18:49:52 user nova-compute[74247]:     <acpi/>
Oct 16 18:49:52 user nova-compute[74247]:     <apic/>
Oct 16 18:49:52 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:49:52 user nova-compute[74247]:   </features>
Oct 16 18:49:52 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:49:52 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:49:52 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:49:52 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:49:52 user nova-compute[74247]:   </clock>
Oct 16 18:49:52 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:49:52 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:49:52 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:49:52 user nova-compute[74247]:   </cpu>
Oct 16 18:49:52 user nova-compute[74247]:   <devices>
Oct 16 18:49:52 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:49:52 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:49:52 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk"/>
Oct 16 18:49:52 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:49:52 user nova-compute[74247]:     </disk>
Oct 16 18:49:52 user nova-compute[74247]:     <disk type="block" device="disk">
Oct 16 18:49:52 user nova-compute[74247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:49:52 user nova-compute[74247]:       <source dev="/dev/sdc"/>
Oct 16 18:49:52 user nova-compute[74247]:       <target dev="vdb" bus="virtio"/>
Oct 16 18:49:52 user nova-compute[74247]:       <serial>45f2a888-7a58-4dfb-af98-407e583a6d33</serial>
Oct 16 18:49:52 user nova-compute[74247]:     </disk>
Oct 16 18:49:52 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:49:52 user nova-compute[74247]:       <mac address="fa:16:3e:ea:29:cf"/>
Oct 16 18:49:52 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:49:52 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:49:52 user nova-compute[74247]:       <target dev="tap77ca2d19-f7"/>
Oct 16 18:49:52 user nova-compute[74247]:     </interface>
Oct 16 18:49:52 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:49:52 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/console.log" append="off"/>
Oct 16 18:49:52 user nova-compute[74247]:     </serial>
Oct 16 18:49:52 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:49:52 user nova-compute[74247]:     <video>
Oct 16 18:49:52 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:49:52 user nova-compute[74247]:     </video>
Oct 16 18:49:52 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:49:52 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:49:52 user nova-compute[74247]:     </rng>
Oct 16 18:49:52 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:49:52 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:49:52 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:49:52 user nova-compute[74247]:     </memballoon>
Oct 16 18:49:52 user nova-compute[74247]:   </devices>
Oct 16 18:49:52 user nova-compute[74247]: </domain>
Oct 16 18:49:52 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:49:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:52 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:49:52 user nova-compute[74247]: DEBUG nova.objects.instance [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lazy-loading 'trusted_certs' on Instance uuid fa1dea31-91bc-4fda-8fb2-638628b66b3f {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:49:52 user nova-compute[74247]: DEBUG nova.objects.base [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Object Instance<fa1dea31-91bc-4fda-8fb2-638628b66b3f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:49:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.170s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:53 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk. size=1073741824 {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 18:49:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:53 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:53 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Cannot resize image /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk to a smaller size. {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 18:49:53 user nova-compute[74247]: DEBUG nova.objects.instance [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lazy-loading 'migration_context' on Instance uuid fa1dea31-91bc-4fda-8fb2-638628b66b3f {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:49:53 user nova-compute[74247]: DEBUG nova.objects.base [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Object Instance<fa1dea31-91bc-4fda-8fb2-638628b66b3f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:49:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-659707189',display_name='tempest-AttachVolumeTestJSON-server-659707189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-659707189',id=35,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZNyKtinECwQEZs0xtAfyopWvuS0WcUALkCCqBfwO2f0LJvjht0xSFVuqtR8GKspliYK+mf0usf7lCpwlqMVzv4m9PsNpIcERNXyS11WNd3vgzvglK2WxbIqiF5MPTBmg==',key_name='tempest-keypair-1281053187',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:45:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='1d6d2ba688434391b03a9f3320a360de',ramdisk_id='',reservation_id='r-lyeae496',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1409761379',owner_user_name='tempest-AttachVolumeTestJSON-1409761379-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:48:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82c71a4cbbf8436dbfdc43bb4db65ef1',uuid=fa1dea31-91bc-4fda-8fb2-638628b66b3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "address": "fa:16:3e:ea:29:cf", "network": {"id": "14ee32da-d0e3-499f-bd47-721e882b2a57", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-700103883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6d2ba688434391b03a9f3320a360de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77ca2d19-f7", "ovs_interfaceid": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:49:53 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Converting VIF {"id": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "address": "fa:16:3e:ea:29:cf", "network": {"id": "14ee32da-d0e3-499f-bd47-721e882b2a57", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-700103883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6d2ba688434391b03a9f3320a360de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77ca2d19-f7", "ovs_interfaceid": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:49:53 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:29:cf,bridge_name='br-int',has_traffic_filtering=True,id=77ca2d19-f745-461d-9f32-8d42469a6bfc,network=Network(14ee32da-d0e3-499f-bd47-721e882b2a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77ca2d19-f7') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:49:53 user nova-compute[74247]: DEBUG os_vif [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:29:cf,bridge_name='br-int',has_traffic_filtering=True,id=77ca2d19-f745-461d-9f32-8d42469a6bfc,network=Network(14ee32da-d0e3-499f-bd47-721e882b2a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77ca2d19-f7') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:49:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:49:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:49:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c5760a63-86e1-5b15-ad02-28cb0ebebcde', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:49:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:49:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap77ca2d19-f7, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:49:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap77ca2d19-f7, col_values=(('qos', UUID('c9be7679-1c70-4882-88d1-fc33471a5df2')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:49:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap77ca2d19-f7, col_values=(('external_ids', {'iface-id': '77ca2d19-f745-461d-9f32-8d42469a6bfc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:29:cf', 'vm-uuid': 'fa1dea31-91bc-4fda-8fb2-638628b66b3f'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:49:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:49:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:53 user nova-compute[74247]: INFO os_vif [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:29:cf,bridge_name='br-int',has_traffic_filtering=True,id=77ca2d19-f745-461d-9f32-8d42469a6bfc,network=Network(14ee32da-d0e3-499f-bd47-721e882b2a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77ca2d19-f7')
Oct 16 18:49:54 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:54 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:54 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:54 user nova-compute[74247]: DEBUG nova.compute.manager [req-1925b964-3852-43ac-abfc-61daca736296 req-a3ae38fa-147d-4160-bf7b-7206de17268e service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Received event network-vif-plugged-77ca2d19-f745-461d-9f32-8d42469a6bfc {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:49:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1925b964-3852-43ac-abfc-61daca736296 req-a3ae38fa-147d-4160-bf7b-7206de17268e service nova] Acquiring lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:49:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1925b964-3852-43ac-abfc-61daca736296 req-a3ae38fa-147d-4160-bf7b-7206de17268e service nova] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:49:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1925b964-3852-43ac-abfc-61daca736296 req-a3ae38fa-147d-4160-bf7b-7206de17268e service nova] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:49:54 user nova-compute[74247]: DEBUG nova.compute.manager [req-1925b964-3852-43ac-abfc-61daca736296 req-a3ae38fa-147d-4160-bf7b-7206de17268e service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] No waiting events found dispatching network-vif-plugged-77ca2d19-f745-461d-9f32-8d42469a6bfc {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:49:54 user nova-compute[74247]: WARNING nova.compute.manager [req-1925b964-3852-43ac-abfc-61daca736296 req-a3ae38fa-147d-4160-bf7b-7206de17268e service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Received unexpected event network-vif-plugged-77ca2d19-f745-461d-9f32-8d42469a6bfc for instance with vm_state stopped and task_state powering-on.
Oct 16 18:49:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:55 user nova-compute[74247]: DEBUG nova.compute.manager [req-4bcd951d-7063-4f0d-8d5a-cf973fce0fd7 req-a0332f9c-fc2d-40ba-9a55-3cc7164f5543 service nova] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Received event network-changed-e42ea480-0315-4ff3-b72a-20c95dd2f615 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:49:55 user nova-compute[74247]: DEBUG nova.compute.manager [req-4bcd951d-7063-4f0d-8d5a-cf973fce0fd7 req-a0332f9c-fc2d-40ba-9a55-3cc7164f5543 service nova] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Refreshing instance network info cache due to event network-changed-e42ea480-0315-4ff3-b72a-20c95dd2f615. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:49:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4bcd951d-7063-4f0d-8d5a-cf973fce0fd7 req-a0332f9c-fc2d-40ba-9a55-3cc7164f5543 service nova] Acquiring lock "refresh_cache-50907e5b-73fe-4bd6-9b66-a06cc937acfb" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:49:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4bcd951d-7063-4f0d-8d5a-cf973fce0fd7 req-a0332f9c-fc2d-40ba-9a55-3cc7164f5543 service nova] Acquired lock "refresh_cache-50907e5b-73fe-4bd6-9b66-a06cc937acfb" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:49:55 user nova-compute[74247]: DEBUG nova.network.neutron [req-4bcd951d-7063-4f0d-8d5a-cf973fce0fd7 req-a0332f9c-fc2d-40ba-9a55-3cc7164f5543 service nova] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Refreshing network info cache for port e42ea480-0315-4ff3-b72a-20c95dd2f615 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:49:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Acquiring lock "50907e5b-73fe-4bd6-9b66-a06cc937acfb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:49:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "50907e5b-73fe-4bd6-9b66-a06cc937acfb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:49:55 user nova-compute[74247]: DEBUG nova.objects.instance [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lazy-loading 'flavor' on Instance uuid 50907e5b-73fe-4bd6-9b66-a06cc937acfb {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:49:55 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Ignoring supplied device name: /dev/vdb
Oct 16 18:49:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "50907e5b-73fe-4bd6-9b66-a06cc937acfb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:49:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Acquiring lock "50907e5b-73fe-4bd6-9b66-a06cc937acfb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:49:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "50907e5b-73fe-4bd6-9b66-a06cc937acfb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:49:55 user nova-compute[74247]: INFO nova.compute.manager [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Attaching volume 28d62c2d-e567-4a49-947a-47780757587c to /dev/vdb
Oct 16 18:49:55 user nova-compute[74247]: DEBUG nova.network.neutron [req-4bcd951d-7063-4f0d-8d5a-cf973fce0fd7 req-a0332f9c-fc2d-40ba-9a55-3cc7164f5543 service nova] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Updated VIF entry in instance network info cache for port e42ea480-0315-4ff3-b72a-20c95dd2f615. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:49:55 user nova-compute[74247]: DEBUG nova.network.neutron [req-4bcd951d-7063-4f0d-8d5a-cf973fce0fd7 req-a0332f9c-fc2d-40ba-9a55-3cc7164f5543 service nova] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Updating instance_info_cache with network_info: [{"id": "e42ea480-0315-4ff3-b72a-20c95dd2f615", "address": "fa:16:3e:aa:e7:5c", "network": {"id": "8e0ea38d-892f-4f82-a321-93292d5bea90", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-201299230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf6596e67794e1794dc93e8e8523ae7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape42ea480-03", "ovs_interfaceid": "e42ea480-0315-4ff3-b72a-20c95dd2f615", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:49:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4bcd951d-7063-4f0d-8d5a-cf973fce0fd7 req-a0332f9c-fc2d-40ba-9a55-3cc7164f5543 service nova] Releasing lock "refresh_cache-50907e5b-73fe-4bd6-9b66-a06cc937acfb" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:49:55 user nova-compute[74247]: DEBUG os_brick.utils [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:49:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:55 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f54d43-c061-46c5-9f1a-b05214fe8852]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:55 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc6f770-be49-4a34-b108-ceeffd4b4627]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:49:55 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afd6e29-e2c6-42d5-a874-9cc93058b045]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:55 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e2a795-6b23-41b5-b3f7-59397fad42b7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:49:56 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 18:49:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:49:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:49:56 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 18:49:56 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9511f94-a122-4bec-95ac-39d8ac48f28d]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:49:56 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 18:49:56 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 18:49:56 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 18:49:56 user nova-compute[74247]: DEBUG os_brick.utils [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:49:56 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Updating existing volume attachment record: 6b31f4d2-895d-47ac-be30-aa2c7feca7fc {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 18:49:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:49:56 user nova-compute[74247]: DEBUG nova.compute.manager [req-2c17b811-01f0-4c80-9a18-087eb554d6d7 req-f9539e9e-8182-44c3-87c9-48cabbeca050 service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Received event network-vif-plugged-77ca2d19-f745-461d-9f32-8d42469a6bfc {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:49:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-2c17b811-01f0-4c80-9a18-087eb554d6d7 req-f9539e9e-8182-44c3-87c9-48cabbeca050 service nova] Acquiring lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:49:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-2c17b811-01f0-4c80-9a18-087eb554d6d7 req-f9539e9e-8182-44c3-87c9-48cabbeca050 service nova] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:49:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-2c17b811-01f0-4c80-9a18-087eb554d6d7 req-f9539e9e-8182-44c3-87c9-48cabbeca050 service nova] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:49:56 user nova-compute[74247]: DEBUG nova.compute.manager [req-2c17b811-01f0-4c80-9a18-087eb554d6d7 req-f9539e9e-8182-44c3-87c9-48cabbeca050 service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] No waiting events found dispatching network-vif-plugged-77ca2d19-f745-461d-9f32-8d42469a6bfc {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:49:56 user nova-compute[74247]: WARNING nova.compute.manager [req-2c17b811-01f0-4c80-9a18-087eb554d6d7 req-f9539e9e-8182-44c3-87c9-48cabbeca050 service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Received unexpected event network-vif-plugged-77ca2d19-f745-461d-9f32-8d42469a6bfc for instance with vm_state stopped and task_state powering-on.
Oct 16 18:49:56 user nova-compute[74247]: DEBUG nova.compute.manager [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:49:56 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Instance rebooted successfully.
Oct 16 18:49:56 user nova-compute[74247]: DEBUG nova.compute.manager [None req-ec806dcc-1ddc-4efb-b7d6-c2162ed0037f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:49:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:50:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:50:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:50:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:50:07 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:50:07 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Cleaning up deleted instances with incomplete migration  {{(pid=74247) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 16 18:50:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:50:11 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:50:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PburlZQf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:50:12 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:50:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:50:12 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:50:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:50:12 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:50:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d37bb0f-f562-4484-8c3c-e558dbe787ba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 18:50:12 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7adcf92-dacc-41b9-bbd8-9d157e0d3a22]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c] added
Oct 16 18:50:12 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e8b87b-89ce-44ea-b590-f877d3b09bae]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d39e351-7142-4b1f-833c-91d74668e8b5]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PburlZQf {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PburlZQf" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[db17650b-b439-472b-933f-bfba7909479b]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PburlZQf'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bd0ee7-9685-463c-b735-ad732262e67d]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a9a73d-4e7f-4a89-bf5d-b0c9a58b71b3]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a (non-flash)
Oct 16 18:50:12 user nova-compute[74247]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 (non-flash)
Oct 16 18:50:12 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a (non-flash)
Oct 16 18:50:12 user nova-compute[74247]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 (non-flash)
Oct 16 18:50:12 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98f0850-beae-46b1-9fee-391f0c931ba9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c, portal: 172.16.0.220,3260]
Oct 16 18:50:12 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c, portal: 172.16.0.220,3260] successful.
Oct 16 18:50:12 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Cleaning up deleted instances {{(pid=74247) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2496188b-b1d3-4a89-895d-7e14cd794a9f]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] There are 0 instances to clean {{(pid=74247) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[17578bfd-58fb-466b-bc3c-de9071d36435]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a (non-flash)
Oct 16 18:50:12 user nova-compute[74247]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 (non-flash)
Oct 16 18:50:12 user nova-compute[74247]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c (non-flash)
Oct 16 18:50:12 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a (non-flash)
Oct 16 18:50:12 user nova-compute[74247]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 (non-flash)
Oct 16 18:50:12 user nova-compute[74247]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c (non-flash)
Oct 16 18:50:12 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9eeb20-d5e7-41c0-9ca1-5f2691445890]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:50:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PburlZQf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:50:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:50:13 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:50:13 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:50:13 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 18:50:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:50:13 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23638643631616139', 'path': '/dev/sdd'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:50:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638643631616139', 'path': '/dev/sdd'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:50:13 user nova-compute[74247]: DEBUG nova.objects.instance [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lazy-loading 'flavor' on Instance uuid 50907e5b-73fe-4bd6-9b66-a06cc937acfb {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:50:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 18:50:13 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:50:13 user nova-compute[74247]:   <source dev="/dev/sdd"/>
Oct 16 18:50:13 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:50:13 user nova-compute[74247]:   <serial>28d62c2d-e567-4a49-947a-47780757587c</serial>
Oct 16 18:50:13 user nova-compute[74247]: </disk>
Oct 16 18:50:13 user nova-compute[74247]:  {{(pid=74247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 18:50:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "refresh_cache-fa1dea31-91bc-4fda-8fb2-638628b66b3f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:50:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquired lock "refresh_cache-fa1dea31-91bc-4fda-8fb2-638628b66b3f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:50:13 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Forcefully refreshing network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 18:50:14 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Updating instance_info_cache with network_info: [{"id": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "address": "fa:16:3e:ea:29:cf", "network": {"id": "14ee32da-d0e3-499f-bd47-721e882b2a57", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-700103883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6d2ba688434391b03a9f3320a360de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77ca2d19-f7", "ovs_interfaceid": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:50:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Releasing lock "refresh_cache-fa1dea31-91bc-4fda-8fb2-638628b66b3f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:50:14 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Updated the network info_cache for instance {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 18:50:14 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:50:14 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:50:14 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] No VIF found with MAC fa:16:3e:aa:e7:5c, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:50:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-504c75de-eaad-49b1-97c1-58c8711e1ba8 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "50907e5b-73fe-4bd6-9b66-a06cc937acfb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.464s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:50:14 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:50:14 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:50:15 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:50:16 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:50:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:50:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:50:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:50:16 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 18:50:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:50:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50907e5b-73fe-4bd6-9b66-a06cc937acfb/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:50:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50907e5b-73fe-4bd6-9b66-a06cc937acfb/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:50:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50907e5b-73fe-4bd6-9b66-a06cc937acfb/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:50:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50907e5b-73fe-4bd6-9b66-a06cc937acfb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:50:17 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:50:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:50:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:50:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:50:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:50:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:50:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:50:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:50:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:50:17 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:50:17 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:50:18 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:50:18 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:50:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=8346MB free_disk=24.923656463623047GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 18:50:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:50:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:50:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:50:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance cddf4842-1c25-4cc8-914e-af30849e4d6c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:50:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance fa1dea31-91bc-4fda-8fb2-638628b66b3f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:50:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 50907e5b-73fe-4bd6-9b66-a06cc937acfb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:50:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 15d7f371-8d29-4d34-bafa-3bd3fc1e635a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:50:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 18:50:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 18:50:18 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Refreshing inventories for resource provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 16 18:50:18 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Updating ProviderTree inventory for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 16 18:50:18 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Updating inventory in ProviderTree for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 16 18:50:18 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Refreshing aggregate associations for resource provider 7b8a7b7b-c686-4162-903b-700fbc4d7273, aggregates: None {{(pid=74247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 16 18:50:18 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Refreshing trait associations for resource provider 7b8a7b7b-c686-4162-903b-700fbc4d7273, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=74247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 16 18:50:18 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:50:18 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:50:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 18:50:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.591s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:50:19 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:50:19 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:50:19 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:50:19 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 18:50:21 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:50:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:50:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:50:24 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:50:24 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._sync_power_states {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:50:24 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Triggering sync for uuid cddf4842-1c25-4cc8-914e-af30849e4d6c {{(pid=74247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 18:50:24 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Triggering sync for uuid fa1dea31-91bc-4fda-8fb2-638628b66b3f {{(pid=74247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 18:50:24 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Triggering sync for uuid 50907e5b-73fe-4bd6-9b66-a06cc937acfb {{(pid=74247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 18:50:24 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Triggering sync for uuid 15d7f371-8d29-4d34-bafa-3bd3fc1e635a {{(pid=74247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 18:50:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "cddf4842-1c25-4cc8-914e-af30849e4d6c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:50:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "cddf4842-1c25-4cc8-914e-af30849e4d6c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:50:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:50:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:50:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "50907e5b-73fe-4bd6-9b66-a06cc937acfb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:50:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "50907e5b-73fe-4bd6-9b66-a06cc937acfb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:50:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "15d7f371-8d29-4d34-bafa-3bd3fc1e635a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:50:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "15d7f371-8d29-4d34-bafa-3bd3fc1e635a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:50:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "50907e5b-73fe-4bd6-9b66-a06cc937acfb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:50:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "cddf4842-1c25-4cc8-914e-af30849e4d6c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:50:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:50:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "15d7f371-8d29-4d34-bafa-3bd3fc1e635a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:50:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:50:28 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:50:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5530bfd6-a9a1-4da3-a74d-1b69ab53d3bf tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "cddf4842-1c25-4cc8-914e-af30849e4d6c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:50:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5530bfd6-a9a1-4da3-a74d-1b69ab53d3bf tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "cddf4842-1c25-4cc8-914e-af30849e4d6c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:50:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5530bfd6-a9a1-4da3-a74d-1b69ab53d3bf tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "cddf4842-1c25-4cc8-914e-af30849e4d6c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:50:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5530bfd6-a9a1-4da3-a74d-1b69ab53d3bf tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "cddf4842-1c25-4cc8-914e-af30849e4d6c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:50:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5530bfd6-a9a1-4da3-a74d-1b69ab53d3bf tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "cddf4842-1c25-4cc8-914e-af30849e4d6c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:50:28 user nova-compute[74247]: INFO nova.compute.manager [None req-5530bfd6-a9a1-4da3-a74d-1b69ab53d3bf tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Terminating instance
Oct 16 18:50:28 user nova-compute[74247]: DEBUG nova.compute.manager [None req-5530bfd6-a9a1-4da3-a74d-1b69ab53d3bf tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 18:50:28 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:50:28 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:50:28 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:50:28 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:50:28 user nova-compute[74247]: DEBUG nova.compute.manager [req-7a90ccef-0cf8-49aa-b9b9-b8991eaf7134 req-4c4d6346-abfa-4be2-8e09-eb276a998cae service nova] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Received event network-vif-unplugged-badc9f06-cef7-46bf-8b74-5d53401021f5 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:50:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7a90ccef-0cf8-49aa-b9b9-b8991eaf7134 req-4c4d6346-abfa-4be2-8e09-eb276a998cae service nova] Acquiring lock "cddf4842-1c25-4cc8-914e-af30849e4d6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:50:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7a90ccef-0cf8-49aa-b9b9-b8991eaf7134 req-4c4d6346-abfa-4be2-8e09-eb276a998cae service nova] Lock "cddf4842-1c25-4cc8-914e-af30849e4d6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:50:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7a90ccef-0cf8-49aa-b9b9-b8991eaf7134 req-4c4d6346-abfa-4be2-8e09-eb276a998cae service nova] Lock "cddf4842-1c25-4cc8-914e-af30849e4d6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:50:28 user nova-compute[74247]: DEBUG nova.compute.manager [req-7a90ccef-0cf8-49aa-b9b9-b8991eaf7134 req-4c4d6346-abfa-4be2-8e09-eb276a998cae service nova] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] No waiting events found dispatching network-vif-unplugged-badc9f06-cef7-46bf-8b74-5d53401021f5 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:50:28 user nova-compute[74247]: DEBUG nova.compute.manager [req-7a90ccef-0cf8-49aa-b9b9-b8991eaf7134 req-4c4d6346-abfa-4be2-8e09-eb276a998cae service nova] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Received event network-vif-unplugged-badc9f06-cef7-46bf-8b74-5d53401021f5 for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:50:29 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Instance destroyed successfully.
Oct 16 18:50:29 user nova-compute[74247]: DEBUG nova.objects.instance [None req-5530bfd6-a9a1-4da3-a74d-1b69ab53d3bf tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lazy-loading 'resources' on Instance uuid cddf4842-1c25-4cc8-914e-af30849e4d6c {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:50:29 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-5530bfd6-a9a1-4da3-a74d-1b69ab53d3bf tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:30:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1242575206',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1242575206',id=17,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:30:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bce6164a392e4cc2a027d12c49145e6d',ramdisk_id='',reservation_id='r-c8ezkq53',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-656520712',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:32:46Z,user_data=None,user_id='b01d3e5d2fcb40bc92c3d2fe1236d509',uuid=cddf4842-1c25-4cc8-914e-af30849e4d6c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "badc9f06-cef7-46bf-8b74-5d53401021f5", "address": "fa:16:3e:c8:ea:de", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbadc9f06-ce", "ovs_interfaceid": "badc9f06-cef7-46bf-8b74-5d53401021f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:50:29 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-5530bfd6-a9a1-4da3-a74d-1b69ab53d3bf tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Converting VIF {"id": "badc9f06-cef7-46bf-8b74-5d53401021f5", "address": "fa:16:3e:c8:ea:de", "network": {"id": "2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1524070648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce6164a392e4cc2a027d12c49145e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbadc9f06-ce", "ovs_interfaceid": "badc9f06-cef7-46bf-8b74-5d53401021f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:50:29 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-5530bfd6-a9a1-4da3-a74d-1b69ab53d3bf tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:ea:de,bridge_name='br-int',has_traffic_filtering=True,id=badc9f06-cef7-46bf-8b74-5d53401021f5,network=Network(2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbadc9f06-ce') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:50:29 user nova-compute[74247]: DEBUG os_vif [None req-5530bfd6-a9a1-4da3-a74d-1b69ab53d3bf tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:ea:de,bridge_name='br-int',has_traffic_filtering=True,id=badc9f06-cef7-46bf-8b74-5d53401021f5,network=Network(2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbadc9f06-ce') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:50:29 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:50:29 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbadc9f06-ce, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:50:29 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:50:29 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:50:29 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:50:29 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=54669093-5c46-4295-807b-d2adee1a2069) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:50:29 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:50:29 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:50:29 user nova-compute[74247]: INFO os_vif [None req-5530bfd6-a9a1-4da3-a74d-1b69ab53d3bf tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:ea:de,bridge_name='br-int',has_traffic_filtering=True,id=badc9f06-cef7-46bf-8b74-5d53401021f5,network=Network(2c7b3dcf-bebf-411e-94ea-0c00ad6de4c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbadc9f06-ce')
Oct 16 18:50:29 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-5530bfd6-a9a1-4da3-a74d-1b69ab53d3bf tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Deleting instance files /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c_del
Oct 16 18:50:29 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-5530bfd6-a9a1-4da3-a74d-1b69ab53d3bf tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Deletion of /opt/stack/data/nova/instances/cddf4842-1c25-4cc8-914e-af30849e4d6c_del complete
Oct 16 18:50:29 user nova-compute[74247]: INFO nova.compute.manager [None req-5530bfd6-a9a1-4da3-a74d-1b69ab53d3bf tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Took 0.65 seconds to destroy the instance on the hypervisor.
Oct 16 18:50:29 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-5530bfd6-a9a1-4da3-a74d-1b69ab53d3bf tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 18:50:29 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 18:50:29 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 18:50:29 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:50:29 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Took 0.44 seconds to deallocate network for instance.
Oct 16 18:50:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5530bfd6-a9a1-4da3-a74d-1b69ab53d3bf tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:50:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5530bfd6-a9a1-4da3-a74d-1b69ab53d3bf tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:50:29 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-5530bfd6-a9a1-4da3-a74d-1b69ab53d3bf tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:50:29 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-5530bfd6-a9a1-4da3-a74d-1b69ab53d3bf tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:50:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5530bfd6-a9a1-4da3-a74d-1b69ab53d3bf tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.179s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:50:29 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-5530bfd6-a9a1-4da3-a74d-1b69ab53d3bf tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Deleted allocations for instance cddf4842-1c25-4cc8-914e-af30849e4d6c
Oct 16 18:50:30 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5530bfd6-a9a1-4da3-a74d-1b69ab53d3bf tempest-ServerBootFromVolumeStableRescueTest-656520712 tempest-ServerBootFromVolumeStableRescueTest-656520712-project-member] Lock "cddf4842-1c25-4cc8-914e-af30849e4d6c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.447s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:50:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:50:30 user nova-compute[74247]: DEBUG nova.compute.manager [req-a5246a8d-c42e-4700-8ba2-4bc3e39367ab req-2079ed56-6693-4311-a86c-c6be71fe7c3e service nova] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Received event network-vif-plugged-badc9f06-cef7-46bf-8b74-5d53401021f5 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:50:30 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a5246a8d-c42e-4700-8ba2-4bc3e39367ab req-2079ed56-6693-4311-a86c-c6be71fe7c3e service nova] Acquiring lock "cddf4842-1c25-4cc8-914e-af30849e4d6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:50:30 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a5246a8d-c42e-4700-8ba2-4bc3e39367ab req-2079ed56-6693-4311-a86c-c6be71fe7c3e service nova] Lock "cddf4842-1c25-4cc8-914e-af30849e4d6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:50:30 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a5246a8d-c42e-4700-8ba2-4bc3e39367ab req-2079ed56-6693-4311-a86c-c6be71fe7c3e service nova] Lock "cddf4842-1c25-4cc8-914e-af30849e4d6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:50:30 user nova-compute[74247]: DEBUG nova.compute.manager [req-a5246a8d-c42e-4700-8ba2-4bc3e39367ab req-2079ed56-6693-4311-a86c-c6be71fe7c3e service nova] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] No waiting events found dispatching network-vif-plugged-badc9f06-cef7-46bf-8b74-5d53401021f5 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:50:30 user nova-compute[74247]: WARNING nova.compute.manager [req-a5246a8d-c42e-4700-8ba2-4bc3e39367ab req-2079ed56-6693-4311-a86c-c6be71fe7c3e service nova] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Received unexpected event network-vif-plugged-badc9f06-cef7-46bf-8b74-5d53401021f5 for instance with vm_state deleted and task_state None.
Oct 16 18:50:30 user nova-compute[74247]: DEBUG nova.compute.manager [req-a5246a8d-c42e-4700-8ba2-4bc3e39367ab req-2079ed56-6693-4311-a86c-c6be71fe7c3e service nova] [instance: cddf4842-1c25-4cc8-914e-af30849e4d6c] Received event network-vif-deleted-badc9f06-cef7-46bf-8b74-5d53401021f5 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:50:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:50:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "15d7f371-8d29-4d34-bafa-3bd3fc1e635a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:50:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "15d7f371-8d29-4d34-bafa-3bd3fc1e635a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:50:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "15d7f371-8d29-4d34-bafa-3bd3fc1e635a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:50:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "15d7f371-8d29-4d34-bafa-3bd3fc1e635a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:50:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "15d7f371-8d29-4d34-bafa-3bd3fc1e635a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:50:34 user nova-compute[74247]: INFO nova.compute.manager [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Terminating instance
Oct 16 18:50:34 user nova-compute[74247]: DEBUG nova.compute.manager [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 18:50:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:50:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:50:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:50:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:50:34 user nova-compute[74247]: DEBUG nova.compute.manager [req-03694275-8c2f-473c-b2fd-ff2bb18d215e req-c6197009-a2cc-4354-8b15-2e7ec9e68484 service nova] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Received event network-vif-unplugged-4e99124d-afd3-48aa-85d8-f1fd277c7842 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:50:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-03694275-8c2f-473c-b2fd-ff2bb18d215e req-c6197009-a2cc-4354-8b15-2e7ec9e68484 service nova] Acquiring lock "15d7f371-8d29-4d34-bafa-3bd3fc1e635a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:50:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-03694275-8c2f-473c-b2fd-ff2bb18d215e req-c6197009-a2cc-4354-8b15-2e7ec9e68484 service nova] Lock "15d7f371-8d29-4d34-bafa-3bd3fc1e635a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:50:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-03694275-8c2f-473c-b2fd-ff2bb18d215e req-c6197009-a2cc-4354-8b15-2e7ec9e68484 service nova] Lock "15d7f371-8d29-4d34-bafa-3bd3fc1e635a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:50:34 user nova-compute[74247]: DEBUG nova.compute.manager [req-03694275-8c2f-473c-b2fd-ff2bb18d215e req-c6197009-a2cc-4354-8b15-2e7ec9e68484 service nova] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] No waiting events found dispatching network-vif-unplugged-4e99124d-afd3-48aa-85d8-f1fd277c7842 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:50:34 user nova-compute[74247]: DEBUG nova.compute.manager [req-03694275-8c2f-473c-b2fd-ff2bb18d215e req-c6197009-a2cc-4354-8b15-2e7ec9e68484 service nova] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Received event network-vif-unplugged-4e99124d-afd3-48aa-85d8-f1fd277c7842 for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:50:34 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Instance destroyed successfully.
Oct 16 18:50:34 user nova-compute[74247]: DEBUG nova.objects.instance [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lazy-loading 'resources' on Instance uuid 15d7f371-8d29-4d34-bafa-3bd3fc1e635a {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:50:34 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:48:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1356379338',display_name='tempest-TestVolumeBootPattern-server-1356379338',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1356379338',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:49:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dca6144ea4e14c28b085e271175bbf67',ramdisk_id='',reservation_id='r-ngb5371n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1733357121',owner_user_name='tempest-TestVolumeBootPattern-1733357121-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:49:11Z,user_data=None,user_id='9608bf58b70248439dbbcc9db38fba08',uuid=15d7f371-8d29-4d34-bafa-3bd3fc1e635a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e99124d-afd3-48aa-85d8-f1fd277c7842", "address": "fa:16:3e:29:cc:52", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e99124d-af", "ovs_interfaceid": "4e99124d-afd3-48aa-85d8-f1fd277c7842", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:50:34 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Converting VIF {"id": "4e99124d-afd3-48aa-85d8-f1fd277c7842", "address": "fa:16:3e:29:cc:52", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e99124d-af", "ovs_interfaceid": "4e99124d-afd3-48aa-85d8-f1fd277c7842", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:50:34 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:cc:52,bridge_name='br-int',has_traffic_filtering=True,id=4e99124d-afd3-48aa-85d8-f1fd277c7842,network=Network(9688c665-d4b7-4179-9a76-fdf6c3013b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e99124d-af') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:50:34 user nova-compute[74247]: DEBUG os_vif [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:cc:52,bridge_name='br-int',has_traffic_filtering=True,id=4e99124d-afd3-48aa-85d8-f1fd277c7842,network=Network(9688c665-d4b7-4179-9a76-fdf6c3013b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e99124d-af') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:50:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:50:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e99124d-af, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:50:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:50:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:50:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:50:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e29e168-1983-4cbe-a758-98b7ea14de22) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:50:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:50:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:50:34 user nova-compute[74247]: INFO os_vif [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:cc:52,bridge_name='br-int',has_traffic_filtering=True,id=4e99124d-afd3-48aa-85d8-f1fd277c7842,network=Network(9688c665-d4b7-4179-9a76-fdf6c3013b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e99124d-af')
Oct 16 18:50:34 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 18:50:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pELKRICs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:50:34 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:50:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:50:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:50:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[021e4d43-9495-4189-a57a-faebd97b867c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 18:50:35 user nova-compute[74247]: No targets found.
Oct 16 18:50:35 user nova-compute[74247]: iSNS:
Oct 16 18:50:35 user nova-compute[74247]: No targets found.
Oct 16 18:50:35 user nova-compute[74247]: STATIC:
Oct 16 18:50:35 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c
Oct 16 18:50:35 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:50:35 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:50:35 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a
Oct 16 18:50:35 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:50:35 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:50:35 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33
Oct 16 18:50:35 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:50:35 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:50:35 user nova-compute[74247]: FIRMWARE:
Oct 16 18:50:35 user nova-compute[74247]: No targets found.
Oct 16 18:50:35 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 18:50:35 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 18:50:35 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3207f974-3a00-43c4-a9b2-49156d3025c2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c0dfce-6634-4365-b030-53c0790bdfd6]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a (non-flash)
Oct 16 18:50:35 user nova-compute[74247]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 (non-flash)
Oct 16 18:50:35 user nova-compute[74247]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c (non-flash)
Oct 16 18:50:35 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a (non-flash)
Oct 16 18:50:35 user nova-compute[74247]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 (non-flash)
Oct 16 18:50:35 user nova-compute[74247]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c (non-flash)
Oct 16 18:50:35 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe07815c1f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a'): ({'sdb'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Removing single pathed devices sdb {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43089e5-e7a5-423e-b57c-8f778d9d3c45]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc6f549-df0d-45f7-bd00-d745475eac49]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Flushing IO for device /dev/sdb {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[818b6282-07ff-48f5-a2f6-4879f0009f15]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82d0adc-914c-48b8-aae7-c119a2580684]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] SCSI volumes sdb have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO43087035-435bc70fe886086b', '/dev/disk/by-id/scsi-23433356263373066', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_43087035') {{(pid=85128) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[de537d59-b630-48ef-b96c-bcef65729593]: (4, None) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76fd1fb-9aa1-4955-8e07-aa99449840a5]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c002d39-b649-4c59-a400-ab8a956e0c56]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a, portal: 172.16.0.220,3260]
Oct 16 18:50:35 user nova-compute[74247]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a, portal: 172.16.0.220,3260] successful.
Oct 16 18:50:35 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75b78bf5-051d-4b0b-ac05-23ad92dced2a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1670494a-d7ba-46c8-9a6a-ce36b5f72023]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] <== disconnect_volume: return (326ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 18:50:35 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Deleting instance files /opt/stack/data/nova/instances/15d7f371-8d29-4d34-bafa-3bd3fc1e635a_del
Oct 16 18:50:35 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Deletion of /opt/stack/data/nova/instances/15d7f371-8d29-4d34-bafa-3bd3fc1e635a_del complete
Oct 16 18:50:35 user nova-compute[74247]: INFO nova.compute.manager [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Took 1.19 seconds to destroy the instance on the hypervisor.
Oct 16 18:50:35 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 18:50:35 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:50:35 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Took 0.60 seconds to deallocate network for instance.
Oct 16 18:50:35 user nova-compute[74247]: DEBUG nova.compute.manager [req-57c02b52-743f-4175-a3bb-d91793f9ae95 req-67cbe4c3-8a54-4ce9-af63-20ef34818b86 service nova] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Received event network-vif-deleted-4e99124d-afd3-48aa-85d8-f1fd277c7842 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:50:36 user nova-compute[74247]: DEBUG nova.compute.manager [req-62cf2ae9-da57-408a-bfca-66e2c524778d req-a58df89e-1e61-41f0-a877-051dfe7e7c26 service nova] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Received event network-vif-plugged-4e99124d-afd3-48aa-85d8-f1fd277c7842 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:50:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-62cf2ae9-da57-408a-bfca-66e2c524778d req-a58df89e-1e61-41f0-a877-051dfe7e7c26 service nova] Acquiring lock "15d7f371-8d29-4d34-bafa-3bd3fc1e635a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:50:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-62cf2ae9-da57-408a-bfca-66e2c524778d req-a58df89e-1e61-41f0-a877-051dfe7e7c26 service nova] Lock "15d7f371-8d29-4d34-bafa-3bd3fc1e635a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:50:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-62cf2ae9-da57-408a-bfca-66e2c524778d req-a58df89e-1e61-41f0-a877-051dfe7e7c26 service nova] Lock "15d7f371-8d29-4d34-bafa-3bd3fc1e635a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:50:36 user nova-compute[74247]: DEBUG nova.compute.manager [req-62cf2ae9-da57-408a-bfca-66e2c524778d req-a58df89e-1e61-41f0-a877-051dfe7e7c26 service nova] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] No waiting events found dispatching network-vif-plugged-4e99124d-afd3-48aa-85d8-f1fd277c7842 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:50:36 user nova-compute[74247]: WARNING nova.compute.manager [req-62cf2ae9-da57-408a-bfca-66e2c524778d req-a58df89e-1e61-41f0-a877-051dfe7e7c26 service nova] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Received unexpected event network-vif-plugged-4e99124d-afd3-48aa-85d8-f1fd277c7842 for instance with vm_state active and task_state deleting.
Oct 16 18:50:36 user nova-compute[74247]: INFO nova.compute.manager [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Took 0.80 seconds to detach 1 volumes for instance.
Oct 16 18:50:36 user nova-compute[74247]: DEBUG nova.compute.manager [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 15d7f371-8d29-4d34-bafa-3bd3fc1e635a] Deleting volume: 75b78bf5-051d-4b0b-ac05-23ad92dced2a {{(pid=74247) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 16 18:50:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:50:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:50:37 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:50:37 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:50:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.186s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:50:37 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Deleted allocations for instance 15d7f371-8d29-4d34-bafa-3bd3fc1e635a
Oct 16 18:50:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f22b3956-c533-45dd-ad80-f60b1824e857 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "15d7f371-8d29-4d34-bafa-3bd3fc1e635a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.404s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:50:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:50:43 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:50:44 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:50:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:50:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:50:54 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:50:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:51:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:51:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:51:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 18:51:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 18:51:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 18:51:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:51:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:51:12 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:51:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:51:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ebf7b5c9-e830-4ee5-9b42-05cffdcd23b3 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Acquiring lock "50907e5b-73fe-4bd6-9b66-a06cc937acfb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:51:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ebf7b5c9-e830-4ee5-9b42-05cffdcd23b3 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "50907e5b-73fe-4bd6-9b66-a06cc937acfb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:51:15 user nova-compute[74247]: INFO nova.compute.manager [None req-ebf7b5c9-e830-4ee5-9b42-05cffdcd23b3 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Detaching volume 28d62c2d-e567-4a49-947a-47780757587c
Oct 16 18:51:15 user nova-compute[74247]: INFO nova.virt.block_device [None req-ebf7b5c9-e830-4ee5-9b42-05cffdcd23b3 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Attempting to driver detach volume 28d62c2d-e567-4a49-947a-47780757587c from mountpoint /dev/vdb
Oct 16 18:51:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-ebf7b5c9-e830-4ee5-9b42-05cffdcd23b3 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Attempting to detach device vdb from instance 50907e5b-73fe-4bd6-9b66-a06cc937acfb from the persistent domain config. {{(pid=74247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 18:51:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-ebf7b5c9-e830-4ee5-9b42-05cffdcd23b3 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 18:51:15 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:51:15 user nova-compute[74247]:   <source dev="/dev/sdd"/>
Oct 16 18:51:15 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:51:15 user nova-compute[74247]:   <serial>28d62c2d-e567-4a49-947a-47780757587c</serial>
Oct 16 18:51:15 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 18:51:15 user nova-compute[74247]: </disk>
Oct 16 18:51:15 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:51:15 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-ebf7b5c9-e830-4ee5-9b42-05cffdcd23b3 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Successfully detached device vdb from instance 50907e5b-73fe-4bd6-9b66-a06cc937acfb from the persistent domain config.
Oct 16 18:51:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-ebf7b5c9-e830-4ee5-9b42-05cffdcd23b3 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 50907e5b-73fe-4bd6-9b66-a06cc937acfb from the live domain config. {{(pid=74247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 18:51:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-ebf7b5c9-e830-4ee5-9b42-05cffdcd23b3 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 18:51:15 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:51:15 user nova-compute[74247]:   <source dev="/dev/sdd"/>
Oct 16 18:51:15 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:51:15 user nova-compute[74247]:   <serial>28d62c2d-e567-4a49-947a-47780757587c</serial>
Oct 16 18:51:15 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 18:51:15 user nova-compute[74247]: </disk>
Oct 16 18:51:15 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:51:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-9e435780-27d0-4c9c-809f-2c9abb1e4600 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Acquiring lock "50907e5b-73fe-4bd6-9b66-a06cc937acfb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:51:15 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:51:15 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 18:51:15 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Skipping network cache update for instance because it is being deleted. {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9970}}
Oct 16 18:51:15 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Didn't find any instances for network info cache update. {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 18:51:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-ebf7b5c9-e830-4ee5-9b42-05cffdcd23b3 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 50907e5b-73fe-4bd6-9b66-a06cc937acfb {{(pid=74247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 18:51:16 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:51:16 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:51:16 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:51:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:51:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:51:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:51:16 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 18:51:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50907e5b-73fe-4bd6-9b66-a06cc937acfb/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:51:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50907e5b-73fe-4bd6-9b66-a06cc937acfb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:51:16 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50907e5b-73fe-4bd6-9b66-a06cc937acfb/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:51:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50907e5b-73fe-4bd6-9b66-a06cc937acfb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:51:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:51:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:51:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:51:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:51:17 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:51:17 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:51:17 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:51:17 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=8674MB free_disk=25.037574768066406GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 18:51:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:51:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:51:17 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance fa1dea31-91bc-4fda-8fb2-638628b66b3f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:51:17 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 50907e5b-73fe-4bd6-9b66-a06cc937acfb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:51:17 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 18:51:17 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 18:51:18 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:51:18 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:51:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 18:51:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.246s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:51:19 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:51:19 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 18:51:19 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:51:19 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:51:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:51:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:51:23 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:51:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:51:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:51:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:51:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:51:35 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-ebf7b5c9-e830-4ee5-9b42-05cffdcd23b3 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 50907e5b-73fe-4bd6-9b66-a06cc937acfb is timed out.
Oct 16 18:51:35 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-ebf7b5c9-e830-4ee5-9b42-05cffdcd23b3 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Successfully detached device vdb from instance 50907e5b-73fe-4bd6-9b66-a06cc937acfb from the live domain config.
Oct 16 18:51:35 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebf7b5c9-e830-4ee5-9b42-05cffdcd23b3 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 18:51:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf7b5c9-e830-4ee5-9b42-05cffdcd23b3 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PburlZQf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:51:35 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-ebf7b5c9-e830-4ee5-9b42-05cffdcd23b3 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:51:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-ebf7b5c9-e830-4ee5-9b42-05cffdcd23b3 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:51:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-ebf7b5c9-e830-4ee5-9b42-05cffdcd23b3 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:51:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:51:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:51:35 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a512be9-3495-4816-9fce-b51cf70092fd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:51:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf7b5c9-e830-4ee5-9b42-05cffdcd23b3 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 18:51:35 user nova-compute[74247]: No targets found.
Oct 16 18:51:35 user nova-compute[74247]: iSNS:
Oct 16 18:51:35 user nova-compute[74247]: No targets found.
Oct 16 18:51:35 user nova-compute[74247]: STATIC:
Oct 16 18:51:35 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c
Oct 16 18:51:35 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:51:35 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:51:35 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33
Oct 16 18:51:35 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:51:35 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:51:35 user nova-compute[74247]: FIRMWARE:
Oct 16 18:51:35 user nova-compute[74247]: No targets found.
Oct 16 18:51:35 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:51:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf7b5c9-e830-4ee5-9b42-05cffdcd23b3 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 18:51:35 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 18:51:35 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 18:51:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf7b5c9-e830-4ee5-9b42-05cffdcd23b3 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 18:51:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:51:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:51:35 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f396db3-e7e1-4b20-a22a-32cf84ecc0b4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:51:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:51:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:51:35 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4d3849-0e06-4524-b73e-50f27f527e04]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:51:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf7b5c9-e830-4ee5-9b42-05cffdcd23b3 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 (non-flash)
Oct 16 18:51:35 user nova-compute[74247]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c (non-flash)
Oct 16 18:51:35 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:51:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf7b5c9-e830-4ee5-9b42-05cffdcd23b3 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 (non-flash)
Oct 16 18:51:35 user nova-compute[74247]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c (non-flash)
Oct 16 18:51:35 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:51:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf7b5c9-e830-4ee5-9b42-05cffdcd23b3 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe048450f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c'): ({'sdd'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 18:51:35 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-ebf7b5c9-e830-4ee5-9b42-05cffdcd23b3 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Removing single pathed devices sdd {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 18:51:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:51:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:51:36 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a57cd9-458d-40d8-b15b-af73647a6b0f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:51:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:51:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:51:36 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[077bf834-b7a9-4817-bb98-6dbdf28c3961]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:51:36 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-ebf7b5c9-e830-4ee5-9b42-05cffdcd23b3 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Flushing IO for device /dev/sdd {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 18:51:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:51:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:51:36 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3235aa8b-f9c9-4aad-b5f5-68a188b7fb80]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:51:36 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-ebf7b5c9-e830-4ee5-9b42-05cffdcd23b3 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 18:51:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:51:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:51:36 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02ebfab-cdd4-458f-99ce-dc656303ab2c]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:51:36 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-ebf7b5c9-e830-4ee5-9b42-05cffdcd23b3 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 18:51:36 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-ebf7b5c9-e830-4ee5-9b42-05cffdcd23b3 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] SCSI volumes sdd have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 18:51:36 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf7b5c9-e830-4ee5-9b42-05cffdcd23b3 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 18:51:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:51:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:51:36 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7850720a-5f0c-4592-a53e-e5224682474b]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:51:36 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf7b5c9-e830-4ee5-9b42-05cffdcd23b3 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:51:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:51:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:51:36 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8c003e-af4b-498d-af0a-d0be6bb068d3]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:51:36 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf7b5c9-e830-4ee5-9b42-05cffdcd23b3 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c, portal: 172.16.0.220,3260]
Oct 16 18:51:36 user nova-compute[74247]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c, portal: 172.16.0.220,3260] successful.
Oct 16 18:51:36 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:51:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:51:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:51:36 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[83615252-354d-42c3-98d1-9c30847e3724]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:51:36 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf7b5c9-e830-4ee5-9b42-05cffdcd23b3 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:51:36 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-ebf7b5c9-e830-4ee5-9b42-05cffdcd23b3 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:51:36 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf7b5c9-e830-4ee5-9b42-05cffdcd23b3 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] <== disconnect_volume: return (294ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:51:36 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebf7b5c9-e830-4ee5-9b42-05cffdcd23b3 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 18:51:37 user nova-compute[74247]: DEBUG nova.objects.instance [None req-ebf7b5c9-e830-4ee5-9b42-05cffdcd23b3 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lazy-loading 'flavor' on Instance uuid 50907e5b-73fe-4bd6-9b66-a06cc937acfb {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:51:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ebf7b5c9-e830-4ee5-9b42-05cffdcd23b3 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "50907e5b-73fe-4bd6-9b66-a06cc937acfb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.914s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:51:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-9e435780-27d0-4c9c-809f-2c9abb1e4600 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "50907e5b-73fe-4bd6-9b66-a06cc937acfb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.801s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:51:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-9e435780-27d0-4c9c-809f-2c9abb1e4600 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Acquiring lock "50907e5b-73fe-4bd6-9b66-a06cc937acfb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:51:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-9e435780-27d0-4c9c-809f-2c9abb1e4600 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "50907e5b-73fe-4bd6-9b66-a06cc937acfb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:51:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-9e435780-27d0-4c9c-809f-2c9abb1e4600 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "50907e5b-73fe-4bd6-9b66-a06cc937acfb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:51:37 user nova-compute[74247]: INFO nova.compute.manager [None req-9e435780-27d0-4c9c-809f-2c9abb1e4600 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Terminating instance
Oct 16 18:51:37 user nova-compute[74247]: DEBUG nova.compute.manager [None req-9e435780-27d0-4c9c-809f-2c9abb1e4600 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 18:51:37 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:51:37 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:51:37 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:51:37 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:51:37 user nova-compute[74247]: DEBUG nova.compute.manager [req-4526897b-ee4e-4ac4-a67e-e0f1b3d467b1 req-57a26e30-e439-4744-a2c3-bf04dc61d62c service nova] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Received event network-vif-unplugged-e42ea480-0315-4ff3-b72a-20c95dd2f615 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:51:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4526897b-ee4e-4ac4-a67e-e0f1b3d467b1 req-57a26e30-e439-4744-a2c3-bf04dc61d62c service nova] Acquiring lock "50907e5b-73fe-4bd6-9b66-a06cc937acfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:51:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4526897b-ee4e-4ac4-a67e-e0f1b3d467b1 req-57a26e30-e439-4744-a2c3-bf04dc61d62c service nova] Lock "50907e5b-73fe-4bd6-9b66-a06cc937acfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:51:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4526897b-ee4e-4ac4-a67e-e0f1b3d467b1 req-57a26e30-e439-4744-a2c3-bf04dc61d62c service nova] Lock "50907e5b-73fe-4bd6-9b66-a06cc937acfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:51:37 user nova-compute[74247]: DEBUG nova.compute.manager [req-4526897b-ee4e-4ac4-a67e-e0f1b3d467b1 req-57a26e30-e439-4744-a2c3-bf04dc61d62c service nova] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] No waiting events found dispatching network-vif-unplugged-e42ea480-0315-4ff3-b72a-20c95dd2f615 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:51:37 user nova-compute[74247]: DEBUG nova.compute.manager [req-4526897b-ee4e-4ac4-a67e-e0f1b3d467b1 req-57a26e30-e439-4744-a2c3-bf04dc61d62c service nova] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Received event network-vif-unplugged-e42ea480-0315-4ff3-b72a-20c95dd2f615 for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:51:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:51:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:51:38 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Instance destroyed successfully.
Oct 16 18:51:38 user nova-compute[74247]: DEBUG nova.objects.instance [None req-9e435780-27d0-4c9c-809f-2c9abb1e4600 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lazy-loading 'resources' on Instance uuid 50907e5b-73fe-4bd6-9b66-a06cc937acfb {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:51:38 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-9e435780-27d0-4c9c-809f-2c9abb1e4600 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:48:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2056155157',display_name='tempest-VolumesSnapshotTestJSON-instance-2056155157',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2056155157',id=36,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9w/aStmWdadF47Ios/TLgR9mBghK2GMSEIpPs7I1XHFa4KMvBmPXSKG0t+PuA3rdLNlkC0jk5rximJcKm4af0COV8gLCum0Q8FAkjTHudAdELIYMKURPtrvGbpo+HAFw==',key_name='tempest-keypair-1153482716',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:48:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eaf6596e67794e1794dc93e8e8523ae7',ramdisk_id='',reservation_id='r-cpoovi0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-730943931',owner_user_name='tempest-VolumesSnapshotTestJSON-730943931-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:48:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb73af6700c1406994dab6331939fe1b',uuid=50907e5b-73fe-4bd6-9b66-a06cc937acfb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e42ea480-0315-4ff3-b72a-20c95dd2f615", "address": "fa:16:3e:aa:e7:5c", "network": {"id": "8e0ea38d-892f-4f82-a321-93292d5bea90", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-201299230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf6596e67794e1794dc93e8e8523ae7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape42ea480-03", "ovs_interfaceid": "e42ea480-0315-4ff3-b72a-20c95dd2f615", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:51:38 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-9e435780-27d0-4c9c-809f-2c9abb1e4600 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Converting VIF {"id": "e42ea480-0315-4ff3-b72a-20c95dd2f615", "address": "fa:16:3e:aa:e7:5c", "network": {"id": "8e0ea38d-892f-4f82-a321-93292d5bea90", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-201299230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf6596e67794e1794dc93e8e8523ae7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape42ea480-03", "ovs_interfaceid": "e42ea480-0315-4ff3-b72a-20c95dd2f615", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:51:38 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-9e435780-27d0-4c9c-809f-2c9abb1e4600 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:e7:5c,bridge_name='br-int',has_traffic_filtering=True,id=e42ea480-0315-4ff3-b72a-20c95dd2f615,network=Network(8e0ea38d-892f-4f82-a321-93292d5bea90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape42ea480-03') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:51:38 user nova-compute[74247]: DEBUG os_vif [None req-9e435780-27d0-4c9c-809f-2c9abb1e4600 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:e7:5c,bridge_name='br-int',has_traffic_filtering=True,id=e42ea480-0315-4ff3-b72a-20c95dd2f615,network=Network(8e0ea38d-892f-4f82-a321-93292d5bea90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape42ea480-03') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:51:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:51:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape42ea480-03, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:51:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:51:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:51:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:51:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7264fd58-90d6-4a01-870f-663db6e4cd62) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:51:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:51:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:51:38 user nova-compute[74247]: INFO os_vif [None req-9e435780-27d0-4c9c-809f-2c9abb1e4600 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:e7:5c,bridge_name='br-int',has_traffic_filtering=True,id=e42ea480-0315-4ff3-b72a-20c95dd2f615,network=Network(8e0ea38d-892f-4f82-a321-93292d5bea90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape42ea480-03')
Oct 16 18:51:38 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e435780-27d0-4c9c-809f-2c9abb1e4600 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 18:51:38 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e435780-27d0-4c9c-809f-2c9abb1e4600 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PburlZQf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:51:38 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-9e435780-27d0-4c9c-809f-2c9abb1e4600 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:51:38 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-9e435780-27d0-4c9c-809f-2c9abb1e4600 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:51:38 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-9e435780-27d0-4c9c-809f-2c9abb1e4600 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:51:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:51:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:51:38 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7ba60f-fb1e-4140-a1a8-553171c300b9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:51:38 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e435780-27d0-4c9c-809f-2c9abb1e4600 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 18:51:38 user nova-compute[74247]: No targets found.
Oct 16 18:51:38 user nova-compute[74247]: iSNS:
Oct 16 18:51:38 user nova-compute[74247]: No targets found.
Oct 16 18:51:38 user nova-compute[74247]: STATIC:
Oct 16 18:51:38 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33
Oct 16 18:51:38 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:51:38 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:51:38 user nova-compute[74247]: FIRMWARE:
Oct 16 18:51:38 user nova-compute[74247]: No targets found.
Oct 16 18:51:38 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:51:38 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e435780-27d0-4c9c-809f-2c9abb1e4600 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 18:51:38 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 18:51:38 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 18:51:38 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e435780-27d0-4c9c-809f-2c9abb1e4600 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28d62c2d-e567-4a49-947a-47780757587c', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 18:51:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:51:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:51:38 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8621f04a-f77a-4549-9e9c-9a25eedad886]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:51:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:51:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:51:38 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[742a80f2-ec8e-41f5-a846-ebd234c8cf7e]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:51:38 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e435780-27d0-4c9c-809f-2c9abb1e4600 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 (non-flash)
Oct 16 18:51:38 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:51:38 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e435780-27d0-4c9c-809f-2c9abb1e4600 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 (non-flash)
Oct 16 18:51:38 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:51:38 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e435780-27d0-4c9c-809f-2c9abb1e4600 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe048473a30>, {}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 18:51:38 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e435780-27d0-4c9c-809f-2c9abb1e4600 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Disconnecting from: [] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 18:51:38 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-9e435780-27d0-4c9c-809f-2c9abb1e4600 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.077s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:51:38 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e435780-27d0-4c9c-809f-2c9abb1e4600 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] <== disconnect_volume: return (80ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:51:38 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e435780-27d0-4c9c-809f-2c9abb1e4600 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 18:51:38 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-9e435780-27d0-4c9c-809f-2c9abb1e4600 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Deleting instance files /opt/stack/data/nova/instances/50907e5b-73fe-4bd6-9b66-a06cc937acfb_del
Oct 16 18:51:38 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-9e435780-27d0-4c9c-809f-2c9abb1e4600 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Deletion of /opt/stack/data/nova/instances/50907e5b-73fe-4bd6-9b66-a06cc937acfb_del complete
Oct 16 18:51:38 user nova-compute[74247]: INFO nova.compute.manager [None req-9e435780-27d0-4c9c-809f-2c9abb1e4600 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Took 1.02 seconds to destroy the instance on the hypervisor.
Oct 16 18:51:38 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-9e435780-27d0-4c9c-809f-2c9abb1e4600 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 18:51:38 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 18:51:38 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 18:51:39 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:51:39 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Took 0.81 seconds to deallocate network for instance.
Oct 16 18:51:39 user nova-compute[74247]: WARNING nova.volume.cinder [None req-9e435780-27d0-4c9c-809f-2c9abb1e4600 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Attachment 6b31f4d2-895d-47ac-be30-aa2c7feca7fc does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 6b31f4d2-895d-47ac-be30-aa2c7feca7fc. (HTTP 404) (Request-ID: req-6b7591d4-afff-4f15-8fd5-7bf8d360e1e9)
Oct 16 18:51:39 user nova-compute[74247]: INFO nova.compute.manager [None req-9e435780-27d0-4c9c-809f-2c9abb1e4600 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Took 0.02 seconds to detach 1 volumes for instance.
Oct 16 18:51:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-9e435780-27d0-4c9c-809f-2c9abb1e4600 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:51:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-9e435780-27d0-4c9c-809f-2c9abb1e4600 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:51:39 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-9e435780-27d0-4c9c-809f-2c9abb1e4600 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:51:39 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-9e435780-27d0-4c9c-809f-2c9abb1e4600 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:51:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-9e435780-27d0-4c9c-809f-2c9abb1e4600 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.152s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:51:39 user nova-compute[74247]: DEBUG nova.compute.manager [req-ad33badc-9d32-4a6c-8299-3b3898143966 req-b34fac8c-d0b8-4800-9c2e-fad8fe3e4e0d service nova] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Received event network-vif-deleted-e42ea480-0315-4ff3-b72a-20c95dd2f615 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:51:39 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-9e435780-27d0-4c9c-809f-2c9abb1e4600 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Deleted allocations for instance 50907e5b-73fe-4bd6-9b66-a06cc937acfb
Oct 16 18:51:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-9e435780-27d0-4c9c-809f-2c9abb1e4600 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "50907e5b-73fe-4bd6-9b66-a06cc937acfb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.278s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:51:39 user nova-compute[74247]: DEBUG nova.compute.manager [req-19baf262-a018-45bc-a9af-fe056c0386a6 req-0ab64491-16b4-4bb8-b232-17523c416475 service nova] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Received event network-vif-plugged-e42ea480-0315-4ff3-b72a-20c95dd2f615 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:51:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-19baf262-a018-45bc-a9af-fe056c0386a6 req-0ab64491-16b4-4bb8-b232-17523c416475 service nova] Acquiring lock "50907e5b-73fe-4bd6-9b66-a06cc937acfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:51:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-19baf262-a018-45bc-a9af-fe056c0386a6 req-0ab64491-16b4-4bb8-b232-17523c416475 service nova] Lock "50907e5b-73fe-4bd6-9b66-a06cc937acfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:51:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-19baf262-a018-45bc-a9af-fe056c0386a6 req-0ab64491-16b4-4bb8-b232-17523c416475 service nova] Lock "50907e5b-73fe-4bd6-9b66-a06cc937acfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:51:39 user nova-compute[74247]: DEBUG nova.compute.manager [req-19baf262-a018-45bc-a9af-fe056c0386a6 req-0ab64491-16b4-4bb8-b232-17523c416475 service nova] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] No waiting events found dispatching network-vif-plugged-e42ea480-0315-4ff3-b72a-20c95dd2f615 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:51:39 user nova-compute[74247]: WARNING nova.compute.manager [req-19baf262-a018-45bc-a9af-fe056c0386a6 req-0ab64491-16b4-4bb8-b232-17523c416475 service nova] [instance: 50907e5b-73fe-4bd6-9b66-a06cc937acfb] Received unexpected event network-vif-plugged-e42ea480-0315-4ff3-b72a-20c95dd2f615 for instance with vm_state deleted and task_state None.
Oct 16 18:51:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:51:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-29a5cd1b-d3e1-4b96-a1dd-2136afebb8b7 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquiring lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:51:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-29a5cd1b-d3e1-4b96-a1dd-2136afebb8b7 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:51:41 user nova-compute[74247]: INFO nova.compute.manager [None req-29a5cd1b-d3e1-4b96-a1dd-2136afebb8b7 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Detaching volume 45f2a888-7a58-4dfb-af98-407e583a6d33
Oct 16 18:51:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:51:41 user nova-compute[74247]: INFO nova.virt.block_device [None req-29a5cd1b-d3e1-4b96-a1dd-2136afebb8b7 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Attempting to driver detach volume 45f2a888-7a58-4dfb-af98-407e583a6d33 from mountpoint /dev/vdb
Oct 16 18:51:41 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-29a5cd1b-d3e1-4b96-a1dd-2136afebb8b7 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Attempting to detach device vdb from instance fa1dea31-91bc-4fda-8fb2-638628b66b3f from the persistent domain config. {{(pid=74247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 18:51:41 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-29a5cd1b-d3e1-4b96-a1dd-2136afebb8b7 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 18:51:41 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:51:41 user nova-compute[74247]:   <source dev="/dev/sdc"/>
Oct 16 18:51:41 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:51:41 user nova-compute[74247]:   <serial>45f2a888-7a58-4dfb-af98-407e583a6d33</serial>
Oct 16 18:51:41 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 16 18:51:41 user nova-compute[74247]: </disk>
Oct 16 18:51:41 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:51:41 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-29a5cd1b-d3e1-4b96-a1dd-2136afebb8b7 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Successfully detached device vdb from instance fa1dea31-91bc-4fda-8fb2-638628b66b3f from the persistent domain config.
Oct 16 18:51:41 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-29a5cd1b-d3e1-4b96-a1dd-2136afebb8b7 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fa1dea31-91bc-4fda-8fb2-638628b66b3f from the live domain config. {{(pid=74247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 18:51:41 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-29a5cd1b-d3e1-4b96-a1dd-2136afebb8b7 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 18:51:41 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:51:41 user nova-compute[74247]:   <source dev="/dev/sdc"/>
Oct 16 18:51:41 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:51:41 user nova-compute[74247]:   <serial>45f2a888-7a58-4dfb-af98-407e583a6d33</serial>
Oct 16 18:51:41 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 16 18:51:41 user nova-compute[74247]: </disk>
Oct 16 18:51:41 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:51:42 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-29a5cd1b-d3e1-4b96-a1dd-2136afebb8b7 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fa1dea31-91bc-4fda-8fb2-638628b66b3f {{(pid=74247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 18:51:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:51:43 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:51:46 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:51:48 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:51:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Acquiring lock "b3c9d603-30a4-4f9f-8ea3-218eb747e580" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:51:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Lock "b3c9d603-30a4-4f9f-8ea3-218eb747e580" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:51:50 user nova-compute[74247]: DEBUG nova.compute.manager [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 18:51:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:51:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:51:50 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:51:50 user nova-compute[74247]: INFO nova.compute.claims [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Claim successful on node user
Oct 16 18:51:51 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:51:51 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:51:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.213s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:51:51 user nova-compute[74247]: DEBUG nova.compute.manager [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 18:51:51 user nova-compute[74247]: DEBUG nova.compute.manager [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 18:51:51 user nova-compute[74247]: DEBUG nova.network.neutron [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 18:51:51 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 18:51:51 user nova-compute[74247]: DEBUG nova.compute.manager [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 18:51:51 user nova-compute[74247]: DEBUG nova.policy [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c3510de5a2cc43f38f7380d53eeab430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e978b6d707c46188f74f2ddbf6deb62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 18:51:51 user nova-compute[74247]: DEBUG nova.compute.manager [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 18:51:51 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:51:51 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Creating image(s)
Oct 16 18:51:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Acquiring lock "/opt/stack/data/nova/instances/b3c9d603-30a4-4f9f-8ea3-218eb747e580/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:51:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Lock "/opt/stack/data/nova/instances/b3c9d603-30a4-4f9f-8ea3-218eb747e580/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:51:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Lock "/opt/stack/data/nova/instances/b3c9d603-30a4-4f9f-8ea3-218eb747e580/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:51:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:51:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.191s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:51:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Acquiring lock "37399febbd18f60b85fd0f833558f6a3539ab231" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:51:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:51:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:51:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.208s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:51:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/b3c9d603-30a4-4f9f-8ea3-218eb747e580/disk 1073741824 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:51:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/b3c9d603-30a4-4f9f-8ea3-218eb747e580/disk 1073741824" returned: 0 in 0.052s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:51:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:51:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:51:51 user nova-compute[74247]: DEBUG nova.network.neutron [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Successfully created port: e05a5f20-8c5b-465b-8795-ff5469d75393 {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:51:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.176s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:51:51 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b3c9d603-30a4-4f9f-8ea3-218eb747e580/disk. size=1073741824 {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 18:51:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c9d603-30a4-4f9f-8ea3-218eb747e580/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:51:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c9d603-30a4-4f9f-8ea3-218eb747e580/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:51:52 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Cannot resize image /opt/stack/data/nova/instances/b3c9d603-30a4-4f9f-8ea3-218eb747e580/disk to a smaller size. {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 18:51:52 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 18:51:52 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Ensure instance console log exists: /opt/stack/data/nova/instances/b3c9d603-30a4-4f9f-8ea3-218eb747e580/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:51:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:51:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:51:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:51:52 user nova-compute[74247]: DEBUG nova.network.neutron [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Successfully updated port: e05a5f20-8c5b-465b-8795-ff5469d75393 {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:51:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Acquiring lock "refresh_cache-b3c9d603-30a4-4f9f-8ea3-218eb747e580" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:51:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Acquired lock "refresh_cache-b3c9d603-30a4-4f9f-8ea3-218eb747e580" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:51:52 user nova-compute[74247]: DEBUG nova.network.neutron [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:51:52 user nova-compute[74247]: DEBUG nova.compute.manager [req-86d9a856-4a5f-4e7a-867d-ff1078dc737d req-90fd15b9-68f1-456f-b84a-e44ee2dae6df service nova] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Received event network-changed-e05a5f20-8c5b-465b-8795-ff5469d75393 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:51:52 user nova-compute[74247]: DEBUG nova.compute.manager [req-86d9a856-4a5f-4e7a-867d-ff1078dc737d req-90fd15b9-68f1-456f-b84a-e44ee2dae6df service nova] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Refreshing instance network info cache due to event network-changed-e05a5f20-8c5b-465b-8795-ff5469d75393. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:51:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-86d9a856-4a5f-4e7a-867d-ff1078dc737d req-90fd15b9-68f1-456f-b84a-e44ee2dae6df service nova] Acquiring lock "refresh_cache-b3c9d603-30a4-4f9f-8ea3-218eb747e580" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:51:52 user nova-compute[74247]: DEBUG nova.network.neutron [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:51:52 user nova-compute[74247]: DEBUG nova.network.neutron [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Updating instance_info_cache with network_info: [{"id": "e05a5f20-8c5b-465b-8795-ff5469d75393", "address": "fa:16:3e:2e:cf:c7", "network": {"id": "dccde3f4-f49e-49b6-905e-3aaf51b415b2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-19864196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e978b6d707c46188f74f2ddbf6deb62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape05a5f20-8c", "ovs_interfaceid": "e05a5f20-8c5b-465b-8795-ff5469d75393", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:51:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Releasing lock "refresh_cache-b3c9d603-30a4-4f9f-8ea3-218eb747e580" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:51:52 user nova-compute[74247]: DEBUG nova.compute.manager [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Instance network_info: |[{"id": "e05a5f20-8c5b-465b-8795-ff5469d75393", "address": "fa:16:3e:2e:cf:c7", "network": {"id": "dccde3f4-f49e-49b6-905e-3aaf51b415b2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-19864196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e978b6d707c46188f74f2ddbf6deb62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape05a5f20-8c", "ovs_interfaceid": "e05a5f20-8c5b-465b-8795-ff5469d75393", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 18:51:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-86d9a856-4a5f-4e7a-867d-ff1078dc737d req-90fd15b9-68f1-456f-b84a-e44ee2dae6df service nova] Acquired lock "refresh_cache-b3c9d603-30a4-4f9f-8ea3-218eb747e580" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:51:52 user nova-compute[74247]: DEBUG nova.network.neutron [req-86d9a856-4a5f-4e7a-867d-ff1078dc737d req-90fd15b9-68f1-456f-b84a-e44ee2dae6df service nova] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Refreshing network info cache for port e05a5f20-8c5b-465b-8795-ff5469d75393 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:51:52 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Start _get_guest_xml network_info=[{"id": "e05a5f20-8c5b-465b-8795-ff5469d75393", "address": "fa:16:3e:2e:cf:c7", "network": {"id": "dccde3f4-f49e-49b6-905e-3aaf51b415b2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-19864196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e978b6d707c46188f74f2ddbf6deb62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape05a5f20-8c", "ovs_interfaceid": "e05a5f20-8c5b-465b-8795-ff5469d75393", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': '83126bb1-29f5-42fe-8620-72ab0797f776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:51:52 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:51:52 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:51:52 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:51:52 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:51:52 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:51:52 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:51:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:51:53 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:51:53 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:51:53 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:51:53 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:51:53 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:51:53 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:51:53 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:51:53 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:51:53 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:51:53 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:51:53 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:51:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:51:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1644425080',display_name='tempest-VolumesActionsTest-instance-1644425080',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1644425080',id=38,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e978b6d707c46188f74f2ddbf6deb62',ramdisk_id='',reservation_id='r-zjhyiaur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-524114660',owner_user_name='tempest-VolumesActionsTest-524114660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:51:51Z,user_data=None,user_id='c3510de5a2cc43f38f7380d53eeab430',uuid=b3c9d603-30a4-4f9f-8ea3-218eb747e580,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e05a5f20-8c5b-465b-8795-ff5469d75393", "address": "fa:16:3e:2e:cf:c7", "network": {"id": "dccde3f4-f49e-49b6-905e-3aaf51b415b2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-19864196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e978b6d707c46188f74f2ddbf6deb62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape05a5f20-8c", "ovs_interfaceid": "e05a5f20-8c5b-465b-8795-ff5469d75393", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:51:53 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Converting VIF {"id": "e05a5f20-8c5b-465b-8795-ff5469d75393", "address": "fa:16:3e:2e:cf:c7", "network": {"id": "dccde3f4-f49e-49b6-905e-3aaf51b415b2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-19864196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e978b6d707c46188f74f2ddbf6deb62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape05a5f20-8c", "ovs_interfaceid": "e05a5f20-8c5b-465b-8795-ff5469d75393", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:51:53 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:cf:c7,bridge_name='br-int',has_traffic_filtering=True,id=e05a5f20-8c5b-465b-8795-ff5469d75393,network=Network(dccde3f4-f49e-49b6-905e-3aaf51b415b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape05a5f20-8c') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:51:53 user nova-compute[74247]: DEBUG nova.objects.instance [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Lazy-loading 'pci_devices' on Instance uuid b3c9d603-30a4-4f9f-8ea3-218eb747e580 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:51:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:51:53 user nova-compute[74247]:   <uuid>b3c9d603-30a4-4f9f-8ea3-218eb747e580</uuid>
Oct 16 18:51:53 user nova-compute[74247]:   <name>instance-00000026</name>
Oct 16 18:51:53 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:51:53 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:51:53 user nova-compute[74247]:   <metadata>
Oct 16 18:51:53 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:51:53 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:51:53 user nova-compute[74247]:       <nova:name>tempest-VolumesActionsTest-instance-1644425080</nova:name>
Oct 16 18:51:53 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:51:52</nova:creationTime>
Oct 16 18:51:53 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:51:53 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:51:53 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:51:53 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:51:53 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:51:53 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:51:53 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:51:53 user nova-compute[74247]:       <nova:owner>
Oct 16 18:51:53 user nova-compute[74247]:         <nova:user uuid="c3510de5a2cc43f38f7380d53eeab430">tempest-VolumesActionsTest-524114660-project-member</nova:user>
Oct 16 18:51:53 user nova-compute[74247]:         <nova:project uuid="9e978b6d707c46188f74f2ddbf6deb62">tempest-VolumesActionsTest-524114660</nova:project>
Oct 16 18:51:53 user nova-compute[74247]:       </nova:owner>
Oct 16 18:51:53 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:51:53 user nova-compute[74247]:       <nova:ports>
Oct 16 18:51:53 user nova-compute[74247]:         <nova:port uuid="e05a5f20-8c5b-465b-8795-ff5469d75393">
Oct 16 18:51:53 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 16 18:51:53 user nova-compute[74247]:         </nova:port>
Oct 16 18:51:53 user nova-compute[74247]:       </nova:ports>
Oct 16 18:51:53 user nova-compute[74247]:     </nova:instance>
Oct 16 18:51:53 user nova-compute[74247]:   </metadata>
Oct 16 18:51:53 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:51:53 user nova-compute[74247]:     <system>
Oct 16 18:51:53 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:51:53 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:51:53 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:51:53 user nova-compute[74247]:       <entry name="serial">b3c9d603-30a4-4f9f-8ea3-218eb747e580</entry>
Oct 16 18:51:53 user nova-compute[74247]:       <entry name="uuid">b3c9d603-30a4-4f9f-8ea3-218eb747e580</entry>
Oct 16 18:51:53 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:51:53 user nova-compute[74247]:     </system>
Oct 16 18:51:53 user nova-compute[74247]:   </sysinfo>
Oct 16 18:51:53 user nova-compute[74247]:   <os>
Oct 16 18:51:53 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:51:53 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:51:53 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:51:53 user nova-compute[74247]:   </os>
Oct 16 18:51:53 user nova-compute[74247]:   <features>
Oct 16 18:51:53 user nova-compute[74247]:     <acpi/>
Oct 16 18:51:53 user nova-compute[74247]:     <apic/>
Oct 16 18:51:53 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:51:53 user nova-compute[74247]:   </features>
Oct 16 18:51:53 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:51:53 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:51:53 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:51:53 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:51:53 user nova-compute[74247]:   </clock>
Oct 16 18:51:53 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:51:53 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:51:53 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:51:53 user nova-compute[74247]:   </cpu>
Oct 16 18:51:53 user nova-compute[74247]:   <devices>
Oct 16 18:51:53 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:51:53 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:51:53 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/b3c9d603-30a4-4f9f-8ea3-218eb747e580/disk"/>
Oct 16 18:51:53 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:51:53 user nova-compute[74247]:     </disk>
Oct 16 18:51:53 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:51:53 user nova-compute[74247]:       <mac address="fa:16:3e:2e:cf:c7"/>
Oct 16 18:51:53 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:51:53 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:51:53 user nova-compute[74247]:       <target dev="tape05a5f20-8c"/>
Oct 16 18:51:53 user nova-compute[74247]:     </interface>
Oct 16 18:51:53 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:51:53 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/b3c9d603-30a4-4f9f-8ea3-218eb747e580/console.log" append="off"/>
Oct 16 18:51:53 user nova-compute[74247]:     </serial>
Oct 16 18:51:53 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:51:53 user nova-compute[74247]:     <video>
Oct 16 18:51:53 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:51:53 user nova-compute[74247]:     </video>
Oct 16 18:51:53 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:51:53 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:51:53 user nova-compute[74247]:     </rng>
Oct 16 18:51:53 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:51:53 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:51:53 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:51:53 user nova-compute[74247]:     </memballoon>
Oct 16 18:51:53 user nova-compute[74247]:   </devices>
Oct 16 18:51:53 user nova-compute[74247]: </domain>
Oct 16 18:51:53 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:51:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:51:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1644425080',display_name='tempest-VolumesActionsTest-instance-1644425080',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1644425080',id=38,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e978b6d707c46188f74f2ddbf6deb62',ramdisk_id='',reservation_id='r-zjhyiaur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-524114660',owner_user_name='tempest-VolumesActionsTest-524114660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:51:51Z,user_data=None,user_id='c3510de5a2cc43f38f7380d53eeab430',uuid=b3c9d603-30a4-4f9f-8ea3-218eb747e580,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e05a5f20-8c5b-465b-8795-ff5469d75393", "address": "fa:16:3e:2e:cf:c7", "network": {"id": "dccde3f4-f49e-49b6-905e-3aaf51b415b2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-19864196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e978b6d707c46188f74f2ddbf6deb62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape05a5f20-8c", "ovs_interfaceid": "e05a5f20-8c5b-465b-8795-ff5469d75393", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:51:53 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Converting VIF {"id": "e05a5f20-8c5b-465b-8795-ff5469d75393", "address": "fa:16:3e:2e:cf:c7", "network": {"id": "dccde3f4-f49e-49b6-905e-3aaf51b415b2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-19864196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e978b6d707c46188f74f2ddbf6deb62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape05a5f20-8c", "ovs_interfaceid": "e05a5f20-8c5b-465b-8795-ff5469d75393", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:51:53 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:cf:c7,bridge_name='br-int',has_traffic_filtering=True,id=e05a5f20-8c5b-465b-8795-ff5469d75393,network=Network(dccde3f4-f49e-49b6-905e-3aaf51b415b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape05a5f20-8c') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:51:53 user nova-compute[74247]: DEBUG os_vif [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:cf:c7,bridge_name='br-int',has_traffic_filtering=True,id=e05a5f20-8c5b-465b-8795-ff5469d75393,network=Network(dccde3f4-f49e-49b6-905e-3aaf51b415b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape05a5f20-8c') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:51:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:51:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:51:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:51:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:51:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '72cb01a0-ee88-5307-b57d-0e628c84551b', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:51:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:51:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:51:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:51:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape05a5f20-8c, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:51:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape05a5f20-8c, col_values=(('qos', UUID('e906e746-02f3-4e5f-b1ee-8299896959b5')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:51:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape05a5f20-8c, col_values=(('external_ids', {'iface-id': 'e05a5f20-8c5b-465b-8795-ff5469d75393', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:cf:c7', 'vm-uuid': 'b3c9d603-30a4-4f9f-8ea3-218eb747e580'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:51:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:51:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:51:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:51:53 user nova-compute[74247]: INFO os_vif [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:cf:c7,bridge_name='br-int',has_traffic_filtering=True,id=e05a5f20-8c5b-465b-8795-ff5469d75393,network=Network(dccde3f4-f49e-49b6-905e-3aaf51b415b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape05a5f20-8c')
Oct 16 18:51:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:51:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] No VIF found with MAC fa:16:3e:2e:cf:c7, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:51:53 user nova-compute[74247]: DEBUG nova.network.neutron [req-86d9a856-4a5f-4e7a-867d-ff1078dc737d req-90fd15b9-68f1-456f-b84a-e44ee2dae6df service nova] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Updated VIF entry in instance network info cache for port e05a5f20-8c5b-465b-8795-ff5469d75393. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:51:53 user nova-compute[74247]: DEBUG nova.network.neutron [req-86d9a856-4a5f-4e7a-867d-ff1078dc737d req-90fd15b9-68f1-456f-b84a-e44ee2dae6df service nova] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Updating instance_info_cache with network_info: [{"id": "e05a5f20-8c5b-465b-8795-ff5469d75393", "address": "fa:16:3e:2e:cf:c7", "network": {"id": "dccde3f4-f49e-49b6-905e-3aaf51b415b2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-19864196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e978b6d707c46188f74f2ddbf6deb62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape05a5f20-8c", "ovs_interfaceid": "e05a5f20-8c5b-465b-8795-ff5469d75393", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:51:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-86d9a856-4a5f-4e7a-867d-ff1078dc737d req-90fd15b9-68f1-456f-b84a-e44ee2dae6df service nova] Releasing lock "refresh_cache-b3c9d603-30a4-4f9f-8ea3-218eb747e580" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:51:54 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:51:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:51:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:51:55 user nova-compute[74247]: DEBUG nova.compute.manager [req-788d7dc8-1163-4413-8862-d66a67700d36 req-d338bc27-1a63-410e-8895-131ceadacfaa service nova] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Received event network-vif-plugged-e05a5f20-8c5b-465b-8795-ff5469d75393 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:51:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-788d7dc8-1163-4413-8862-d66a67700d36 req-d338bc27-1a63-410e-8895-131ceadacfaa service nova] Acquiring lock "b3c9d603-30a4-4f9f-8ea3-218eb747e580-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:51:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-788d7dc8-1163-4413-8862-d66a67700d36 req-d338bc27-1a63-410e-8895-131ceadacfaa service nova] Lock "b3c9d603-30a4-4f9f-8ea3-218eb747e580-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:51:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-788d7dc8-1163-4413-8862-d66a67700d36 req-d338bc27-1a63-410e-8895-131ceadacfaa service nova] Lock "b3c9d603-30a4-4f9f-8ea3-218eb747e580-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:51:55 user nova-compute[74247]: DEBUG nova.compute.manager [req-788d7dc8-1163-4413-8862-d66a67700d36 req-d338bc27-1a63-410e-8895-131ceadacfaa service nova] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] No waiting events found dispatching network-vif-plugged-e05a5f20-8c5b-465b-8795-ff5469d75393 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:51:55 user nova-compute[74247]: WARNING nova.compute.manager [req-788d7dc8-1163-4413-8862-d66a67700d36 req-d338bc27-1a63-410e-8895-131ceadacfaa service nova] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Received unexpected event network-vif-plugged-e05a5f20-8c5b-465b-8795-ff5469d75393 for instance with vm_state building and task_state spawning.
Oct 16 18:51:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:51:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:51:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:51:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:51:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:51:56 user nova-compute[74247]: DEBUG nova.compute.manager [req-9c303242-2b3f-436c-a1ad-519ce96f78ab req-2a9de60b-942a-44ef-8d3b-b047fd7f2cdf service nova] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Received event network-vif-plugged-e05a5f20-8c5b-465b-8795-ff5469d75393 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:51:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9c303242-2b3f-436c-a1ad-519ce96f78ab req-2a9de60b-942a-44ef-8d3b-b047fd7f2cdf service nova] Acquiring lock "b3c9d603-30a4-4f9f-8ea3-218eb747e580-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:51:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9c303242-2b3f-436c-a1ad-519ce96f78ab req-2a9de60b-942a-44ef-8d3b-b047fd7f2cdf service nova] Lock "b3c9d603-30a4-4f9f-8ea3-218eb747e580-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:51:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9c303242-2b3f-436c-a1ad-519ce96f78ab req-2a9de60b-942a-44ef-8d3b-b047fd7f2cdf service nova] Lock "b3c9d603-30a4-4f9f-8ea3-218eb747e580-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:51:56 user nova-compute[74247]: DEBUG nova.compute.manager [req-9c303242-2b3f-436c-a1ad-519ce96f78ab req-2a9de60b-942a-44ef-8d3b-b047fd7f2cdf service nova] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] No waiting events found dispatching network-vif-plugged-e05a5f20-8c5b-465b-8795-ff5469d75393 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:51:56 user nova-compute[74247]: WARNING nova.compute.manager [req-9c303242-2b3f-436c-a1ad-519ce96f78ab req-2a9de60b-942a-44ef-8d3b-b047fd7f2cdf service nova] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Received unexpected event network-vif-plugged-e05a5f20-8c5b-465b-8795-ff5469d75393 for instance with vm_state building and task_state spawning.
Oct 16 18:51:56 user nova-compute[74247]: DEBUG nova.compute.manager [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:51:56 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:51:56 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Instance spawned successfully.
Oct 16 18:51:56 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 18:51:56 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:51:56 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:51:56 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:51:56 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:51:56 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:51:56 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:51:57 user nova-compute[74247]: INFO nova.compute.manager [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Took 5.70 seconds to spawn the instance on the hypervisor.
Oct 16 18:51:57 user nova-compute[74247]: DEBUG nova.compute.manager [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:51:57 user nova-compute[74247]: INFO nova.compute.manager [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Took 6.27 seconds to build instance.
Oct 16 18:51:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-37bb121b-3115-463f-b69b-cd958a10e515 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Lock "b3c9d603-30a4-4f9f-8ea3-218eb747e580" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.367s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:51:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:52:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:52:02 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-29a5cd1b-d3e1-4b96-a1dd-2136afebb8b7 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fa1dea31-91bc-4fda-8fb2-638628b66b3f is timed out.
Oct 16 18:52:02 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-29a5cd1b-d3e1-4b96-a1dd-2136afebb8b7 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Successfully detached device vdb from instance fa1dea31-91bc-4fda-8fb2-638628b66b3f from the live domain config.
Oct 16 18:52:02 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29a5cd1b-d3e1-4b96-a1dd-2136afebb8b7 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a5cd1b-d3e1-4b96-a1dd-2136afebb8b7 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jvtxomgk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:52:02 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-29a5cd1b-d3e1-4b96-a1dd-2136afebb8b7 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:52:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-29a5cd1b-d3e1-4b96-a1dd-2136afebb8b7 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-29a5cd1b-d3e1-4b96-a1dd-2136afebb8b7 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fe6a3f-1702-4c2a-af44-4f2dd9fdbc95]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a5cd1b-d3e1-4b96-a1dd-2136afebb8b7 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 18:52:02 user nova-compute[74247]: No targets found.
Oct 16 18:52:02 user nova-compute[74247]: iSNS:
Oct 16 18:52:02 user nova-compute[74247]: No targets found.
Oct 16 18:52:02 user nova-compute[74247]: STATIC:
Oct 16 18:52:02 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33
Oct 16 18:52:02 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:52:02 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:52:02 user nova-compute[74247]: FIRMWARE:
Oct 16 18:52:02 user nova-compute[74247]: No targets found.
Oct 16 18:52:02 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a5cd1b-d3e1-4b96-a1dd-2136afebb8b7 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 18:52:02 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 18:52:02 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a5cd1b-d3e1-4b96-a1dd-2136afebb8b7 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6ec3bf-38f9-4496-af9d-09951b05d148]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5358a05b-8812-4a4b-8542-92b3685d667f]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a5cd1b-d3e1-4b96-a1dd-2136afebb8b7 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 (non-flash)
Oct 16 18:52:02 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a5cd1b-d3e1-4b96-a1dd-2136afebb8b7 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 (non-flash)
Oct 16 18:52:02 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a5cd1b-d3e1-4b96-a1dd-2136afebb8b7 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe0483fecb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33'): ({'sdc'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-29a5cd1b-d3e1-4b96-a1dd-2136afebb8b7 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Removing single pathed devices sdc {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[326bf4d7-f7cd-4a12-ba26-03ba121dde4d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9366a0-a380-4483-bd88-6634887f586f]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-29a5cd1b-d3e1-4b96-a1dd-2136afebb8b7 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Flushing IO for device /dev/sdc {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[79efcd85-ba42-4c83-9c72-e65aae42d376]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-29a5cd1b-d3e1-4b96-a1dd-2136afebb8b7 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[677a9556-e8b0-4d00-813a-0846c808dbac]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-29a5cd1b-d3e1-4b96-a1dd-2136afebb8b7 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-29a5cd1b-d3e1-4b96-a1dd-2136afebb8b7 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] SCSI volumes sdc have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a5cd1b-d3e1-4b96-a1dd-2136afebb8b7 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6c1315-dc6b-402c-ae18-bb215b835f09]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a5cd1b-d3e1-4b96-a1dd-2136afebb8b7 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde7d98b-b963-4805-bc7e-202f9abaf193]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a5cd1b-d3e1-4b96-a1dd-2136afebb8b7 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33, portal: 172.16.0.220,3260]
Oct 16 18:52:02 user nova-compute[74247]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33, portal: 172.16.0.220,3260] successful.
Oct 16 18:52:02 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f2a888-7a58-4dfb-af98-407e583a6d33 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[857306b3-afe6-46f6-a040-a0cdbd4095b5]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a5cd1b-d3e1-4b96-a1dd-2136afebb8b7 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-29a5cd1b-d3e1-4b96-a1dd-2136afebb8b7 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a5cd1b-d3e1-4b96-a1dd-2136afebb8b7 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] <== disconnect_volume: return (344ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:52:02 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29a5cd1b-d3e1-4b96-a1dd-2136afebb8b7 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 18:52:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:52:03 user nova-compute[74247]: DEBUG nova.objects.instance [None req-29a5cd1b-d3e1-4b96-a1dd-2136afebb8b7 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lazy-loading 'flavor' on Instance uuid fa1dea31-91bc-4fda-8fb2-638628b66b3f {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:52:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-29a5cd1b-d3e1-4b96-a1dd-2136afebb8b7 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.209s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:52:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-cea21bf5-d01d-4599-bfa8-d6a54068b68d tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquiring lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:52:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-cea21bf5-d01d-4599-bfa8-d6a54068b68d tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:52:04 user nova-compute[74247]: DEBUG nova.compute.manager [None req-cea21bf5-d01d-4599-bfa8-d6a54068b68d tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:52:04 user nova-compute[74247]: DEBUG nova.compute.manager [None req-cea21bf5-d01d-4599-bfa8-d6a54068b68d tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74247) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 16 18:52:04 user nova-compute[74247]: DEBUG nova.objects.instance [None req-cea21bf5-d01d-4599-bfa8-d6a54068b68d tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lazy-loading 'flavor' on Instance uuid fa1dea31-91bc-4fda-8fb2-638628b66b3f {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:52:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:52:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:52:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:52:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:52:04 user nova-compute[74247]: DEBUG nova.compute.manager [req-a9ff3dc3-1f73-44ef-8346-5bddf0dac32e req-5d1b1bb7-c1a8-4a2f-8af4-9564ecdebe67 service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Received event network-vif-unplugged-77ca2d19-f745-461d-9f32-8d42469a6bfc {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:52:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a9ff3dc3-1f73-44ef-8346-5bddf0dac32e req-5d1b1bb7-c1a8-4a2f-8af4-9564ecdebe67 service nova] Acquiring lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:52:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a9ff3dc3-1f73-44ef-8346-5bddf0dac32e req-5d1b1bb7-c1a8-4a2f-8af4-9564ecdebe67 service nova] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:52:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a9ff3dc3-1f73-44ef-8346-5bddf0dac32e req-5d1b1bb7-c1a8-4a2f-8af4-9564ecdebe67 service nova] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:52:04 user nova-compute[74247]: DEBUG nova.compute.manager [req-a9ff3dc3-1f73-44ef-8346-5bddf0dac32e req-5d1b1bb7-c1a8-4a2f-8af4-9564ecdebe67 service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] No waiting events found dispatching network-vif-unplugged-77ca2d19-f745-461d-9f32-8d42469a6bfc {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:52:04 user nova-compute[74247]: WARNING nova.compute.manager [req-a9ff3dc3-1f73-44ef-8346-5bddf0dac32e req-5d1b1bb7-c1a8-4a2f-8af4-9564ecdebe67 service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Received unexpected event network-vif-unplugged-77ca2d19-f745-461d-9f32-8d42469a6bfc for instance with vm_state active and task_state powering-off.
Oct 16 18:52:05 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Instance destroyed successfully.
Oct 16 18:52:05 user nova-compute[74247]: DEBUG nova.compute.manager [None req-cea21bf5-d01d-4599-bfa8-d6a54068b68d tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:52:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-cea21bf5-d01d-4599-bfa8-d6a54068b68d tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.896s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:52:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "75e5e67a-3e02-4bc4-8e28-04125d32c6e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:52:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "75e5e67a-3e02-4bc4-8e28-04125d32c6e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:52:05 user nova-compute[74247]: DEBUG nova.compute.manager [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 18:52:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:52:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:52:05 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:52:05 user nova-compute[74247]: INFO nova.compute.claims [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Claim successful on node user
Oct 16 18:52:06 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:52:06 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:52:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.320s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:52:06 user nova-compute[74247]: DEBUG nova.compute.manager [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 18:52:06 user nova-compute[74247]: DEBUG nova.compute.manager [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 18:52:06 user nova-compute[74247]: DEBUG nova.network.neutron [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 18:52:06 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 18:52:06 user nova-compute[74247]: DEBUG nova.compute.manager [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 18:52:06 user nova-compute[74247]: INFO nova.virt.block_device [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Booting with volume 9fe1e4f8-289f-4932-a993-19d652c7f5dc at /dev/vda
Oct 16 18:52:06 user nova-compute[74247]: DEBUG nova.policy [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9608bf58b70248439dbbcc9db38fba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6144ea4e14c28b085e271175bbf67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 18:52:06 user nova-compute[74247]: DEBUG os_brick.utils [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:52:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:52:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:52:06 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89ef245-e6cf-4a45-8f3d-9a8bb7ea034e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:52:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:52:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:52:06 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[43258c65-7a70-4363-835f-5b3d085431ed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:52:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:52:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:52:06 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a6efb3-6abb-46d8-8f53-827f2bb914b6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:52:06 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b738d9ae-23c3-47c4-b249-3361a2ad5343]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:52:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:52:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:52:06 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 18:52:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:52:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:52:06 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 18:52:06 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f08e2a4-d8bf-4abf-bd16-7b916a11a0e4]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:52:06 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 18:52:06 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 18:52:06 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 18:52:06 user nova-compute[74247]: DEBUG os_brick.utils [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:52:06 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Updating existing volume attachment record: f9bdb1c6-f1ac-44a5-a474-56a95c7d6b0e {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 18:52:06 user nova-compute[74247]: DEBUG nova.compute.manager [req-177bfc59-88d3-423f-955d-99361cb2dc71 req-4348a1da-5757-4ac6-a399-503ed1761794 service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Received event network-vif-plugged-77ca2d19-f745-461d-9f32-8d42469a6bfc {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:52:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-177bfc59-88d3-423f-955d-99361cb2dc71 req-4348a1da-5757-4ac6-a399-503ed1761794 service nova] Acquiring lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:52:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-177bfc59-88d3-423f-955d-99361cb2dc71 req-4348a1da-5757-4ac6-a399-503ed1761794 service nova] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:52:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-177bfc59-88d3-423f-955d-99361cb2dc71 req-4348a1da-5757-4ac6-a399-503ed1761794 service nova] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:52:06 user nova-compute[74247]: DEBUG nova.compute.manager [req-177bfc59-88d3-423f-955d-99361cb2dc71 req-4348a1da-5757-4ac6-a399-503ed1761794 service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] No waiting events found dispatching network-vif-plugged-77ca2d19-f745-461d-9f32-8d42469a6bfc {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:52:06 user nova-compute[74247]: WARNING nova.compute.manager [req-177bfc59-88d3-423f-955d-99361cb2dc71 req-4348a1da-5757-4ac6-a399-503ed1761794 service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Received unexpected event network-vif-plugged-77ca2d19-f745-461d-9f32-8d42469a6bfc for instance with vm_state stopped and task_state None.
Oct 16 18:52:07 user nova-compute[74247]: DEBUG nova.network.neutron [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Successfully created port: fee1b802-a163-42e1-8262-e5553f847cb8 {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:52:07 user nova-compute[74247]: DEBUG nova.network.neutron [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Successfully updated port: fee1b802-a163-42e1-8262-e5553f847cb8 {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:52:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "refresh_cache-75e5e67a-3e02-4bc4-8e28-04125d32c6e9" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:52:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquired lock "refresh_cache-75e5e67a-3e02-4bc4-8e28-04125d32c6e9" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:52:08 user nova-compute[74247]: DEBUG nova.network.neutron [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:52:08 user nova-compute[74247]: DEBUG nova.network.neutron [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:52:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:52:08 user nova-compute[74247]: DEBUG nova.network.neutron [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Updating instance_info_cache with network_info: [{"id": "fee1b802-a163-42e1-8262-e5553f847cb8", "address": "fa:16:3e:0f:b4:9a", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee1b802-a1", "ovs_interfaceid": "fee1b802-a163-42e1-8262-e5553f847cb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:52:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Releasing lock "refresh_cache-75e5e67a-3e02-4bc4-8e28-04125d32c6e9" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:52:08 user nova-compute[74247]: DEBUG nova.compute.manager [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Instance network_info: |[{"id": "fee1b802-a163-42e1-8262-e5553f847cb8", "address": "fa:16:3e:0f:b4:9a", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee1b802-a1", "ovs_interfaceid": "fee1b802-a163-42e1-8262-e5553f847cb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 18:52:08 user nova-compute[74247]: DEBUG nova.compute.manager [req-bbccc0cb-1756-42d8-8ee5-5cff6aac7da3 req-d624f413-2c69-422b-a588-0eff3fc4c928 service nova] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Received event network-changed-fee1b802-a163-42e1-8262-e5553f847cb8 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:52:08 user nova-compute[74247]: DEBUG nova.compute.manager [req-bbccc0cb-1756-42d8-8ee5-5cff6aac7da3 req-d624f413-2c69-422b-a588-0eff3fc4c928 service nova] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Refreshing instance network info cache due to event network-changed-fee1b802-a163-42e1-8262-e5553f847cb8. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:52:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-bbccc0cb-1756-42d8-8ee5-5cff6aac7da3 req-d624f413-2c69-422b-a588-0eff3fc4c928 service nova] Acquiring lock "refresh_cache-75e5e67a-3e02-4bc4-8e28-04125d32c6e9" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:52:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-bbccc0cb-1756-42d8-8ee5-5cff6aac7da3 req-d624f413-2c69-422b-a588-0eff3fc4c928 service nova] Acquired lock "refresh_cache-75e5e67a-3e02-4bc4-8e28-04125d32c6e9" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:52:08 user nova-compute[74247]: DEBUG nova.network.neutron [req-bbccc0cb-1756-42d8-8ee5-5cff6aac7da3 req-d624f413-2c69-422b-a588-0eff3fc4c928 service nova] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Refreshing network info cache for port fee1b802-a163-42e1-8262-e5553f847cb8 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:52:09 user nova-compute[74247]: DEBUG nova.network.neutron [req-bbccc0cb-1756-42d8-8ee5-5cff6aac7da3 req-d624f413-2c69-422b-a588-0eff3fc4c928 service nova] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Updated VIF entry in instance network info cache for port fee1b802-a163-42e1-8262-e5553f847cb8. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:52:09 user nova-compute[74247]: DEBUG nova.network.neutron [req-bbccc0cb-1756-42d8-8ee5-5cff6aac7da3 req-d624f413-2c69-422b-a588-0eff3fc4c928 service nova] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Updating instance_info_cache with network_info: [{"id": "fee1b802-a163-42e1-8262-e5553f847cb8", "address": "fa:16:3e:0f:b4:9a", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee1b802-a1", "ovs_interfaceid": "fee1b802-a163-42e1-8262-e5553f847cb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:52:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-bbccc0cb-1756-42d8-8ee5-5cff6aac7da3 req-d624f413-2c69-422b-a588-0eff3fc4c928 service nova] Releasing lock "refresh_cache-75e5e67a-3e02-4bc4-8e28-04125d32c6e9" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:52:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:52:12 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:52:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:52:14 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:52:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:52:17 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:52:17 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 18:52:17 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Rebuilding the list of instances to heal {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 18:52:17 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Skipping network cache update for instance because it is Building. {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 16 18:52:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "refresh_cache-fa1dea31-91bc-4fda-8fb2-638628b66b3f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:52:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquired lock "refresh_cache-fa1dea31-91bc-4fda-8fb2-638628b66b3f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:52:17 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Forcefully refreshing network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 18:52:17 user nova-compute[74247]: DEBUG nova.objects.instance [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lazy-loading 'info_cache' on Instance uuid fa1dea31-91bc-4fda-8fb2-638628b66b3f {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:52:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:52:18 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Updating instance_info_cache with network_info: [{"id": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "address": "fa:16:3e:ea:29:cf", "network": {"id": "14ee32da-d0e3-499f-bd47-721e882b2a57", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-700103883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6d2ba688434391b03a9f3320a360de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77ca2d19-f7", "ovs_interfaceid": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:52:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Releasing lock "refresh_cache-fa1dea31-91bc-4fda-8fb2-638628b66b3f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:52:18 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Updated the network info_cache for instance {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 18:52:18 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:52:18 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:52:18 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:52:18 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 18:52:18 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:52:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:52:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:52:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:52:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 18:52:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c9d603-30a4-4f9f-8ea3-218eb747e580/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:52:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c9d603-30a4-4f9f-8ea3-218eb747e580/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:52:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c9d603-30a4-4f9f-8ea3-218eb747e580/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:52:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c9d603-30a4-4f9f-8ea3-218eb747e580/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:52:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:52:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:52:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:52:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:52:19 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:52:19 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:52:19 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=8807MB free_disk=25.01770782470703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 18:52:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:52:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:52:19 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance fa1dea31-91bc-4fda-8fb2-638628b66b3f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:52:19 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance b3c9d603-30a4-4f9f-8ea3-218eb747e580 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:52:19 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 75e5e67a-3e02-4bc4-8e28-04125d32c6e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:52:19 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 18:52:19 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 18:52:19 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:52:19 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:52:19 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 18:52:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.244s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:52:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:52:22 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:52:22 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:52:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:52:24 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:52:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:52:28 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG nova.compute.manager [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:52:31 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Creating image(s)
Oct 16 18:52:31 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Did not create local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Ensure instance console log exists: /opt/stack/data/nova/instances/75e5e67a-3e02-4bc4-8e28-04125d32c6e9/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Start _get_guest_xml network_info=[{"id": "fee1b802-a163-42e1-8262-e5553f847cb8", "address": "fa:16:3e:0f:b4:9a", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee1b802-a1", "ovs_interfaceid": "fee1b802-a163-42e1-8262-e5553f847cb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qePKIuBF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '75e5e67a-3e02-4bc4-8e28-04125d32c6e9', 'attached_at': '', 'detached_at': '', 'volume_id': '9fe1e4f8-289f-4932-a993-19d652c7f5dc', 'serial': '9fe1e4f8-289f-4932-a993-19d652c7f5dc'}, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'f9bdb1c6-f1ac-44a5-a474-56a95c7d6b0e', 'guest_format': None, 'volume_type': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:52:31 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:52:31 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:52:31 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qePKIuBF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:52:31 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:52:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:52:31 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:52:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:52:31 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:52:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5b08a3-a0c8-4a04-946b-4b6d8d6461ba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 18:52:31 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dad4c05-5a20-4651-b322-623e8e81e049]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc] added
Oct 16 18:52:31 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d16db7-7348-4323-bf5d-23275bb6821b]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d80708-4282-4dde-ad58-72fada1ef366]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qePKIuBF {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qePKIuBF" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2d6caf-78d8-4b06-9224-f840bec30976]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qePKIuBF'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a18fb30-6c94-4af5-976e-fc4769b85a3c]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b077e9f8-2e99-402a-a07f-0ab82a6c63cd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 16 18:52:31 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 16 18:52:31 user nova-compute[74247]:  {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:52:31 user nova-compute[74247]: WARNING os_brick.initiator.connectors.iscsi [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 16 18:52:31 user nova-compute[74247]: 
Oct 16 18:52:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf068f3-7468-4067-9d0b-f210f8c2713b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc, portal: 172.16.0.220,3260]
Oct 16 18:52:31 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc, portal: 172.16.0.220,3260] successful.
Oct 16 18:52:31 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a3fc4f-631d-4dec-b378-05b71eb6a97f]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f207e750-8eff-40c4-9846-38fb9f36bf38]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc (non-flash)
Oct 16 18:52:31 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc (non-flash)
Oct 16 18:52:31 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e1d5b5-d8be-48f7-b7f2-8f3ad94543ea]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qePKIuBF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:52:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:52:32 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:52:32 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '26537653161343066', 'path': '/dev/sdb'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:52:32 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537653161343066', 'path': '/dev/sdb'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:52:32 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:52:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1975418206',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1975418206',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1975418206',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpiMU33jnpS+L2JxWC8FEv2iwcfNEMgEjHfwHxWgFPj4+NrGnOYH5UuinYTvQJL19+ev+y0UnbjN1D2cdq3wWZnNdns4J5aOFbJjCk3sUrzEU+ID89gy8BtFJIEOrsmeA==',key_name='tempest-keypair-1736404231',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dca6144ea4e14c28b085e271175bbf67',ramdisk_id='',reservation_id='r-wdcq3l8h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1733357121',owner_user_name='tempest-TestVolumeBootPattern-1733357121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:52:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9608bf58b70248439dbbcc9db38fba08',uuid=75e5e67a-3e02-4bc4-8e28-04125d32c6e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fee1b802-a163-42e1-8262-e5553f847cb8", "address": "fa:16:3e:0f:b4:9a", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee1b802-a1", "ovs_interfaceid": "fee1b802-a163-42e1-8262-e5553f847cb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:52:32 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Converting VIF {"id": "fee1b802-a163-42e1-8262-e5553f847cb8", "address": "fa:16:3e:0f:b4:9a", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee1b802-a1", "ovs_interfaceid": "fee1b802-a163-42e1-8262-e5553f847cb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:52:32 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:b4:9a,bridge_name='br-int',has_traffic_filtering=True,id=fee1b802-a163-42e1-8262-e5553f847cb8,network=Network(9688c665-d4b7-4179-9a76-fdf6c3013b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfee1b802-a1') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:52:32 user nova-compute[74247]: DEBUG nova.objects.instance [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lazy-loading 'pci_devices' on Instance uuid 75e5e67a-3e02-4bc4-8e28-04125d32c6e9 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:52:32 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:52:32 user nova-compute[74247]:   <uuid>75e5e67a-3e02-4bc4-8e28-04125d32c6e9</uuid>
Oct 16 18:52:32 user nova-compute[74247]:   <name>instance-00000027</name>
Oct 16 18:52:32 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:52:32 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:52:32 user nova-compute[74247]:   <metadata>
Oct 16 18:52:32 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:52:32 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:52:32 user nova-compute[74247]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1975418206</nova:name>
Oct 16 18:52:32 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:52:31</nova:creationTime>
Oct 16 18:52:32 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:52:32 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:52:32 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:52:32 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:52:32 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:52:32 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:52:32 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:52:32 user nova-compute[74247]:       <nova:owner>
Oct 16 18:52:32 user nova-compute[74247]:         <nova:user uuid="9608bf58b70248439dbbcc9db38fba08">tempest-TestVolumeBootPattern-1733357121-project-member</nova:user>
Oct 16 18:52:32 user nova-compute[74247]:         <nova:project uuid="dca6144ea4e14c28b085e271175bbf67">tempest-TestVolumeBootPattern-1733357121</nova:project>
Oct 16 18:52:32 user nova-compute[74247]:       </nova:owner>
Oct 16 18:52:32 user nova-compute[74247]:       <nova:ports>
Oct 16 18:52:32 user nova-compute[74247]:         <nova:port uuid="fee1b802-a163-42e1-8262-e5553f847cb8">
Oct 16 18:52:32 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 16 18:52:32 user nova-compute[74247]:         </nova:port>
Oct 16 18:52:32 user nova-compute[74247]:       </nova:ports>
Oct 16 18:52:32 user nova-compute[74247]:     </nova:instance>
Oct 16 18:52:32 user nova-compute[74247]:   </metadata>
Oct 16 18:52:32 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:52:32 user nova-compute[74247]:     <system>
Oct 16 18:52:32 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:52:32 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:52:32 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:52:32 user nova-compute[74247]:       <entry name="serial">75e5e67a-3e02-4bc4-8e28-04125d32c6e9</entry>
Oct 16 18:52:32 user nova-compute[74247]:       <entry name="uuid">75e5e67a-3e02-4bc4-8e28-04125d32c6e9</entry>
Oct 16 18:52:32 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:52:32 user nova-compute[74247]:     </system>
Oct 16 18:52:32 user nova-compute[74247]:   </sysinfo>
Oct 16 18:52:32 user nova-compute[74247]:   <os>
Oct 16 18:52:32 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:52:32 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:52:32 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:52:32 user nova-compute[74247]:   </os>
Oct 16 18:52:32 user nova-compute[74247]:   <features>
Oct 16 18:52:32 user nova-compute[74247]:     <acpi/>
Oct 16 18:52:32 user nova-compute[74247]:     <apic/>
Oct 16 18:52:32 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:52:32 user nova-compute[74247]:   </features>
Oct 16 18:52:32 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:52:32 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:52:32 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:52:32 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:52:32 user nova-compute[74247]:   </clock>
Oct 16 18:52:32 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:52:32 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:52:32 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:52:32 user nova-compute[74247]:   </cpu>
Oct 16 18:52:32 user nova-compute[74247]:   <devices>
Oct 16 18:52:32 user nova-compute[74247]:     <disk type="block" device="disk">
Oct 16 18:52:32 user nova-compute[74247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:52:32 user nova-compute[74247]:       <source dev="/dev/sdb"/>
Oct 16 18:52:32 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:52:32 user nova-compute[74247]:       <serial>9fe1e4f8-289f-4932-a993-19d652c7f5dc</serial>
Oct 16 18:52:32 user nova-compute[74247]:     </disk>
Oct 16 18:52:32 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:52:32 user nova-compute[74247]:       <mac address="fa:16:3e:0f:b4:9a"/>
Oct 16 18:52:32 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:52:32 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:52:32 user nova-compute[74247]:       <target dev="tapfee1b802-a1"/>
Oct 16 18:52:32 user nova-compute[74247]:     </interface>
Oct 16 18:52:32 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:52:32 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/75e5e67a-3e02-4bc4-8e28-04125d32c6e9/console.log" append="off"/>
Oct 16 18:52:32 user nova-compute[74247]:     </serial>
Oct 16 18:52:32 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:52:32 user nova-compute[74247]:     <video>
Oct 16 18:52:32 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:52:32 user nova-compute[74247]:     </video>
Oct 16 18:52:32 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:52:32 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:52:32 user nova-compute[74247]:     </rng>
Oct 16 18:52:32 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:52:32 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:52:32 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:52:32 user nova-compute[74247]:     </memballoon>
Oct 16 18:52:32 user nova-compute[74247]:   </devices>
Oct 16 18:52:32 user nova-compute[74247]: </domain>
Oct 16 18:52:32 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:52:32 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:52:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1975418206',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1975418206',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1975418206',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpiMU33jnpS+L2JxWC8FEv2iwcfNEMgEjHfwHxWgFPj4+NrGnOYH5UuinYTvQJL19+ev+y0UnbjN1D2cdq3wWZnNdns4J5aOFbJjCk3sUrzEU+ID89gy8BtFJIEOrsmeA==',key_name='tempest-keypair-1736404231',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dca6144ea4e14c28b085e271175bbf67',ramdisk_id='',reservation_id='r-wdcq3l8h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1733357121',owner_user_name='tempest-TestVolumeBootPattern-1733357121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:52:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9608bf58b70248439dbbcc9db38fba08',uuid=75e5e67a-3e02-4bc4-8e28-04125d32c6e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fee1b802-a163-42e1-8262-e5553f847cb8", "address": "fa:16:3e:0f:b4:9a", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee1b802-a1", "ovs_interfaceid": "fee1b802-a163-42e1-8262-e5553f847cb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:52:32 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Converting VIF {"id": "fee1b802-a163-42e1-8262-e5553f847cb8", "address": "fa:16:3e:0f:b4:9a", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee1b802-a1", "ovs_interfaceid": "fee1b802-a163-42e1-8262-e5553f847cb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:52:32 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:b4:9a,bridge_name='br-int',has_traffic_filtering=True,id=fee1b802-a163-42e1-8262-e5553f847cb8,network=Network(9688c665-d4b7-4179-9a76-fdf6c3013b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfee1b802-a1') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:52:32 user nova-compute[74247]: DEBUG os_vif [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:b4:9a,bridge_name='br-int',has_traffic_filtering=True,id=fee1b802-a163-42e1-8262-e5553f847cb8,network=Network(9688c665-d4b7-4179-9a76-fdf6c3013b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfee1b802-a1') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:52:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:52:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:52:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:52:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:52:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f7cafb25-2713-523f-89f4-42739708ec57', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:52:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:52:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:52:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:52:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfee1b802-a1, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:52:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfee1b802-a1, col_values=(('qos', UUID('b023ae17-1f23-47b3-8ae3-020e835375a9')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:52:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfee1b802-a1, col_values=(('external_ids', {'iface-id': 'fee1b802-a163-42e1-8262-e5553f847cb8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:b4:9a', 'vm-uuid': '75e5e67a-3e02-4bc4-8e28-04125d32c6e9'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:52:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:52:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:52:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:52:32 user nova-compute[74247]: INFO os_vif [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:b4:9a,bridge_name='br-int',has_traffic_filtering=True,id=fee1b802-a163-42e1-8262-e5553f847cb8,network=Network(9688c665-d4b7-4179-9a76-fdf6c3013b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfee1b802-a1')
Oct 16 18:52:32 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:52:32 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] No VIF found with MAC fa:16:3e:0f:b4:9a, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:52:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:52:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:52:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:52:34 user nova-compute[74247]: DEBUG nova.compute.manager [req-e70e2304-4846-4584-a0b0-925a7064c218 req-e06ed489-69ee-4355-a719-6a4f7cfff9a6 service nova] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Received event network-vif-plugged-fee1b802-a163-42e1-8262-e5553f847cb8 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:52:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e70e2304-4846-4584-a0b0-925a7064c218 req-e06ed489-69ee-4355-a719-6a4f7cfff9a6 service nova] Acquiring lock "75e5e67a-3e02-4bc4-8e28-04125d32c6e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:52:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e70e2304-4846-4584-a0b0-925a7064c218 req-e06ed489-69ee-4355-a719-6a4f7cfff9a6 service nova] Lock "75e5e67a-3e02-4bc4-8e28-04125d32c6e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:52:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e70e2304-4846-4584-a0b0-925a7064c218 req-e06ed489-69ee-4355-a719-6a4f7cfff9a6 service nova] Lock "75e5e67a-3e02-4bc4-8e28-04125d32c6e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:52:34 user nova-compute[74247]: DEBUG nova.compute.manager [req-e70e2304-4846-4584-a0b0-925a7064c218 req-e06ed489-69ee-4355-a719-6a4f7cfff9a6 service nova] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] No waiting events found dispatching network-vif-plugged-fee1b802-a163-42e1-8262-e5553f847cb8 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:52:34 user nova-compute[74247]: WARNING nova.compute.manager [req-e70e2304-4846-4584-a0b0-925a7064c218 req-e06ed489-69ee-4355-a719-6a4f7cfff9a6 service nova] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Received unexpected event network-vif-plugged-fee1b802-a163-42e1-8262-e5553f847cb8 for instance with vm_state building and task_state spawning.
Oct 16 18:52:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:52:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:52:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:52:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:52:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:52:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:52:36 user nova-compute[74247]: DEBUG nova.compute.manager [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:52:36 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:52:36 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Instance spawned successfully.
Oct 16 18:52:36 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 18:52:36 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:52:36 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:52:36 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:52:36 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:52:36 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:52:36 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:52:36 user nova-compute[74247]: INFO nova.compute.manager [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Took 5.17 seconds to spawn the instance on the hypervisor.
Oct 16 18:52:36 user nova-compute[74247]: DEBUG nova.compute.manager [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:52:36 user nova-compute[74247]: DEBUG nova.compute.manager [req-0be18960-1fc2-46d4-8a4c-278a74a0969f req-ce8d92a3-0783-43ef-b333-dd30e9af77de service nova] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Received event network-vif-plugged-fee1b802-a163-42e1-8262-e5553f847cb8 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:52:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0be18960-1fc2-46d4-8a4c-278a74a0969f req-ce8d92a3-0783-43ef-b333-dd30e9af77de service nova] Acquiring lock "75e5e67a-3e02-4bc4-8e28-04125d32c6e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:52:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0be18960-1fc2-46d4-8a4c-278a74a0969f req-ce8d92a3-0783-43ef-b333-dd30e9af77de service nova] Lock "75e5e67a-3e02-4bc4-8e28-04125d32c6e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:52:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0be18960-1fc2-46d4-8a4c-278a74a0969f req-ce8d92a3-0783-43ef-b333-dd30e9af77de service nova] Lock "75e5e67a-3e02-4bc4-8e28-04125d32c6e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:52:36 user nova-compute[74247]: DEBUG nova.compute.manager [req-0be18960-1fc2-46d4-8a4c-278a74a0969f req-ce8d92a3-0783-43ef-b333-dd30e9af77de service nova] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] No waiting events found dispatching network-vif-plugged-fee1b802-a163-42e1-8262-e5553f847cb8 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:52:36 user nova-compute[74247]: WARNING nova.compute.manager [req-0be18960-1fc2-46d4-8a4c-278a74a0969f req-ce8d92a3-0783-43ef-b333-dd30e9af77de service nova] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Received unexpected event network-vif-plugged-fee1b802-a163-42e1-8262-e5553f847cb8 for instance with vm_state building and task_state spawning.
Oct 16 18:52:36 user nova-compute[74247]: INFO nova.compute.manager [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Took 30.73 seconds to build instance.
Oct 16 18:52:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f384f8f2-af34-43a1-9dd8-e065daee8ef2 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "75e5e67a-3e02-4bc4-8e28-04125d32c6e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.836s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:52:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:52:37 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:52:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:52:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:52:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:52:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:52:52 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:52:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:52:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:02 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Acquiring lock "caeb76f2-c378-4ca9-ac9d-b21bbda08343" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:53:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "caeb76f2-c378-4ca9-ac9d-b21bbda08343" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:53:02 user nova-compute[74247]: DEBUG nova.compute.manager [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 18:53:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:53:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:53:03 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:53:03 user nova-compute[74247]: INFO nova.compute.claims [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Claim successful on node user
Oct 16 18:53:03 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:53:03 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:53:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.357s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:53:03 user nova-compute[74247]: DEBUG nova.compute.manager [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 18:53:03 user nova-compute[74247]: DEBUG nova.compute.manager [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 18:53:03 user nova-compute[74247]: DEBUG nova.network.neutron [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 18:53:03 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 18:53:03 user nova-compute[74247]: DEBUG nova.compute.manager [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 18:53:03 user nova-compute[74247]: DEBUG nova.policy [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb73af6700c1406994dab6331939fe1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf6596e67794e1794dc93e8e8523ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 18:53:03 user nova-compute[74247]: DEBUG nova.compute.manager [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 18:53:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:53:03 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Creating image(s)
Oct 16 18:53:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Acquiring lock "/opt/stack/data/nova/instances/caeb76f2-c378-4ca9-ac9d-b21bbda08343/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:53:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "/opt/stack/data/nova/instances/caeb76f2-c378-4ca9-ac9d-b21bbda08343/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:53:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "/opt/stack/data/nova/instances/caeb76f2-c378-4ca9-ac9d-b21bbda08343/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:53:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:53:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.205s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:53:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Acquiring lock "37399febbd18f60b85fd0f833558f6a3539ab231" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:53:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:53:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:53:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.176s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:53:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/caeb76f2-c378-4ca9-ac9d-b21bbda08343/disk 1073741824 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:53:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/caeb76f2-c378-4ca9-ac9d-b21bbda08343/disk 1073741824" returned: 0 in 0.056s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:53:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:53:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:53:04 user nova-compute[74247]: DEBUG nova.network.neutron [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Successfully created port: 0f13fea1-9428-4547-8f54-8ba7b9b9e07f {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:53:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.192s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:53:04 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Checking if we can resize image /opt/stack/data/nova/instances/caeb76f2-c378-4ca9-ac9d-b21bbda08343/disk. size=1073741824 {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 18:53:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caeb76f2-c378-4ca9-ac9d-b21bbda08343/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:53:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caeb76f2-c378-4ca9-ac9d-b21bbda08343/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:53:04 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Cannot resize image /opt/stack/data/nova/instances/caeb76f2-c378-4ca9-ac9d-b21bbda08343/disk to a smaller size. {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 18:53:04 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 18:53:04 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Ensure instance console log exists: /opt/stack/data/nova/instances/caeb76f2-c378-4ca9-ac9d-b21bbda08343/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:53:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:53:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:53:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:53:04 user nova-compute[74247]: DEBUG nova.network.neutron [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Successfully updated port: 0f13fea1-9428-4547-8f54-8ba7b9b9e07f {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:53:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Acquiring lock "refresh_cache-caeb76f2-c378-4ca9-ac9d-b21bbda08343" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:53:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Acquired lock "refresh_cache-caeb76f2-c378-4ca9-ac9d-b21bbda08343" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:53:04 user nova-compute[74247]: DEBUG nova.network.neutron [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:53:04 user nova-compute[74247]: DEBUG nova.compute.manager [req-e90d2049-79fd-412c-84f5-8303fccb92ee req-6fee5bb3-fafe-44af-b1c1-2d546897b2ae service nova] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Received event network-changed-0f13fea1-9428-4547-8f54-8ba7b9b9e07f {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:53:04 user nova-compute[74247]: DEBUG nova.compute.manager [req-e90d2049-79fd-412c-84f5-8303fccb92ee req-6fee5bb3-fafe-44af-b1c1-2d546897b2ae service nova] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Refreshing instance network info cache due to event network-changed-0f13fea1-9428-4547-8f54-8ba7b9b9e07f. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:53:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e90d2049-79fd-412c-84f5-8303fccb92ee req-6fee5bb3-fafe-44af-b1c1-2d546897b2ae service nova] Acquiring lock "refresh_cache-caeb76f2-c378-4ca9-ac9d-b21bbda08343" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG nova.network.neutron [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG nova.network.neutron [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Updating instance_info_cache with network_info: [{"id": "0f13fea1-9428-4547-8f54-8ba7b9b9e07f", "address": "fa:16:3e:d1:18:e8", "network": {"id": "8e0ea38d-892f-4f82-a321-93292d5bea90", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-201299230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf6596e67794e1794dc93e8e8523ae7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f13fea1-94", "ovs_interfaceid": "0f13fea1-9428-4547-8f54-8ba7b9b9e07f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Releasing lock "refresh_cache-caeb76f2-c378-4ca9-ac9d-b21bbda08343" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG nova.compute.manager [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Instance network_info: |[{"id": "0f13fea1-9428-4547-8f54-8ba7b9b9e07f", "address": "fa:16:3e:d1:18:e8", "network": {"id": "8e0ea38d-892f-4f82-a321-93292d5bea90", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-201299230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf6596e67794e1794dc93e8e8523ae7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f13fea1-94", "ovs_interfaceid": "0f13fea1-9428-4547-8f54-8ba7b9b9e07f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e90d2049-79fd-412c-84f5-8303fccb92ee req-6fee5bb3-fafe-44af-b1c1-2d546897b2ae service nova] Acquired lock "refresh_cache-caeb76f2-c378-4ca9-ac9d-b21bbda08343" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG nova.network.neutron [req-e90d2049-79fd-412c-84f5-8303fccb92ee req-6fee5bb3-fafe-44af-b1c1-2d546897b2ae service nova] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Refreshing network info cache for port 0f13fea1-9428-4547-8f54-8ba7b9b9e07f {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Start _get_guest_xml network_info=[{"id": "0f13fea1-9428-4547-8f54-8ba7b9b9e07f", "address": "fa:16:3e:d1:18:e8", "network": {"id": "8e0ea38d-892f-4f82-a321-93292d5bea90", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-201299230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf6596e67794e1794dc93e8e8523ae7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f13fea1-94", "ovs_interfaceid": "0f13fea1-9428-4547-8f54-8ba7b9b9e07f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': '83126bb1-29f5-42fe-8620-72ab0797f776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:53:05 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:53:05 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:53:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:53:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-486657457',display_name='tempest-VolumesSnapshotTestJSON-instance-486657457',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-486657457',id=40,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANRpLlA35xp1wxL7Lve2agQRlFcBdevBC36yPFIuP0wtithsfKbO/NDP7lc4Gu5Fd2HBRfgrBPr7wMcWtapdsjNWpGE6IA0YkAzGRYWOJ9K0QBg+jMqUPyzBHI5xhs75Q==',key_name='tempest-keypair-915996718',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eaf6596e67794e1794dc93e8e8523ae7',ramdisk_id='',reservation_id='r-w0hb22cg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-730943931',owner_user_name='tempest-VolumesSnapshotTestJSON-730943931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:53:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb73af6700c1406994dab6331939fe1b',uuid=caeb76f2-c378-4ca9-ac9d-b21bbda08343,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f13fea1-9428-4547-8f54-8ba7b9b9e07f", "address": "fa:16:3e:d1:18:e8", "network": {"id": "8e0ea38d-892f-4f82-a321-93292d5bea90", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-201299230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf6596e67794e1794dc93e8e8523ae7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f13fea1-94", "ovs_interfaceid": "0f13fea1-9428-4547-8f54-8ba7b9b9e07f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Converting VIF {"id": "0f13fea1-9428-4547-8f54-8ba7b9b9e07f", "address": "fa:16:3e:d1:18:e8", "network": {"id": "8e0ea38d-892f-4f82-a321-93292d5bea90", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-201299230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf6596e67794e1794dc93e8e8523ae7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f13fea1-94", "ovs_interfaceid": "0f13fea1-9428-4547-8f54-8ba7b9b9e07f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:18:e8,bridge_name='br-int',has_traffic_filtering=True,id=0f13fea1-9428-4547-8f54-8ba7b9b9e07f,network=Network(8e0ea38d-892f-4f82-a321-93292d5bea90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f13fea1-94') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG nova.objects.instance [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lazy-loading 'pci_devices' on Instance uuid caeb76f2-c378-4ca9-ac9d-b21bbda08343 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:53:05 user nova-compute[74247]:   <uuid>caeb76f2-c378-4ca9-ac9d-b21bbda08343</uuid>
Oct 16 18:53:05 user nova-compute[74247]:   <name>instance-00000028</name>
Oct 16 18:53:05 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:53:05 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:53:05 user nova-compute[74247]:   <metadata>
Oct 16 18:53:05 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:53:05 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:53:05 user nova-compute[74247]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-486657457</nova:name>
Oct 16 18:53:05 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:53:05</nova:creationTime>
Oct 16 18:53:05 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:53:05 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:53:05 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:53:05 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:53:05 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:53:05 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:53:05 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:53:05 user nova-compute[74247]:       <nova:owner>
Oct 16 18:53:05 user nova-compute[74247]:         <nova:user uuid="bb73af6700c1406994dab6331939fe1b">tempest-VolumesSnapshotTestJSON-730943931-project-member</nova:user>
Oct 16 18:53:05 user nova-compute[74247]:         <nova:project uuid="eaf6596e67794e1794dc93e8e8523ae7">tempest-VolumesSnapshotTestJSON-730943931</nova:project>
Oct 16 18:53:05 user nova-compute[74247]:       </nova:owner>
Oct 16 18:53:05 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:53:05 user nova-compute[74247]:       <nova:ports>
Oct 16 18:53:05 user nova-compute[74247]:         <nova:port uuid="0f13fea1-9428-4547-8f54-8ba7b9b9e07f">
Oct 16 18:53:05 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 16 18:53:05 user nova-compute[74247]:         </nova:port>
Oct 16 18:53:05 user nova-compute[74247]:       </nova:ports>
Oct 16 18:53:05 user nova-compute[74247]:     </nova:instance>
Oct 16 18:53:05 user nova-compute[74247]:   </metadata>
Oct 16 18:53:05 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:53:05 user nova-compute[74247]:     <system>
Oct 16 18:53:05 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:53:05 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:53:05 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:53:05 user nova-compute[74247]:       <entry name="serial">caeb76f2-c378-4ca9-ac9d-b21bbda08343</entry>
Oct 16 18:53:05 user nova-compute[74247]:       <entry name="uuid">caeb76f2-c378-4ca9-ac9d-b21bbda08343</entry>
Oct 16 18:53:05 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:53:05 user nova-compute[74247]:     </system>
Oct 16 18:53:05 user nova-compute[74247]:   </sysinfo>
Oct 16 18:53:05 user nova-compute[74247]:   <os>
Oct 16 18:53:05 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:53:05 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:53:05 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:53:05 user nova-compute[74247]:   </os>
Oct 16 18:53:05 user nova-compute[74247]:   <features>
Oct 16 18:53:05 user nova-compute[74247]:     <acpi/>
Oct 16 18:53:05 user nova-compute[74247]:     <apic/>
Oct 16 18:53:05 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:53:05 user nova-compute[74247]:   </features>
Oct 16 18:53:05 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:53:05 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:53:05 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:53:05 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:53:05 user nova-compute[74247]:   </clock>
Oct 16 18:53:05 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:53:05 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:53:05 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:53:05 user nova-compute[74247]:   </cpu>
Oct 16 18:53:05 user nova-compute[74247]:   <devices>
Oct 16 18:53:05 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:53:05 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:53:05 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/caeb76f2-c378-4ca9-ac9d-b21bbda08343/disk"/>
Oct 16 18:53:05 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:53:05 user nova-compute[74247]:     </disk>
Oct 16 18:53:05 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:53:05 user nova-compute[74247]:       <mac address="fa:16:3e:d1:18:e8"/>
Oct 16 18:53:05 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:53:05 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:53:05 user nova-compute[74247]:       <target dev="tap0f13fea1-94"/>
Oct 16 18:53:05 user nova-compute[74247]:     </interface>
Oct 16 18:53:05 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:53:05 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/caeb76f2-c378-4ca9-ac9d-b21bbda08343/console.log" append="off"/>
Oct 16 18:53:05 user nova-compute[74247]:     </serial>
Oct 16 18:53:05 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:53:05 user nova-compute[74247]:     <video>
Oct 16 18:53:05 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:53:05 user nova-compute[74247]:     </video>
Oct 16 18:53:05 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:53:05 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:53:05 user nova-compute[74247]:     </rng>
Oct 16 18:53:05 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:53:05 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:53:05 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:53:05 user nova-compute[74247]:     </memballoon>
Oct 16 18:53:05 user nova-compute[74247]:   </devices>
Oct 16 18:53:05 user nova-compute[74247]: </domain>
Oct 16 18:53:05 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:53:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-486657457',display_name='tempest-VolumesSnapshotTestJSON-instance-486657457',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-486657457',id=40,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANRpLlA35xp1wxL7Lve2agQRlFcBdevBC36yPFIuP0wtithsfKbO/NDP7lc4Gu5Fd2HBRfgrBPr7wMcWtapdsjNWpGE6IA0YkAzGRYWOJ9K0QBg+jMqUPyzBHI5xhs75Q==',key_name='tempest-keypair-915996718',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eaf6596e67794e1794dc93e8e8523ae7',ramdisk_id='',reservation_id='r-w0hb22cg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-730943931',owner_user_name='tempest-VolumesSnapshotTestJSON-730943931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:53:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb73af6700c1406994dab6331939fe1b',uuid=caeb76f2-c378-4ca9-ac9d-b21bbda08343,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f13fea1-9428-4547-8f54-8ba7b9b9e07f", "address": "fa:16:3e:d1:18:e8", "network": {"id": "8e0ea38d-892f-4f82-a321-93292d5bea90", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-201299230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf6596e67794e1794dc93e8e8523ae7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f13fea1-94", "ovs_interfaceid": "0f13fea1-9428-4547-8f54-8ba7b9b9e07f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Converting VIF {"id": "0f13fea1-9428-4547-8f54-8ba7b9b9e07f", "address": "fa:16:3e:d1:18:e8", "network": {"id": "8e0ea38d-892f-4f82-a321-93292d5bea90", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-201299230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf6596e67794e1794dc93e8e8523ae7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f13fea1-94", "ovs_interfaceid": "0f13fea1-9428-4547-8f54-8ba7b9b9e07f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:18:e8,bridge_name='br-int',has_traffic_filtering=True,id=0f13fea1-9428-4547-8f54-8ba7b9b9e07f,network=Network(8e0ea38d-892f-4f82-a321-93292d5bea90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f13fea1-94') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG os_vif [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:18:e8,bridge_name='br-int',has_traffic_filtering=True,id=0f13fea1-9428-4547-8f54-8ba7b9b9e07f,network=Network(8e0ea38d-892f-4f82-a321-93292d5bea90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f13fea1-94') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '279fe5b7-9598-5aa5-8e65-8f83c8440e35', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f13fea1-94, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0f13fea1-94, col_values=(('qos', UUID('05d2c77b-74a5-47ad-bb9f-eb1bb1f92540')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0f13fea1-94, col_values=(('external_ids', {'iface-id': '0f13fea1-9428-4547-8f54-8ba7b9b9e07f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:18:e8', 'vm-uuid': 'caeb76f2-c378-4ca9-ac9d-b21bbda08343'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:05 user nova-compute[74247]: INFO os_vif [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:18:e8,bridge_name='br-int',has_traffic_filtering=True,id=0f13fea1-9428-4547-8f54-8ba7b9b9e07f,network=Network(8e0ea38d-892f-4f82-a321-93292d5bea90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f13fea1-94')
Oct 16 18:53:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] No VIF found with MAC fa:16:3e:d1:18:e8, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG nova.network.neutron [req-e90d2049-79fd-412c-84f5-8303fccb92ee req-6fee5bb3-fafe-44af-b1c1-2d546897b2ae service nova] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Updated VIF entry in instance network info cache for port 0f13fea1-9428-4547-8f54-8ba7b9b9e07f. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG nova.network.neutron [req-e90d2049-79fd-412c-84f5-8303fccb92ee req-6fee5bb3-fafe-44af-b1c1-2d546897b2ae service nova] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Updating instance_info_cache with network_info: [{"id": "0f13fea1-9428-4547-8f54-8ba7b9b9e07f", "address": "fa:16:3e:d1:18:e8", "network": {"id": "8e0ea38d-892f-4f82-a321-93292d5bea90", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-201299230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf6596e67794e1794dc93e8e8523ae7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f13fea1-94", "ovs_interfaceid": "0f13fea1-9428-4547-8f54-8ba7b9b9e07f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:53:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e90d2049-79fd-412c-84f5-8303fccb92ee req-6fee5bb3-fafe-44af-b1c1-2d546897b2ae service nova] Releasing lock "refresh_cache-caeb76f2-c378-4ca9-ac9d-b21bbda08343" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:53:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:07 user nova-compute[74247]: DEBUG nova.compute.manager [req-f704d268-eee9-4c2e-8bd5-2b12a658e74b req-5df02679-bb3b-4caf-b07b-955e4e09ee7a service nova] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Received event network-vif-plugged-0f13fea1-9428-4547-8f54-8ba7b9b9e07f {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:53:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f704d268-eee9-4c2e-8bd5-2b12a658e74b req-5df02679-bb3b-4caf-b07b-955e4e09ee7a service nova] Acquiring lock "caeb76f2-c378-4ca9-ac9d-b21bbda08343-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:53:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f704d268-eee9-4c2e-8bd5-2b12a658e74b req-5df02679-bb3b-4caf-b07b-955e4e09ee7a service nova] Lock "caeb76f2-c378-4ca9-ac9d-b21bbda08343-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:53:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f704d268-eee9-4c2e-8bd5-2b12a658e74b req-5df02679-bb3b-4caf-b07b-955e4e09ee7a service nova] Lock "caeb76f2-c378-4ca9-ac9d-b21bbda08343-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:53:07 user nova-compute[74247]: DEBUG nova.compute.manager [req-f704d268-eee9-4c2e-8bd5-2b12a658e74b req-5df02679-bb3b-4caf-b07b-955e4e09ee7a service nova] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] No waiting events found dispatching network-vif-plugged-0f13fea1-9428-4547-8f54-8ba7b9b9e07f {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:53:07 user nova-compute[74247]: WARNING nova.compute.manager [req-f704d268-eee9-4c2e-8bd5-2b12a658e74b req-5df02679-bb3b-4caf-b07b-955e4e09ee7a service nova] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Received unexpected event network-vif-plugged-0f13fea1-9428-4547-8f54-8ba7b9b9e07f for instance with vm_state building and task_state spawning.
Oct 16 18:53:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:08 user nova-compute[74247]: DEBUG nova.compute.manager [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:53:08 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:53:08 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Instance spawned successfully.
Oct 16 18:53:08 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 18:53:08 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:53:08 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:53:08 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:53:08 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:53:08 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:53:08 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:53:08 user nova-compute[74247]: INFO nova.compute.manager [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Took 5.24 seconds to spawn the instance on the hypervisor.
Oct 16 18:53:08 user nova-compute[74247]: DEBUG nova.compute.manager [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:53:09 user nova-compute[74247]: DEBUG nova.compute.manager [req-3569f887-6f6e-474b-babd-5e75cd7ae24f req-8415e2b0-5af1-46dc-823b-b180c207b4c7 service nova] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Received event network-vif-plugged-0f13fea1-9428-4547-8f54-8ba7b9b9e07f {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:53:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3569f887-6f6e-474b-babd-5e75cd7ae24f req-8415e2b0-5af1-46dc-823b-b180c207b4c7 service nova] Acquiring lock "caeb76f2-c378-4ca9-ac9d-b21bbda08343-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:53:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3569f887-6f6e-474b-babd-5e75cd7ae24f req-8415e2b0-5af1-46dc-823b-b180c207b4c7 service nova] Lock "caeb76f2-c378-4ca9-ac9d-b21bbda08343-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:53:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3569f887-6f6e-474b-babd-5e75cd7ae24f req-8415e2b0-5af1-46dc-823b-b180c207b4c7 service nova] Lock "caeb76f2-c378-4ca9-ac9d-b21bbda08343-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:53:09 user nova-compute[74247]: DEBUG nova.compute.manager [req-3569f887-6f6e-474b-babd-5e75cd7ae24f req-8415e2b0-5af1-46dc-823b-b180c207b4c7 service nova] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] No waiting events found dispatching network-vif-plugged-0f13fea1-9428-4547-8f54-8ba7b9b9e07f {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:53:09 user nova-compute[74247]: WARNING nova.compute.manager [req-3569f887-6f6e-474b-babd-5e75cd7ae24f req-8415e2b0-5af1-46dc-823b-b180c207b4c7 service nova] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Received unexpected event network-vif-plugged-0f13fea1-9428-4547-8f54-8ba7b9b9e07f for instance with vm_state building and task_state spawning.
Oct 16 18:53:09 user nova-compute[74247]: INFO nova.compute.manager [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Took 6.01 seconds to build instance.
Oct 16 18:53:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0710493d-67b4-40c0-9e01-854f660e4b32 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "caeb76f2-c378-4ca9-ac9d-b21bbda08343" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.135s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:53:10 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:12 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:53:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:17 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:53:18 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:53:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:53:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:53:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:53:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 18:53:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c9d603-30a4-4f9f-8ea3-218eb747e580/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:53:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c9d603-30a4-4f9f-8ea3-218eb747e580/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:53:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c9d603-30a4-4f9f-8ea3-218eb747e580/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:53:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c9d603-30a4-4f9f-8ea3-218eb747e580/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:53:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:53:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:53:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:53:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:53:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caeb76f2-c378-4ca9-ac9d-b21bbda08343/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:53:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caeb76f2-c378-4ca9-ac9d-b21bbda08343/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:53:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caeb76f2-c378-4ca9-ac9d-b21bbda08343/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:53:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caeb76f2-c378-4ca9-ac9d-b21bbda08343/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:53:19 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:53:20 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:53:20 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:53:20 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=8581MB free_disk=25.004711151123047GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 18:53:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:53:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:53:20 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance fa1dea31-91bc-4fda-8fb2-638628b66b3f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:53:20 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance b3c9d603-30a4-4f9f-8ea3-218eb747e580 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:53:20 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 75e5e67a-3e02-4bc4-8e28-04125d32c6e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:53:20 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance caeb76f2-c378-4ca9-ac9d-b21bbda08343 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:53:20 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 18:53:20 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 18:53:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:20 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:53:20 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:53:20 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 18:53:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.265s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:53:21 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:53:21 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 18:53:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "refresh_cache-b3c9d603-30a4-4f9f-8ea3-218eb747e580" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:53:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquired lock "refresh_cache-b3c9d603-30a4-4f9f-8ea3-218eb747e580" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:53:21 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Forcefully refreshing network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 18:53:21 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Updating instance_info_cache with network_info: [{"id": "e05a5f20-8c5b-465b-8795-ff5469d75393", "address": "fa:16:3e:2e:cf:c7", "network": {"id": "dccde3f4-f49e-49b6-905e-3aaf51b415b2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-19864196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e978b6d707c46188f74f2ddbf6deb62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape05a5f20-8c", "ovs_interfaceid": "e05a5f20-8c5b-465b-8795-ff5469d75393", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:53:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Releasing lock "refresh_cache-b3c9d603-30a4-4f9f-8ea3-218eb747e580" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:53:22 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Updated the network info_cache for instance {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 18:53:22 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:53:22 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:53:22 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:53:22 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 18:53:24 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:53:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:26 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:53:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:40 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c53df2a2-5baa-4f27-bc61-1e2425be020f tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Acquiring lock "b3c9d603-30a4-4f9f-8ea3-218eb747e580" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:53:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c53df2a2-5baa-4f27-bc61-1e2425be020f tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Lock "b3c9d603-30a4-4f9f-8ea3-218eb747e580" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:53:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c53df2a2-5baa-4f27-bc61-1e2425be020f tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Acquiring lock "b3c9d603-30a4-4f9f-8ea3-218eb747e580-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:53:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c53df2a2-5baa-4f27-bc61-1e2425be020f tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Lock "b3c9d603-30a4-4f9f-8ea3-218eb747e580-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:53:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c53df2a2-5baa-4f27-bc61-1e2425be020f tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Lock "b3c9d603-30a4-4f9f-8ea3-218eb747e580-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:53:41 user nova-compute[74247]: INFO nova.compute.manager [None req-c53df2a2-5baa-4f27-bc61-1e2425be020f tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Terminating instance
Oct 16 18:53:41 user nova-compute[74247]: DEBUG nova.compute.manager [None req-c53df2a2-5baa-4f27-bc61-1e2425be020f tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 18:53:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:41 user nova-compute[74247]: DEBUG nova.compute.manager [req-12a31cf4-cd9e-4058-bc26-f50c1255276e req-3f6f7046-df74-417c-a6b8-8796d0f7cd9b service nova] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Received event network-vif-unplugged-e05a5f20-8c5b-465b-8795-ff5469d75393 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:53:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-12a31cf4-cd9e-4058-bc26-f50c1255276e req-3f6f7046-df74-417c-a6b8-8796d0f7cd9b service nova] Acquiring lock "b3c9d603-30a4-4f9f-8ea3-218eb747e580-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:53:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-12a31cf4-cd9e-4058-bc26-f50c1255276e req-3f6f7046-df74-417c-a6b8-8796d0f7cd9b service nova] Lock "b3c9d603-30a4-4f9f-8ea3-218eb747e580-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:53:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-12a31cf4-cd9e-4058-bc26-f50c1255276e req-3f6f7046-df74-417c-a6b8-8796d0f7cd9b service nova] Lock "b3c9d603-30a4-4f9f-8ea3-218eb747e580-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:53:41 user nova-compute[74247]: DEBUG nova.compute.manager [req-12a31cf4-cd9e-4058-bc26-f50c1255276e req-3f6f7046-df74-417c-a6b8-8796d0f7cd9b service nova] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] No waiting events found dispatching network-vif-unplugged-e05a5f20-8c5b-465b-8795-ff5469d75393 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:53:41 user nova-compute[74247]: DEBUG nova.compute.manager [req-12a31cf4-cd9e-4058-bc26-f50c1255276e req-3f6f7046-df74-417c-a6b8-8796d0f7cd9b service nova] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Received event network-vif-unplugged-e05a5f20-8c5b-465b-8795-ff5469d75393 for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:53:41 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Instance destroyed successfully.
Oct 16 18:53:41 user nova-compute[74247]: DEBUG nova.objects.instance [None req-c53df2a2-5baa-4f27-bc61-1e2425be020f tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Lazy-loading 'resources' on Instance uuid b3c9d603-30a4-4f9f-8ea3-218eb747e580 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:53:41 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-c53df2a2-5baa-4f27-bc61-1e2425be020f tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:51:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1644425080',display_name='tempest-VolumesActionsTest-instance-1644425080',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1644425080',id=38,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:51:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e978b6d707c46188f74f2ddbf6deb62',ramdisk_id='',reservation_id='r-zjhyiaur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-524114660',owner_user_name='tempest-VolumesActionsTest-524114660-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:51:57Z,user_data=None,user_id='c3510de5a2cc43f38f7380d53eeab430',uuid=b3c9d603-30a4-4f9f-8ea3-218eb747e580,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e05a5f20-8c5b-465b-8795-ff5469d75393", "address": "fa:16:3e:2e:cf:c7", "network": {"id": "dccde3f4-f49e-49b6-905e-3aaf51b415b2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-19864196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e978b6d707c46188f74f2ddbf6deb62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape05a5f20-8c", "ovs_interfaceid": "e05a5f20-8c5b-465b-8795-ff5469d75393", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:53:41 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-c53df2a2-5baa-4f27-bc61-1e2425be020f tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Converting VIF {"id": "e05a5f20-8c5b-465b-8795-ff5469d75393", "address": "fa:16:3e:2e:cf:c7", "network": {"id": "dccde3f4-f49e-49b6-905e-3aaf51b415b2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-19864196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e978b6d707c46188f74f2ddbf6deb62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape05a5f20-8c", "ovs_interfaceid": "e05a5f20-8c5b-465b-8795-ff5469d75393", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:53:41 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-c53df2a2-5baa-4f27-bc61-1e2425be020f tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:cf:c7,bridge_name='br-int',has_traffic_filtering=True,id=e05a5f20-8c5b-465b-8795-ff5469d75393,network=Network(dccde3f4-f49e-49b6-905e-3aaf51b415b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape05a5f20-8c') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:53:41 user nova-compute[74247]: DEBUG os_vif [None req-c53df2a2-5baa-4f27-bc61-1e2425be020f tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:cf:c7,bridge_name='br-int',has_traffic_filtering=True,id=e05a5f20-8c5b-465b-8795-ff5469d75393,network=Network(dccde3f4-f49e-49b6-905e-3aaf51b415b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape05a5f20-8c') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:53:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape05a5f20-8c, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:53:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:53:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e906e746-02f3-4e5f-b1ee-8299896959b5) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:53:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:53:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:41 user nova-compute[74247]: INFO os_vif [None req-c53df2a2-5baa-4f27-bc61-1e2425be020f tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:cf:c7,bridge_name='br-int',has_traffic_filtering=True,id=e05a5f20-8c5b-465b-8795-ff5469d75393,network=Network(dccde3f4-f49e-49b6-905e-3aaf51b415b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape05a5f20-8c')
Oct 16 18:53:41 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-c53df2a2-5baa-4f27-bc61-1e2425be020f tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Deleting instance files /opt/stack/data/nova/instances/b3c9d603-30a4-4f9f-8ea3-218eb747e580_del
Oct 16 18:53:41 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-c53df2a2-5baa-4f27-bc61-1e2425be020f tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Deletion of /opt/stack/data/nova/instances/b3c9d603-30a4-4f9f-8ea3-218eb747e580_del complete
Oct 16 18:53:41 user nova-compute[74247]: INFO nova.compute.manager [None req-c53df2a2-5baa-4f27-bc61-1e2425be020f tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Took 0.67 seconds to destroy the instance on the hypervisor.
Oct 16 18:53:41 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-c53df2a2-5baa-4f27-bc61-1e2425be020f tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 18:53:41 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 18:53:41 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 18:53:42 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:53:42 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Took 0.46 seconds to deallocate network for instance.
Oct 16 18:53:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c53df2a2-5baa-4f27-bc61-1e2425be020f tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:53:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c53df2a2-5baa-4f27-bc61-1e2425be020f tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:53:42 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-c53df2a2-5baa-4f27-bc61-1e2425be020f tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:53:42 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-c53df2a2-5baa-4f27-bc61-1e2425be020f tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:53:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c53df2a2-5baa-4f27-bc61-1e2425be020f tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.187s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:53:42 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-c53df2a2-5baa-4f27-bc61-1e2425be020f tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Deleted allocations for instance b3c9d603-30a4-4f9f-8ea3-218eb747e580
Oct 16 18:53:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c53df2a2-5baa-4f27-bc61-1e2425be020f tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Lock "b3c9d603-30a4-4f9f-8ea3-218eb747e580" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.499s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:53:43 user nova-compute[74247]: DEBUG nova.compute.manager [req-055d71fe-9e93-41f9-9f61-71e20b6cfa23 req-598046d0-47c4-4754-94dc-8c09e131f07e service nova] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Received event network-vif-plugged-e05a5f20-8c5b-465b-8795-ff5469d75393 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:53:43 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-055d71fe-9e93-41f9-9f61-71e20b6cfa23 req-598046d0-47c4-4754-94dc-8c09e131f07e service nova] Acquiring lock "b3c9d603-30a4-4f9f-8ea3-218eb747e580-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:53:43 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-055d71fe-9e93-41f9-9f61-71e20b6cfa23 req-598046d0-47c4-4754-94dc-8c09e131f07e service nova] Lock "b3c9d603-30a4-4f9f-8ea3-218eb747e580-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:53:43 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-055d71fe-9e93-41f9-9f61-71e20b6cfa23 req-598046d0-47c4-4754-94dc-8c09e131f07e service nova] Lock "b3c9d603-30a4-4f9f-8ea3-218eb747e580-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:53:43 user nova-compute[74247]: DEBUG nova.compute.manager [req-055d71fe-9e93-41f9-9f61-71e20b6cfa23 req-598046d0-47c4-4754-94dc-8c09e131f07e service nova] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] No waiting events found dispatching network-vif-plugged-e05a5f20-8c5b-465b-8795-ff5469d75393 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:53:43 user nova-compute[74247]: WARNING nova.compute.manager [req-055d71fe-9e93-41f9-9f61-71e20b6cfa23 req-598046d0-47c4-4754-94dc-8c09e131f07e service nova] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Received unexpected event network-vif-plugged-e05a5f20-8c5b-465b-8795-ff5469d75393 for instance with vm_state deleted and task_state None.
Oct 16 18:53:43 user nova-compute[74247]: DEBUG nova.compute.manager [req-055d71fe-9e93-41f9-9f61-71e20b6cfa23 req-598046d0-47c4-4754-94dc-8c09e131f07e service nova] [instance: b3c9d603-30a4-4f9f-8ea3-218eb747e580] Received event network-vif-deleted-e05a5f20-8c5b-465b-8795-ff5469d75393 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:53:46 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:53:55 user nova-compute[74247]: DEBUG nova.objects.instance [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lazy-loading 'flavor' on Instance uuid fa1dea31-91bc-4fda-8fb2-638628b66b3f {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:53:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquiring lock "refresh_cache-fa1dea31-91bc-4fda-8fb2-638628b66b3f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:53:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquired lock "refresh_cache-fa1dea31-91bc-4fda-8fb2-638628b66b3f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:53:55 user nova-compute[74247]: DEBUG nova.network.neutron [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:53:55 user nova-compute[74247]: DEBUG nova.objects.instance [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lazy-loading 'info_cache' on Instance uuid fa1dea31-91bc-4fda-8fb2-638628b66b3f {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:53:55 user nova-compute[74247]: DEBUG nova.objects.base [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Object Instance<fa1dea31-91bc-4fda-8fb2-638628b66b3f> lazy-loaded attributes: flavor,info_cache {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:53:55 user nova-compute[74247]: DEBUG nova.network.neutron [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Updating instance_info_cache with network_info: [{"id": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "address": "fa:16:3e:ea:29:cf", "network": {"id": "14ee32da-d0e3-499f-bd47-721e882b2a57", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-700103883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6d2ba688434391b03a9f3320a360de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77ca2d19-f7", "ovs_interfaceid": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:53:55 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Releasing lock "refresh_cache-fa1dea31-91bc-4fda-8fb2-638628b66b3f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:53:55 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Instance destroyed successfully.
Oct 16 18:53:55 user nova-compute[74247]: DEBUG nova.objects.instance [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lazy-loading 'resources' on Instance uuid fa1dea31-91bc-4fda-8fb2-638628b66b3f {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:53:55 user nova-compute[74247]: DEBUG nova.objects.base [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Object Instance<fa1dea31-91bc-4fda-8fb2-638628b66b3f> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:53:55 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-659707189',display_name='tempest-AttachVolumeTestJSON-server-659707189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-659707189',id=35,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZNyKtinECwQEZs0xtAfyopWvuS0WcUALkCCqBfwO2f0LJvjht0xSFVuqtR8GKspliYK+mf0usf7lCpwlqMVzv4m9PsNpIcERNXyS11WNd3vgzvglK2WxbIqiF5MPTBmg==',key_name='tempest-keypair-1281053187',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:45:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='1d6d2ba688434391b03a9f3320a360de',ramdisk_id='',reservation_id='r-lyeae496',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1409761379',owner_user_name='tempest-AttachVolumeTestJSON-1409761379-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:52:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82c71a4cbbf8436dbfdc43bb4db65ef1',uuid=fa1dea31-91bc-4fda-8fb2-638628b66b3f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "address": "fa:16:3e:ea:29:cf", "network": {"id": "14ee32da-d0e3-499f-bd47-721e882b2a57", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-700103883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6d2ba688434391b03a9f3320a360de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77ca2d19-f7", "ovs_interfaceid": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:53:55 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Converting VIF {"id": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "address": "fa:16:3e:ea:29:cf", "network": {"id": "14ee32da-d0e3-499f-bd47-721e882b2a57", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-700103883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6d2ba688434391b03a9f3320a360de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77ca2d19-f7", "ovs_interfaceid": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:53:55 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:29:cf,bridge_name='br-int',has_traffic_filtering=True,id=77ca2d19-f745-461d-9f32-8d42469a6bfc,network=Network(14ee32da-d0e3-499f-bd47-721e882b2a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77ca2d19-f7') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:53:55 user nova-compute[74247]: DEBUG os_vif [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:29:cf,bridge_name='br-int',has_traffic_filtering=True,id=77ca2d19-f745-461d-9f32-8d42469a6bfc,network=Network(14ee32da-d0e3-499f-bd47-721e882b2a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77ca2d19-f7') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:53:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77ca2d19-f7, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:53:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:53:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c9be7679-1c70-4882-88d1-fc33471a5df2) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:53:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:53:55 user nova-compute[74247]: INFO os_vif [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:29:cf,bridge_name='br-int',has_traffic_filtering=True,id=77ca2d19-f745-461d-9f32-8d42469a6bfc,network=Network(14ee32da-d0e3-499f-bd47-721e882b2a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77ca2d19-f7')
Oct 16 18:53:55 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Start _get_guest_xml network_info=[{"id": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "address": "fa:16:3e:ea:29:cf", "network": {"id": "14ee32da-d0e3-499f-bd47-721e882b2a57", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-700103883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6d2ba688434391b03a9f3320a360de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77ca2d19-f7", "ovs_interfaceid": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': '83126bb1-29f5-42fe-8620-72ab0797f776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:53:55 user nova-compute[74247]: DEBUG nova.objects.instance [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lazy-loading 'numa_topology' on Instance uuid fa1dea31-91bc-4fda-8fb2-638628b66b3f {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:53:55 user nova-compute[74247]: DEBUG nova.objects.base [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Object Instance<fa1dea31-91bc-4fda-8fb2-638628b66b3f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:53:55 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:53:55 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:53:55 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:53:55 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:53:55 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:53:55 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:53:55 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:53:55 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:53:55 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:53:55 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:53:55 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:53:55 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:53:55 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:53:55 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:53:55 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:53:55 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:53:55 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:53:55 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:53:55 user nova-compute[74247]: DEBUG nova.objects.instance [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lazy-loading 'vcpu_model' on Instance uuid fa1dea31-91bc-4fda-8fb2-638628b66b3f {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:53:55 user nova-compute[74247]: DEBUG nova.objects.base [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Object Instance<fa1dea31-91bc-4fda-8fb2-638628b66b3f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:53:55 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-659707189',display_name='tempest-AttachVolumeTestJSON-server-659707189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-659707189',id=35,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZNyKtinECwQEZs0xtAfyopWvuS0WcUALkCCqBfwO2f0LJvjht0xSFVuqtR8GKspliYK+mf0usf7lCpwlqMVzv4m9PsNpIcERNXyS11WNd3vgzvglK2WxbIqiF5MPTBmg==',key_name='tempest-keypair-1281053187',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:45:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='1d6d2ba688434391b03a9f3320a360de',ramdisk_id='',reservation_id='r-lyeae496',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1409761379',owner_user_name='tempest-AttachVolumeTestJSON-1409761379-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:52:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82c71a4cbbf8436dbfdc43bb4db65ef1',uuid=fa1dea31-91bc-4fda-8fb2-638628b66b3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "address": "fa:16:3e:ea:29:cf", "network": {"id": "14ee32da-d0e3-499f-bd47-721e882b2a57", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-700103883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6d2ba688434391b03a9f3320a360de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77ca2d19-f7", "ovs_interfaceid": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:53:55 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Converting VIF {"id": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "address": "fa:16:3e:ea:29:cf", "network": {"id": "14ee32da-d0e3-499f-bd47-721e882b2a57", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-700103883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6d2ba688434391b03a9f3320a360de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77ca2d19-f7", "ovs_interfaceid": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:53:55 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:29:cf,bridge_name='br-int',has_traffic_filtering=True,id=77ca2d19-f745-461d-9f32-8d42469a6bfc,network=Network(14ee32da-d0e3-499f-bd47-721e882b2a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77ca2d19-f7') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:53:55 user nova-compute[74247]: DEBUG nova.objects.instance [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lazy-loading 'pci_devices' on Instance uuid fa1dea31-91bc-4fda-8fb2-638628b66b3f {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:53:55 user nova-compute[74247]: DEBUG nova.objects.base [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Object Instance<fa1dea31-91bc-4fda-8fb2-638628b66b3f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:53:55 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:53:55 user nova-compute[74247]:   <uuid>fa1dea31-91bc-4fda-8fb2-638628b66b3f</uuid>
Oct 16 18:53:55 user nova-compute[74247]:   <name>instance-00000023</name>
Oct 16 18:53:55 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:53:55 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:53:55 user nova-compute[74247]:   <metadata>
Oct 16 18:53:55 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:53:55 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:53:55 user nova-compute[74247]:       <nova:name>tempest-AttachVolumeTestJSON-server-659707189</nova:name>
Oct 16 18:53:55 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:53:55</nova:creationTime>
Oct 16 18:53:55 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:53:55 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:53:55 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:53:55 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:53:55 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:53:55 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:53:55 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:53:55 user nova-compute[74247]:       <nova:owner>
Oct 16 18:53:55 user nova-compute[74247]:         <nova:user uuid="82c71a4cbbf8436dbfdc43bb4db65ef1">tempest-AttachVolumeTestJSON-1409761379-project-member</nova:user>
Oct 16 18:53:55 user nova-compute[74247]:         <nova:project uuid="1d6d2ba688434391b03a9f3320a360de">tempest-AttachVolumeTestJSON-1409761379</nova:project>
Oct 16 18:53:55 user nova-compute[74247]:       </nova:owner>
Oct 16 18:53:55 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:53:55 user nova-compute[74247]:       <nova:ports>
Oct 16 18:53:55 user nova-compute[74247]:         <nova:port uuid="77ca2d19-f745-461d-9f32-8d42469a6bfc">
Oct 16 18:53:55 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 16 18:53:55 user nova-compute[74247]:         </nova:port>
Oct 16 18:53:55 user nova-compute[74247]:       </nova:ports>
Oct 16 18:53:55 user nova-compute[74247]:     </nova:instance>
Oct 16 18:53:55 user nova-compute[74247]:   </metadata>
Oct 16 18:53:55 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:53:55 user nova-compute[74247]:     <system>
Oct 16 18:53:55 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:53:55 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:53:55 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:53:55 user nova-compute[74247]:       <entry name="serial">fa1dea31-91bc-4fda-8fb2-638628b66b3f</entry>
Oct 16 18:53:55 user nova-compute[74247]:       <entry name="uuid">fa1dea31-91bc-4fda-8fb2-638628b66b3f</entry>
Oct 16 18:53:55 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:53:55 user nova-compute[74247]:     </system>
Oct 16 18:53:55 user nova-compute[74247]:   </sysinfo>
Oct 16 18:53:55 user nova-compute[74247]:   <os>
Oct 16 18:53:55 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:53:55 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:53:55 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:53:55 user nova-compute[74247]:   </os>
Oct 16 18:53:55 user nova-compute[74247]:   <features>
Oct 16 18:53:55 user nova-compute[74247]:     <acpi/>
Oct 16 18:53:55 user nova-compute[74247]:     <apic/>
Oct 16 18:53:55 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:53:55 user nova-compute[74247]:   </features>
Oct 16 18:53:55 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:53:55 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:53:55 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:53:55 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:53:55 user nova-compute[74247]:   </clock>
Oct 16 18:53:55 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:53:55 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:53:55 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:53:55 user nova-compute[74247]:   </cpu>
Oct 16 18:53:55 user nova-compute[74247]:   <devices>
Oct 16 18:53:55 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:53:55 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:53:55 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk"/>
Oct 16 18:53:55 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:53:55 user nova-compute[74247]:     </disk>
Oct 16 18:53:55 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:53:55 user nova-compute[74247]:       <mac address="fa:16:3e:ea:29:cf"/>
Oct 16 18:53:55 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:53:55 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:53:55 user nova-compute[74247]:       <target dev="tap77ca2d19-f7"/>
Oct 16 18:53:55 user nova-compute[74247]:     </interface>
Oct 16 18:53:55 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:53:55 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/console.log" append="off"/>
Oct 16 18:53:55 user nova-compute[74247]:     </serial>
Oct 16 18:53:55 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:53:55 user nova-compute[74247]:     <video>
Oct 16 18:53:55 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:53:55 user nova-compute[74247]:     </video>
Oct 16 18:53:55 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:53:55 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:53:55 user nova-compute[74247]:     </rng>
Oct 16 18:53:55 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:53:55 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:53:55 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:53:55 user nova-compute[74247]:     </memballoon>
Oct 16 18:53:55 user nova-compute[74247]:   </devices>
Oct 16 18:53:55 user nova-compute[74247]: </domain>
Oct 16 18:53:55 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:53:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:53:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:53:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:53:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:53:56 user nova-compute[74247]: DEBUG nova.objects.instance [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lazy-loading 'trusted_certs' on Instance uuid fa1dea31-91bc-4fda-8fb2-638628b66b3f {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:53:56 user nova-compute[74247]: DEBUG nova.objects.base [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Object Instance<fa1dea31-91bc-4fda-8fb2-638628b66b3f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:53:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:53:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.172s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:53:56 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk. size=1073741824 {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 18:53:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:53:56 user nova-compute[74247]: DEBUG nova.compute.manager [req-1bb1f140-5007-42a0-90f8-7e453d3c0fcb req-3b92359b-c22e-4523-9f67-ca535862e6a2 service nova] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Received event network-changed-fee1b802-a163-42e1-8262-e5553f847cb8 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:53:56 user nova-compute[74247]: DEBUG nova.compute.manager [req-1bb1f140-5007-42a0-90f8-7e453d3c0fcb req-3b92359b-c22e-4523-9f67-ca535862e6a2 service nova] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Refreshing instance network info cache due to event network-changed-fee1b802-a163-42e1-8262-e5553f847cb8. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:53:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1bb1f140-5007-42a0-90f8-7e453d3c0fcb req-3b92359b-c22e-4523-9f67-ca535862e6a2 service nova] Acquiring lock "refresh_cache-75e5e67a-3e02-4bc4-8e28-04125d32c6e9" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:53:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1bb1f140-5007-42a0-90f8-7e453d3c0fcb req-3b92359b-c22e-4523-9f67-ca535862e6a2 service nova] Acquired lock "refresh_cache-75e5e67a-3e02-4bc4-8e28-04125d32c6e9" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:53:56 user nova-compute[74247]: DEBUG nova.network.neutron [req-1bb1f140-5007-42a0-90f8-7e453d3c0fcb req-3b92359b-c22e-4523-9f67-ca535862e6a2 service nova] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Refreshing network info cache for port fee1b802-a163-42e1-8262-e5553f847cb8 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:53:56 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:53:56 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Cannot resize image /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk to a smaller size. {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 18:53:56 user nova-compute[74247]: DEBUG nova.objects.instance [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lazy-loading 'migration_context' on Instance uuid fa1dea31-91bc-4fda-8fb2-638628b66b3f {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:53:56 user nova-compute[74247]: DEBUG nova.objects.base [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Object Instance<fa1dea31-91bc-4fda-8fb2-638628b66b3f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 18:53:56 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-659707189',display_name='tempest-AttachVolumeTestJSON-server-659707189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-659707189',id=35,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZNyKtinECwQEZs0xtAfyopWvuS0WcUALkCCqBfwO2f0LJvjht0xSFVuqtR8GKspliYK+mf0usf7lCpwlqMVzv4m9PsNpIcERNXyS11WNd3vgzvglK2WxbIqiF5MPTBmg==',key_name='tempest-keypair-1281053187',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:45:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='1d6d2ba688434391b03a9f3320a360de',ramdisk_id='',reservation_id='r-lyeae496',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1409761379',owner_user_name='tempest-AttachVolumeTestJSON-1409761379-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:52:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82c71a4cbbf8436dbfdc43bb4db65ef1',uuid=fa1dea31-91bc-4fda-8fb2-638628b66b3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "address": "fa:16:3e:ea:29:cf", "network": {"id": "14ee32da-d0e3-499f-bd47-721e882b2a57", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-700103883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6d2ba688434391b03a9f3320a360de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77ca2d19-f7", "ovs_interfaceid": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:53:56 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Converting VIF {"id": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "address": "fa:16:3e:ea:29:cf", "network": {"id": "14ee32da-d0e3-499f-bd47-721e882b2a57", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-700103883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6d2ba688434391b03a9f3320a360de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77ca2d19-f7", "ovs_interfaceid": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:53:56 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:29:cf,bridge_name='br-int',has_traffic_filtering=True,id=77ca2d19-f745-461d-9f32-8d42469a6bfc,network=Network(14ee32da-d0e3-499f-bd47-721e882b2a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77ca2d19-f7') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:53:56 user nova-compute[74247]: DEBUG os_vif [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:29:cf,bridge_name='br-int',has_traffic_filtering=True,id=77ca2d19-f745-461d-9f32-8d42469a6bfc,network=Network(14ee32da-d0e3-499f-bd47-721e882b2a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77ca2d19-f7') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:53:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:53:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:53:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c5760a63-86e1-5b15-ad02-28cb0ebebcde', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:53:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:53:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap77ca2d19-f7, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:53:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap77ca2d19-f7, col_values=(('qos', UUID('5ef4577c-d0ec-44ef-974a-81b27ab0e22a')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:53:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap77ca2d19-f7, col_values=(('external_ids', {'iface-id': '77ca2d19-f745-461d-9f32-8d42469a6bfc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:29:cf', 'vm-uuid': 'fa1dea31-91bc-4fda-8fb2-638628b66b3f'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:53:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:53:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:56 user nova-compute[74247]: INFO os_vif [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:29:cf,bridge_name='br-int',has_traffic_filtering=True,id=77ca2d19-f745-461d-9f32-8d42469a6bfc,network=Network(14ee32da-d0e3-499f-bd47-721e882b2a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77ca2d19-f7')
Oct 16 18:53:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:57 user nova-compute[74247]: DEBUG nova.network.neutron [req-1bb1f140-5007-42a0-90f8-7e453d3c0fcb req-3b92359b-c22e-4523-9f67-ca535862e6a2 service nova] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Updated VIF entry in instance network info cache for port fee1b802-a163-42e1-8262-e5553f847cb8. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:53:57 user nova-compute[74247]: DEBUG nova.network.neutron [req-1bb1f140-5007-42a0-90f8-7e453d3c0fcb req-3b92359b-c22e-4523-9f67-ca535862e6a2 service nova] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Updating instance_info_cache with network_info: [{"id": "fee1b802-a163-42e1-8262-e5553f847cb8", "address": "fa:16:3e:0f:b4:9a", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee1b802-a1", "ovs_interfaceid": "fee1b802-a163-42e1-8262-e5553f847cb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:53:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1bb1f140-5007-42a0-90f8-7e453d3c0fcb req-3b92359b-c22e-4523-9f67-ca535862e6a2 service nova] Releasing lock "refresh_cache-75e5e67a-3e02-4bc4-8e28-04125d32c6e9" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:53:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:58 user nova-compute[74247]: DEBUG nova.compute.manager [req-f73356bc-0b67-4aae-8e42-2d6a6b62b1b8 req-df923a37-3924-4ae6-8044-e01f48b45e67 service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Received event network-vif-plugged-77ca2d19-f745-461d-9f32-8d42469a6bfc {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:53:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f73356bc-0b67-4aae-8e42-2d6a6b62b1b8 req-df923a37-3924-4ae6-8044-e01f48b45e67 service nova] Acquiring lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:53:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f73356bc-0b67-4aae-8e42-2d6a6b62b1b8 req-df923a37-3924-4ae6-8044-e01f48b45e67 service nova] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:53:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f73356bc-0b67-4aae-8e42-2d6a6b62b1b8 req-df923a37-3924-4ae6-8044-e01f48b45e67 service nova] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:53:58 user nova-compute[74247]: DEBUG nova.compute.manager [req-f73356bc-0b67-4aae-8e42-2d6a6b62b1b8 req-df923a37-3924-4ae6-8044-e01f48b45e67 service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] No waiting events found dispatching network-vif-plugged-77ca2d19-f745-461d-9f32-8d42469a6bfc {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:53:58 user nova-compute[74247]: WARNING nova.compute.manager [req-f73356bc-0b67-4aae-8e42-2d6a6b62b1b8 req-df923a37-3924-4ae6-8044-e01f48b45e67 service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Received unexpected event network-vif-plugged-77ca2d19-f745-461d-9f32-8d42469a6bfc for instance with vm_state stopped and task_state powering-on.
Oct 16 18:53:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:53:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:54:00 user nova-compute[74247]: DEBUG nova.compute.manager [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:54:00 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Instance rebooted successfully.
Oct 16 18:54:00 user nova-compute[74247]: DEBUG nova.compute.manager [None req-c86f76eb-028a-4661-8e23-b584f372ac75 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:54:00 user nova-compute[74247]: DEBUG nova.compute.manager [req-840afefe-a2e4-4326-a2bf-5de2de4e4075 req-d09321ed-4d97-48e0-8500-f8bafc835486 service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Received event network-vif-plugged-77ca2d19-f745-461d-9f32-8d42469a6bfc {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:54:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-840afefe-a2e4-4326-a2bf-5de2de4e4075 req-d09321ed-4d97-48e0-8500-f8bafc835486 service nova] Acquiring lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:54:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-840afefe-a2e4-4326-a2bf-5de2de4e4075 req-d09321ed-4d97-48e0-8500-f8bafc835486 service nova] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:54:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-840afefe-a2e4-4326-a2bf-5de2de4e4075 req-d09321ed-4d97-48e0-8500-f8bafc835486 service nova] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:54:00 user nova-compute[74247]: DEBUG nova.compute.manager [req-840afefe-a2e4-4326-a2bf-5de2de4e4075 req-d09321ed-4d97-48e0-8500-f8bafc835486 service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] No waiting events found dispatching network-vif-plugged-77ca2d19-f745-461d-9f32-8d42469a6bfc {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:54:00 user nova-compute[74247]: WARNING nova.compute.manager [req-840afefe-a2e4-4326-a2bf-5de2de4e4075 req-d09321ed-4d97-48e0-8500-f8bafc835486 service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Received unexpected event network-vif-plugged-77ca2d19-f745-461d-9f32-8d42469a6bfc for instance with vm_state stopped and task_state powering-on.
Oct 16 18:54:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:54:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:54:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:54:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:54:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:54:11 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:54:11 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:54:11 user nova-compute[74247]: DEBUG nova.compute.manager [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 18:54:11 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:54:11 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:54:11 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:54:11 user nova-compute[74247]: INFO nova.compute.claims [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Claim successful on node user
Oct 16 18:54:11 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:54:11 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:54:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:54:11 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.289s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:54:11 user nova-compute[74247]: DEBUG nova.compute.manager [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 18:54:11 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 18:54:11 user nova-compute[74247]: DEBUG nova.compute.manager [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 18:54:11 user nova-compute[74247]: DEBUG nova.network.neutron [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 18:54:11 user nova-compute[74247]: DEBUG nova.compute.manager [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 18:54:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:54:11 user nova-compute[74247]: INFO nova.virt.block_device [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Booting with volume snapshot 9c02f947-04eb-4414-8662-2c84254c4536 at /dev/vda
Oct 16 18:54:12 user nova-compute[74247]: DEBUG nova.policy [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9608bf58b70248439dbbcc9db38fba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6144ea4e14c28b085e271175bbf67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 18:54:12 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:54:13 user nova-compute[74247]: DEBUG nova.network.neutron [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Successfully created port: 05534003-00a8-4e28-9524-aed9e43ecd30 {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:54:13 user nova-compute[74247]: DEBUG nova.network.neutron [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Successfully updated port: 05534003-00a8-4e28-9524-aed9e43ecd30 {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:54:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "refresh_cache-8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:54:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquired lock "refresh_cache-8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:54:13 user nova-compute[74247]: DEBUG nova.network.neutron [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:54:13 user nova-compute[74247]: DEBUG nova.compute.manager [req-af136e4b-a0ad-4a1d-b844-40f5286df703 req-535f743a-2bfb-4440-8bfa-00313346fe05 service nova] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Received event network-changed-05534003-00a8-4e28-9524-aed9e43ecd30 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:54:13 user nova-compute[74247]: DEBUG nova.compute.manager [req-af136e4b-a0ad-4a1d-b844-40f5286df703 req-535f743a-2bfb-4440-8bfa-00313346fe05 service nova] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Refreshing instance network info cache due to event network-changed-05534003-00a8-4e28-9524-aed9e43ecd30. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:54:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-af136e4b-a0ad-4a1d-b844-40f5286df703 req-535f743a-2bfb-4440-8bfa-00313346fe05 service nova] Acquiring lock "refresh_cache-8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:54:13 user nova-compute[74247]: DEBUG nova.network.neutron [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:54:14 user nova-compute[74247]: DEBUG nova.network.neutron [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Updating instance_info_cache with network_info: [{"id": "05534003-00a8-4e28-9524-aed9e43ecd30", "address": "fa:16:3e:ce:95:bf", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05534003-00", "ovs_interfaceid": "05534003-00a8-4e28-9524-aed9e43ecd30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:54:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Releasing lock "refresh_cache-8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:54:14 user nova-compute[74247]: DEBUG nova.compute.manager [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Instance network_info: |[{"id": "05534003-00a8-4e28-9524-aed9e43ecd30", "address": "fa:16:3e:ce:95:bf", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05534003-00", "ovs_interfaceid": "05534003-00a8-4e28-9524-aed9e43ecd30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 18:54:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-af136e4b-a0ad-4a1d-b844-40f5286df703 req-535f743a-2bfb-4440-8bfa-00313346fe05 service nova] Acquired lock "refresh_cache-8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:54:14 user nova-compute[74247]: DEBUG nova.network.neutron [req-af136e4b-a0ad-4a1d-b844-40f5286df703 req-535f743a-2bfb-4440-8bfa-00313346fe05 service nova] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Refreshing network info cache for port 05534003-00a8-4e28-9524-aed9e43ecd30 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:54:14 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:54:14 user nova-compute[74247]: DEBUG nova.network.neutron [req-af136e4b-a0ad-4a1d-b844-40f5286df703 req-535f743a-2bfb-4440-8bfa-00313346fe05 service nova] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Updated VIF entry in instance network info cache for port 05534003-00a8-4e28-9524-aed9e43ecd30. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:54:14 user nova-compute[74247]: DEBUG nova.network.neutron [req-af136e4b-a0ad-4a1d-b844-40f5286df703 req-535f743a-2bfb-4440-8bfa-00313346fe05 service nova] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Updating instance_info_cache with network_info: [{"id": "05534003-00a8-4e28-9524-aed9e43ecd30", "address": "fa:16:3e:ce:95:bf", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05534003-00", "ovs_interfaceid": "05534003-00a8-4e28-9524-aed9e43ecd30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:54:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-af136e4b-a0ad-4a1d-b844-40f5286df703 req-535f743a-2bfb-4440-8bfa-00313346fe05 service nova] Releasing lock "refresh_cache-8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:54:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:54:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:54:17 user nova-compute[74247]: DEBUG os_brick.utils [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:54:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:54:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:54:17 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef07c25f-4b2d-496b-b681-6678d64d8ad1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:54:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:54:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:54:17 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[65800787-903f-4cb5-a040-5e728dd789a7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:54:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:54:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:54:17 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[52768b36-6319-44d4-b191-e1472504959e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:54:17 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e48628-bba3-4cab-9141-525301360308]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:54:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:54:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:54:17 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 18:54:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:54:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:54:17 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 18:54:17 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f699201e-1b9b-4a79-8e2d-8df4d41a9133]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:54:17 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 18:54:17 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 18:54:17 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 18:54:17 user nova-compute[74247]: DEBUG os_brick.utils [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:54:17 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Updating existing volume attachment record: 6a1cb304-1ee5-41d0-a5ad-1191a46a6a2e {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 18:54:18 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:54:18 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:54:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:54:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:54:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:54:18 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 18:54:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:54:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:54:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:54:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:54:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caeb76f2-c378-4ca9-ac9d-b21bbda08343/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:54:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caeb76f2-c378-4ca9-ac9d-b21bbda08343/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:54:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caeb76f2-c378-4ca9-ac9d-b21bbda08343/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:54:19 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caeb76f2-c378-4ca9-ac9d-b21bbda08343/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:54:19 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:54:19 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:54:19 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:54:19 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=8495MB free_disk=25.00147247314453GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 18:54:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:54:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:54:19 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance fa1dea31-91bc-4fda-8fb2-638628b66b3f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:54:19 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 75e5e67a-3e02-4bc4-8e28-04125d32c6e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:54:19 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance caeb76f2-c378-4ca9-ac9d-b21bbda08343 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:54:19 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:54:19 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 18:54:19 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 18:54:20 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:54:20 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:54:20 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 18:54:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.295s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:54:21 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:54:21 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 18:54:21 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Rebuilding the list of instances to heal {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 18:54:21 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Skipping network cache update for instance because it is Building. {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 16 18:54:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "refresh_cache-fa1dea31-91bc-4fda-8fb2-638628b66b3f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:54:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquired lock "refresh_cache-fa1dea31-91bc-4fda-8fb2-638628b66b3f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:54:21 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Forcefully refreshing network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 18:54:21 user nova-compute[74247]: DEBUG nova.objects.instance [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lazy-loading 'info_cache' on Instance uuid fa1dea31-91bc-4fda-8fb2-638628b66b3f {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:54:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:54:21 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Updating instance_info_cache with network_info: [{"id": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "address": "fa:16:3e:ea:29:cf", "network": {"id": "14ee32da-d0e3-499f-bd47-721e882b2a57", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-700103883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6d2ba688434391b03a9f3320a360de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77ca2d19-f7", "ovs_interfaceid": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:54:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Releasing lock "refresh_cache-fa1dea31-91bc-4fda-8fb2-638628b66b3f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:54:21 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Updated the network info_cache for instance {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 18:54:21 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:54:21 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:54:21 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:54:21 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 18:54:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:54:24 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:54:26 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:54:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:54:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:54:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:54:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:54:32 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Acquiring lock "ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:54:32 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Lock "ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:54:32 user nova-compute[74247]: DEBUG nova.compute.manager [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 18:54:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:54:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:54:33 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:54:33 user nova-compute[74247]: INFO nova.compute.claims [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Claim successful on node user
Oct 16 18:54:33 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:54:33 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:54:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.448s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:54:33 user nova-compute[74247]: DEBUG nova.compute.manager [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 18:54:33 user nova-compute[74247]: DEBUG nova.compute.manager [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 18:54:33 user nova-compute[74247]: DEBUG nova.network.neutron [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 18:54:33 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 18:54:33 user nova-compute[74247]: DEBUG nova.compute.manager [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 18:54:33 user nova-compute[74247]: DEBUG nova.policy [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c3510de5a2cc43f38f7380d53eeab430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e978b6d707c46188f74f2ddbf6deb62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 18:54:33 user nova-compute[74247]: DEBUG nova.compute.manager [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 18:54:33 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:54:33 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Creating image(s)
Oct 16 18:54:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Acquiring lock "/opt/stack/data/nova/instances/ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:54:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Lock "/opt/stack/data/nova/instances/ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:54:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Lock "/opt/stack/data/nova/instances/ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:54:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:54:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.201s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:54:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Acquiring lock "37399febbd18f60b85fd0f833558f6a3539ab231" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:54:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:54:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.177s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6/disk 1073741824 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6/disk 1073741824" returned: 0 in 0.055s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG nova.network.neutron [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Successfully created port: ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1 {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG nova.compute.manager [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:54:34 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Creating image(s)
Oct 16 18:54:34 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Did not create local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Ensure instance console log exists: /opt/stack/data/nova/instances/8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Start _get_guest_xml network_info=[{"id": "05534003-00a8-4e28-9524-aed9e43ecd30", "address": "fa:16:3e:ce:95:bf", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05534003-00", "ovs_interfaceid": "05534003-00a8-4e28-9524-aed9e43ecd30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-16T18:53:59Z,direct_url=<?>,disk_format='qcow2',id=c43661ac-4281-4b10-a15a-b16b5a809a6a,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1758713054',owner='dca6144ea4e14c28b085e271175bbf67',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-16T18:54:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ctmUxvYS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa', 'attached_at': '', 'detached_at': '', 'volume_id': '8f03f477-d31e-4b8c-944b-297e5f555d0b', 'serial': '8f03f477-d31e-4b8c-944b-297e5f555d0b'}, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '6a1cb304-1ee5-41d0-a5ad-1191a46a6a2e', 'guest_format': None, 'volume_type': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:54:34 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:54:34 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:54:34 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-16T18:53:59Z,direct_url=<?>,disk_format='qcow2',id=c43661ac-4281-4b10-a15a-b16b5a809a6a,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1758713054',owner='dca6144ea4e14c28b085e271175bbf67',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-16T18:54:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ctmUxvYS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:54:34 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:54:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:54:34 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:54:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:54:34 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b9c4db-15c3-47bc-ba23-59b8285f2c4d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 18:54:34 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b3a0ad-5a42-4251-82a7-f582f52572c8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b] added
Oct 16 18:54:34 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.177s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6/disk. size=1073741824 {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ffa2a5-0316-42ca-8e4e-a868dbd26b66]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06a70a0-6f74-40d1-8bc2-3ed064ff45b6]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ctmUxvYS {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ctmUxvYS" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[737d4ca2-3b46-411b-9181-8e0d1c78f466]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ctmUxvYS'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7dab92-5069-4504-b89a-0e6f30c41ee4]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[545f18f1-d33f-410e-b250-4ed16fede298]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc (non-flash)
Oct 16 18:54:34 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc (non-flash)
Oct 16 18:54:34 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f5034f-cffe-4f0b-9a02-29c5a4db853c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b, portal: 172.16.0.220,3260]
Oct 16 18:54:34 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b, portal: 172.16.0.220,3260] successful.
Oct 16 18:54:34 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Cannot resize image /opt/stack/data/nova/instances/ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6/disk to a smaller size. {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Ensure instance console log exists: /opt/stack/data/nova/instances/ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea094d98-d1ee-4ffd-93b0-73e0fe940671]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc07c8e-0eef-4edc-8be4-d6fc95cd65d8]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc (non-flash)
Oct 16 18:54:34 user nova-compute[74247]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b (non-flash)
Oct 16 18:54:34 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc (non-flash)
Oct 16 18:54:34 user nova-compute[74247]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b (non-flash)
Oct 16 18:54:34 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[352c2dc0-68e0-48de-b8ee-f541319d7f6b]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: None {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG nova.network.neutron [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Successfully updated port: ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1 {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Acquiring lock "refresh_cache-ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Acquired lock "refresh_cache-ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG nova.network.neutron [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG nova.compute.manager [req-4bf46ac2-fddd-46d2-9438-1558c621fd48 req-48cf3475-593a-4dc1-a59b-91995e75a591 service nova] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Received event network-changed-ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG nova.compute.manager [req-4bf46ac2-fddd-46d2-9438-1558c621fd48 req-48cf3475-593a-4dc1-a59b-91995e75a591 service nova] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Refreshing instance network info cache due to event network-changed-ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4bf46ac2-fddd-46d2-9438-1558c621fd48 req-48cf3475-593a-4dc1-a59b-91995e75a591 service nova] Acquiring lock "refresh_cache-ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:54:34 user nova-compute[74247]: DEBUG nova.network.neutron [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG nova.network.neutron [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Updating instance_info_cache with network_info: [{"id": "ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1", "address": "fa:16:3e:be:67:7a", "network": {"id": "dccde3f4-f49e-49b6-905e-3aaf51b415b2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-19864196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e978b6d707c46188f74f2ddbf6deb62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecdaa2b2-4a", "ovs_interfaceid": "ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Releasing lock "refresh_cache-ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG nova.compute.manager [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Instance network_info: |[{"id": "ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1", "address": "fa:16:3e:be:67:7a", "network": {"id": "dccde3f4-f49e-49b6-905e-3aaf51b415b2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-19864196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e978b6d707c46188f74f2ddbf6deb62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecdaa2b2-4a", "ovs_interfaceid": "ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4bf46ac2-fddd-46d2-9438-1558c621fd48 req-48cf3475-593a-4dc1-a59b-91995e75a591 service nova] Acquired lock "refresh_cache-ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG nova.network.neutron [req-4bf46ac2-fddd-46d2-9438-1558c621fd48 req-48cf3475-593a-4dc1-a59b-91995e75a591 service nova] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Refreshing network info cache for port ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Start _get_guest_xml network_info=[{"id": "ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1", "address": "fa:16:3e:be:67:7a", "network": {"id": "dccde3f4-f49e-49b6-905e-3aaf51b415b2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-19864196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e978b6d707c46188f74f2ddbf6deb62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecdaa2b2-4a", "ovs_interfaceid": "ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': '83126bb1-29f5-42fe-8620-72ab0797f776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:54:35 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:54:35 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:54:35 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:54:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1764612672',display_name='tempest-VolumesActionsTest-instance-1764612672',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1764612672',id=42,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e978b6d707c46188f74f2ddbf6deb62',ramdisk_id='',reservation_id='r-9w8mfu4k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-524114660',owner_user_name='tempest-VolumesActionsTest-524114660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:54:34Z,user_data=None,user_id='c3510de5a2cc43f38f7380d53eeab430',uuid=ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1", "address": "fa:16:3e:be:67:7a", "network": {"id": "dccde3f4-f49e-49b6-905e-3aaf51b415b2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-19864196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e978b6d707c46188f74f2ddbf6deb62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecdaa2b2-4a", "ovs_interfaceid": "ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Converting VIF {"id": "ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1", "address": "fa:16:3e:be:67:7a", "network": {"id": "dccde3f4-f49e-49b6-905e-3aaf51b415b2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-19864196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e978b6d707c46188f74f2ddbf6deb62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecdaa2b2-4a", "ovs_interfaceid": "ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:67:7a,bridge_name='br-int',has_traffic_filtering=True,id=ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1,network=Network(dccde3f4-f49e-49b6-905e-3aaf51b415b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecdaa2b2-4a') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG nova.objects.instance [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Lazy-loading 'pci_devices' on Instance uuid ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:54:35 user nova-compute[74247]:   <uuid>ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6</uuid>
Oct 16 18:54:35 user nova-compute[74247]:   <name>instance-0000002a</name>
Oct 16 18:54:35 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:54:35 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:54:35 user nova-compute[74247]:   <metadata>
Oct 16 18:54:35 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:54:35 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:54:35 user nova-compute[74247]:       <nova:name>tempest-VolumesActionsTest-instance-1764612672</nova:name>
Oct 16 18:54:35 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:54:35</nova:creationTime>
Oct 16 18:54:35 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:54:35 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:54:35 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:54:35 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:54:35 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:54:35 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:54:35 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:54:35 user nova-compute[74247]:       <nova:owner>
Oct 16 18:54:35 user nova-compute[74247]:         <nova:user uuid="c3510de5a2cc43f38f7380d53eeab430">tempest-VolumesActionsTest-524114660-project-member</nova:user>
Oct 16 18:54:35 user nova-compute[74247]:         <nova:project uuid="9e978b6d707c46188f74f2ddbf6deb62">tempest-VolumesActionsTest-524114660</nova:project>
Oct 16 18:54:35 user nova-compute[74247]:       </nova:owner>
Oct 16 18:54:35 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:54:35 user nova-compute[74247]:       <nova:ports>
Oct 16 18:54:35 user nova-compute[74247]:         <nova:port uuid="ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1">
Oct 16 18:54:35 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 16 18:54:35 user nova-compute[74247]:         </nova:port>
Oct 16 18:54:35 user nova-compute[74247]:       </nova:ports>
Oct 16 18:54:35 user nova-compute[74247]:     </nova:instance>
Oct 16 18:54:35 user nova-compute[74247]:   </metadata>
Oct 16 18:54:35 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:54:35 user nova-compute[74247]:     <system>
Oct 16 18:54:35 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:54:35 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:54:35 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:54:35 user nova-compute[74247]:       <entry name="serial">ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6</entry>
Oct 16 18:54:35 user nova-compute[74247]:       <entry name="uuid">ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6</entry>
Oct 16 18:54:35 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:54:35 user nova-compute[74247]:     </system>
Oct 16 18:54:35 user nova-compute[74247]:   </sysinfo>
Oct 16 18:54:35 user nova-compute[74247]:   <os>
Oct 16 18:54:35 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:54:35 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:54:35 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:54:35 user nova-compute[74247]:   </os>
Oct 16 18:54:35 user nova-compute[74247]:   <features>
Oct 16 18:54:35 user nova-compute[74247]:     <acpi/>
Oct 16 18:54:35 user nova-compute[74247]:     <apic/>
Oct 16 18:54:35 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:54:35 user nova-compute[74247]:   </features>
Oct 16 18:54:35 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:54:35 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:54:35 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:54:35 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:54:35 user nova-compute[74247]:   </clock>
Oct 16 18:54:35 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:54:35 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:54:35 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:54:35 user nova-compute[74247]:   </cpu>
Oct 16 18:54:35 user nova-compute[74247]:   <devices>
Oct 16 18:54:35 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:54:35 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:54:35 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6/disk"/>
Oct 16 18:54:35 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:54:35 user nova-compute[74247]:     </disk>
Oct 16 18:54:35 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:54:35 user nova-compute[74247]:       <mac address="fa:16:3e:be:67:7a"/>
Oct 16 18:54:35 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:54:35 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:54:35 user nova-compute[74247]:       <target dev="tapecdaa2b2-4a"/>
Oct 16 18:54:35 user nova-compute[74247]:     </interface>
Oct 16 18:54:35 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:54:35 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6/console.log" append="off"/>
Oct 16 18:54:35 user nova-compute[74247]:     </serial>
Oct 16 18:54:35 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:54:35 user nova-compute[74247]:     <video>
Oct 16 18:54:35 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:54:35 user nova-compute[74247]:     </video>
Oct 16 18:54:35 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:54:35 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:54:35 user nova-compute[74247]:     </rng>
Oct 16 18:54:35 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:54:35 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:54:35 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:54:35 user nova-compute[74247]:     </memballoon>
Oct 16 18:54:35 user nova-compute[74247]:   </devices>
Oct 16 18:54:35 user nova-compute[74247]: </domain>
Oct 16 18:54:35 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:54:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1764612672',display_name='tempest-VolumesActionsTest-instance-1764612672',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1764612672',id=42,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e978b6d707c46188f74f2ddbf6deb62',ramdisk_id='',reservation_id='r-9w8mfu4k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-524114660',owner_user_name='tempest-VolumesActionsTest-524114660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:54:34Z,user_data=None,user_id='c3510de5a2cc43f38f7380d53eeab430',uuid=ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1", "address": "fa:16:3e:be:67:7a", "network": {"id": "dccde3f4-f49e-49b6-905e-3aaf51b415b2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-19864196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e978b6d707c46188f74f2ddbf6deb62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecdaa2b2-4a", "ovs_interfaceid": "ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Converting VIF {"id": "ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1", "address": "fa:16:3e:be:67:7a", "network": {"id": "dccde3f4-f49e-49b6-905e-3aaf51b415b2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-19864196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e978b6d707c46188f74f2ddbf6deb62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecdaa2b2-4a", "ovs_interfaceid": "ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:67:7a,bridge_name='br-int',has_traffic_filtering=True,id=ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1,network=Network(dccde3f4-f49e-49b6-905e-3aaf51b415b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecdaa2b2-4a') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG os_vif [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:67:7a,bridge_name='br-int',has_traffic_filtering=True,id=ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1,network=Network(dccde3f4-f49e-49b6-905e-3aaf51b415b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecdaa2b2-4a') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '81a03ac5-86d5-5fe5-ace8-908134db9ed5', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapecdaa2b2-4a, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapecdaa2b2-4a, col_values=(('qos', UUID('f72a3211-3fae-4f8d-ae11-12304ede5908')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapecdaa2b2-4a, col_values=(('external_ids', {'iface-id': 'ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:67:7a', 'vm-uuid': 'ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:54:35 user nova-compute[74247]: INFO os_vif [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:67:7a,bridge_name='br-int',has_traffic_filtering=True,id=ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1,network=Network(dccde3f4-f49e-49b6-905e-3aaf51b415b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecdaa2b2-4a')
Oct 16 18:54:35 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] No VIF found with MAC fa:16:3e:be:67:7a, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG nova.network.neutron [req-4bf46ac2-fddd-46d2-9438-1558c621fd48 req-48cf3475-593a-4dc1-a59b-91995e75a591 service nova] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Updated VIF entry in instance network info cache for port ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG nova.network.neutron [req-4bf46ac2-fddd-46d2-9438-1558c621fd48 req-48cf3475-593a-4dc1-a59b-91995e75a591 service nova] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Updating instance_info_cache with network_info: [{"id": "ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1", "address": "fa:16:3e:be:67:7a", "network": {"id": "dccde3f4-f49e-49b6-905e-3aaf51b415b2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-19864196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e978b6d707c46188f74f2ddbf6deb62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecdaa2b2-4a", "ovs_interfaceid": "ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4bf46ac2-fddd-46d2-9438-1558c621fd48 req-48cf3475-593a-4dc1-a59b-91995e75a591 service nova] Releasing lock "refresh_cache-ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ctmUxvYS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23731636334373931', 'path': '/dev/sdc'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731636334373931', 'path': '/dev/sdc'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:54:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-604696685',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-604696685',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-604696685',id=41,image_ref='c43661ac-4281-4b10-a15a-b16b5a809a6a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdCV5BAec86OjzjY1vcmPXw9MPS/hqShcGJdoyf8tWwr928BL29mRQFvRxmb5ep2ejAa0iAcJX+915RUQAZ0dujVR9/Q55TsH4qvkAbXi8oLzlBup5WrSQyTqHLvCkABg==',key_name='tempest-keypair-1855829965',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dca6144ea4e14c28b085e271175bbf67',ramdisk_id='',reservation_id='r-ytte0bal',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1733357121',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1733357121-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1733357121',owner_user_name='tempest-TestVolumeBootPattern-1733357121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:54:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9608bf58b70248439dbbcc9db38fba08',uuid=8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05534003-00a8-4e28-9524-aed9e43ecd30", "address": "fa:16:3e:ce:95:bf", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05534003-00", "ovs_interfaceid": "05534003-00a8-4e28-9524-aed9e43ecd30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Converting VIF {"id": "05534003-00a8-4e28-9524-aed9e43ecd30", "address": "fa:16:3e:ce:95:bf", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05534003-00", "ovs_interfaceid": "05534003-00a8-4e28-9524-aed9e43ecd30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:95:bf,bridge_name='br-int',has_traffic_filtering=True,id=05534003-00a8-4e28-9524-aed9e43ecd30,network=Network(9688c665-d4b7-4179-9a76-fdf6c3013b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05534003-00') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG nova.objects.instance [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lazy-loading 'pci_devices' on Instance uuid 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:54:35 user nova-compute[74247]:   <uuid>8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa</uuid>
Oct 16 18:54:35 user nova-compute[74247]:   <name>instance-00000029</name>
Oct 16 18:54:35 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:54:35 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:54:35 user nova-compute[74247]:   <metadata>
Oct 16 18:54:35 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:54:35 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:54:35 user nova-compute[74247]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-604696685</nova:name>
Oct 16 18:54:35 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:54:34</nova:creationTime>
Oct 16 18:54:35 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:54:35 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:54:35 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:54:35 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:54:35 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:54:35 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:54:35 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:54:35 user nova-compute[74247]:       <nova:owner>
Oct 16 18:54:35 user nova-compute[74247]:         <nova:user uuid="9608bf58b70248439dbbcc9db38fba08">tempest-TestVolumeBootPattern-1733357121-project-member</nova:user>
Oct 16 18:54:35 user nova-compute[74247]:         <nova:project uuid="dca6144ea4e14c28b085e271175bbf67">tempest-TestVolumeBootPattern-1733357121</nova:project>
Oct 16 18:54:35 user nova-compute[74247]:       </nova:owner>
Oct 16 18:54:35 user nova-compute[74247]:       <nova:root type="image" uuid="c43661ac-4281-4b10-a15a-b16b5a809a6a"/>
Oct 16 18:54:35 user nova-compute[74247]:       <nova:ports>
Oct 16 18:54:35 user nova-compute[74247]:         <nova:port uuid="05534003-00a8-4e28-9524-aed9e43ecd30">
Oct 16 18:54:35 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 16 18:54:35 user nova-compute[74247]:         </nova:port>
Oct 16 18:54:35 user nova-compute[74247]:       </nova:ports>
Oct 16 18:54:35 user nova-compute[74247]:     </nova:instance>
Oct 16 18:54:35 user nova-compute[74247]:   </metadata>
Oct 16 18:54:35 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:54:35 user nova-compute[74247]:     <system>
Oct 16 18:54:35 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:54:35 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:54:35 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:54:35 user nova-compute[74247]:       <entry name="serial">8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa</entry>
Oct 16 18:54:35 user nova-compute[74247]:       <entry name="uuid">8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa</entry>
Oct 16 18:54:35 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:54:35 user nova-compute[74247]:     </system>
Oct 16 18:54:35 user nova-compute[74247]:   </sysinfo>
Oct 16 18:54:35 user nova-compute[74247]:   <os>
Oct 16 18:54:35 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:54:35 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:54:35 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:54:35 user nova-compute[74247]:   </os>
Oct 16 18:54:35 user nova-compute[74247]:   <features>
Oct 16 18:54:35 user nova-compute[74247]:     <acpi/>
Oct 16 18:54:35 user nova-compute[74247]:     <apic/>
Oct 16 18:54:35 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:54:35 user nova-compute[74247]:   </features>
Oct 16 18:54:35 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:54:35 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:54:35 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:54:35 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:54:35 user nova-compute[74247]:   </clock>
Oct 16 18:54:35 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:54:35 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:54:35 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:54:35 user nova-compute[74247]:   </cpu>
Oct 16 18:54:35 user nova-compute[74247]:   <devices>
Oct 16 18:54:35 user nova-compute[74247]:     <disk type="block" device="disk">
Oct 16 18:54:35 user nova-compute[74247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:54:35 user nova-compute[74247]:       <source dev="/dev/sdc"/>
Oct 16 18:54:35 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:54:35 user nova-compute[74247]:       <serial>8f03f477-d31e-4b8c-944b-297e5f555d0b</serial>
Oct 16 18:54:35 user nova-compute[74247]:     </disk>
Oct 16 18:54:35 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:54:35 user nova-compute[74247]:       <mac address="fa:16:3e:ce:95:bf"/>
Oct 16 18:54:35 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:54:35 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:54:35 user nova-compute[74247]:       <target dev="tap05534003-00"/>
Oct 16 18:54:35 user nova-compute[74247]:     </interface>
Oct 16 18:54:35 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:54:35 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa/console.log" append="off"/>
Oct 16 18:54:35 user nova-compute[74247]:     </serial>
Oct 16 18:54:35 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:54:35 user nova-compute[74247]:     <video>
Oct 16 18:54:35 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:54:35 user nova-compute[74247]:     </video>
Oct 16 18:54:35 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:54:35 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:54:35 user nova-compute[74247]:     </rng>
Oct 16 18:54:35 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:54:35 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:54:35 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:54:35 user nova-compute[74247]:     </memballoon>
Oct 16 18:54:35 user nova-compute[74247]:   </devices>
Oct 16 18:54:35 user nova-compute[74247]: </domain>
Oct 16 18:54:35 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:54:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-604696685',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-604696685',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-604696685',id=41,image_ref='c43661ac-4281-4b10-a15a-b16b5a809a6a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdCV5BAec86OjzjY1vcmPXw9MPS/hqShcGJdoyf8tWwr928BL29mRQFvRxmb5ep2ejAa0iAcJX+915RUQAZ0dujVR9/Q55TsH4qvkAbXi8oLzlBup5WrSQyTqHLvCkABg==',key_name='tempest-keypair-1855829965',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dca6144ea4e14c28b085e271175bbf67',ramdisk_id='',reservation_id='r-ytte0bal',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1733357121',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1733357121-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1733357121',owner_user_name='tempest-TestVolumeBootPattern-1733357121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:54:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9608bf58b70248439dbbcc9db38fba08',uuid=8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05534003-00a8-4e28-9524-aed9e43ecd30", "address": "fa:16:3e:ce:95:bf", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05534003-00", "ovs_interfaceid": "05534003-00a8-4e28-9524-aed9e43ecd30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Converting VIF {"id": "05534003-00a8-4e28-9524-aed9e43ecd30", "address": "fa:16:3e:ce:95:bf", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05534003-00", "ovs_interfaceid": "05534003-00a8-4e28-9524-aed9e43ecd30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:95:bf,bridge_name='br-int',has_traffic_filtering=True,id=05534003-00a8-4e28-9524-aed9e43ecd30,network=Network(9688c665-d4b7-4179-9a76-fdf6c3013b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05534003-00') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG os_vif [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:95:bf,bridge_name='br-int',has_traffic_filtering=True,id=05534003-00a8-4e28-9524-aed9e43ecd30,network=Network(9688c665-d4b7-4179-9a76-fdf6c3013b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05534003-00') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4412e703-17c0-54a0-bcec-926bdb47f05e', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap05534003-00, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap05534003-00, col_values=(('qos', UUID('4f33c5fb-e2b1-4a89-8923-9dfb833c8b84')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap05534003-00, col_values=(('external_ids', {'iface-id': '05534003-00a8-4e28-9524-aed9e43ecd30', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:95:bf', 'vm-uuid': '8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:54:35 user nova-compute[74247]: INFO os_vif [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:95:bf,bridge_name='br-int',has_traffic_filtering=True,id=05534003-00a8-4e28-9524-aed9e43ecd30,network=Network(9688c665-d4b7-4179-9a76-fdf6c3013b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05534003-00')
Oct 16 18:54:35 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:54:35 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] No VIF found with MAC fa:16:3e:ce:95:bf, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:54:37 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:54:37 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:54:37 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:54:37 user nova-compute[74247]: DEBUG nova.compute.manager [req-68b3a1b7-82e4-4e3b-845d-d59d4ec68edf req-7f30c2c2-4374-4e87-b80f-53dbbc591aa1 service nova] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Received event network-vif-plugged-ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:54:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-68b3a1b7-82e4-4e3b-845d-d59d4ec68edf req-7f30c2c2-4374-4e87-b80f-53dbbc591aa1 service nova] Acquiring lock "ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:54:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-68b3a1b7-82e4-4e3b-845d-d59d4ec68edf req-7f30c2c2-4374-4e87-b80f-53dbbc591aa1 service nova] Lock "ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:54:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-68b3a1b7-82e4-4e3b-845d-d59d4ec68edf req-7f30c2c2-4374-4e87-b80f-53dbbc591aa1 service nova] Lock "ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:54:37 user nova-compute[74247]: DEBUG nova.compute.manager [req-68b3a1b7-82e4-4e3b-845d-d59d4ec68edf req-7f30c2c2-4374-4e87-b80f-53dbbc591aa1 service nova] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] No waiting events found dispatching network-vif-plugged-ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:54:37 user nova-compute[74247]: WARNING nova.compute.manager [req-68b3a1b7-82e4-4e3b-845d-d59d4ec68edf req-7f30c2c2-4374-4e87-b80f-53dbbc591aa1 service nova] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Received unexpected event network-vif-plugged-ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1 for instance with vm_state building and task_state spawning.
Oct 16 18:54:37 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:54:37 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:54:37 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:54:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:54:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:54:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:54:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:54:39 user nova-compute[74247]: DEBUG nova.compute.manager [req-3ec852d2-7956-4913-8199-5f602fc81a4e req-1cc2886b-d32c-40a6-b6a2-11aae0f66afb service nova] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Received event network-vif-plugged-ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:54:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3ec852d2-7956-4913-8199-5f602fc81a4e req-1cc2886b-d32c-40a6-b6a2-11aae0f66afb service nova] Acquiring lock "ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:54:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3ec852d2-7956-4913-8199-5f602fc81a4e req-1cc2886b-d32c-40a6-b6a2-11aae0f66afb service nova] Lock "ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:54:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3ec852d2-7956-4913-8199-5f602fc81a4e req-1cc2886b-d32c-40a6-b6a2-11aae0f66afb service nova] Lock "ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:54:39 user nova-compute[74247]: DEBUG nova.compute.manager [req-3ec852d2-7956-4913-8199-5f602fc81a4e req-1cc2886b-d32c-40a6-b6a2-11aae0f66afb service nova] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] No waiting events found dispatching network-vif-plugged-ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:54:39 user nova-compute[74247]: WARNING nova.compute.manager [req-3ec852d2-7956-4913-8199-5f602fc81a4e req-1cc2886b-d32c-40a6-b6a2-11aae0f66afb service nova] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Received unexpected event network-vif-plugged-ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1 for instance with vm_state building and task_state spawning.
Oct 16 18:54:39 user nova-compute[74247]: DEBUG nova.compute.manager [req-3ec852d2-7956-4913-8199-5f602fc81a4e req-1cc2886b-d32c-40a6-b6a2-11aae0f66afb service nova] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Received event network-vif-plugged-05534003-00a8-4e28-9524-aed9e43ecd30 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:54:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3ec852d2-7956-4913-8199-5f602fc81a4e req-1cc2886b-d32c-40a6-b6a2-11aae0f66afb service nova] Acquiring lock "8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:54:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3ec852d2-7956-4913-8199-5f602fc81a4e req-1cc2886b-d32c-40a6-b6a2-11aae0f66afb service nova] Lock "8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:54:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3ec852d2-7956-4913-8199-5f602fc81a4e req-1cc2886b-d32c-40a6-b6a2-11aae0f66afb service nova] Lock "8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:54:39 user nova-compute[74247]: DEBUG nova.compute.manager [req-3ec852d2-7956-4913-8199-5f602fc81a4e req-1cc2886b-d32c-40a6-b6a2-11aae0f66afb service nova] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] No waiting events found dispatching network-vif-plugged-05534003-00a8-4e28-9524-aed9e43ecd30 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:54:39 user nova-compute[74247]: WARNING nova.compute.manager [req-3ec852d2-7956-4913-8199-5f602fc81a4e req-1cc2886b-d32c-40a6-b6a2-11aae0f66afb service nova] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Received unexpected event network-vif-plugged-05534003-00a8-4e28-9524-aed9e43ecd30 for instance with vm_state building and task_state spawning.
Oct 16 18:54:39 user nova-compute[74247]: DEBUG nova.compute.manager [req-3ec852d2-7956-4913-8199-5f602fc81a4e req-1cc2886b-d32c-40a6-b6a2-11aae0f66afb service nova] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Received event network-vif-plugged-05534003-00a8-4e28-9524-aed9e43ecd30 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:54:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3ec852d2-7956-4913-8199-5f602fc81a4e req-1cc2886b-d32c-40a6-b6a2-11aae0f66afb service nova] Acquiring lock "8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:54:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3ec852d2-7956-4913-8199-5f602fc81a4e req-1cc2886b-d32c-40a6-b6a2-11aae0f66afb service nova] Lock "8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:54:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3ec852d2-7956-4913-8199-5f602fc81a4e req-1cc2886b-d32c-40a6-b6a2-11aae0f66afb service nova] Lock "8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:54:39 user nova-compute[74247]: DEBUG nova.compute.manager [req-3ec852d2-7956-4913-8199-5f602fc81a4e req-1cc2886b-d32c-40a6-b6a2-11aae0f66afb service nova] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] No waiting events found dispatching network-vif-plugged-05534003-00a8-4e28-9524-aed9e43ecd30 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:54:39 user nova-compute[74247]: WARNING nova.compute.manager [req-3ec852d2-7956-4913-8199-5f602fc81a4e req-1cc2886b-d32c-40a6-b6a2-11aae0f66afb service nova] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Received unexpected event network-vif-plugged-05534003-00a8-4e28-9524-aed9e43ecd30 for instance with vm_state building and task_state spawning.
Oct 16 18:54:40 user nova-compute[74247]: DEBUG nova.compute.manager [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:54:40 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:54:40 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Instance spawned successfully.
Oct 16 18:54:40 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 18:54:40 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:54:40 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:54:40 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:54:40 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:54:40 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:54:40 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:54:40 user nova-compute[74247]: DEBUG nova.compute.manager [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:54:40 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:54:40 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Instance spawned successfully.
Oct 16 18:54:40 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 18:54:40 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:54:40 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:54:40 user nova-compute[74247]: INFO nova.compute.manager [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Took 6.79 seconds to spawn the instance on the hypervisor.
Oct 16 18:54:40 user nova-compute[74247]: DEBUG nova.compute.manager [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:54:40 user nova-compute[74247]: INFO nova.compute.manager [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Took 6.29 seconds to spawn the instance on the hypervisor.
Oct 16 18:54:40 user nova-compute[74247]: DEBUG nova.compute.manager [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:54:40 user nova-compute[74247]: INFO nova.compute.manager [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Took 7.61 seconds to build instance.
Oct 16 18:54:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-49d624d1-963e-4e8f-bba5-54a596e9297e tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Lock "ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.872s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:54:40 user nova-compute[74247]: INFO nova.compute.manager [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Took 29.24 seconds to build instance.
Oct 16 18:54:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-778ffb5b-fd26-44ea-a223-22cfda0825be tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.344s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:54:40 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:54:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:54:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:54:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:54:54 user nova-compute[74247]: DEBUG nova.compute.manager [req-233e142a-dead-46d2-9d9c-3c63298bf1c1 req-ec8abd9b-3155-4d22-b816-c38f50662ed6 service nova] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Received event network-changed-0f13fea1-9428-4547-8f54-8ba7b9b9e07f {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:54:54 user nova-compute[74247]: DEBUG nova.compute.manager [req-233e142a-dead-46d2-9d9c-3c63298bf1c1 req-ec8abd9b-3155-4d22-b816-c38f50662ed6 service nova] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Refreshing instance network info cache due to event network-changed-0f13fea1-9428-4547-8f54-8ba7b9b9e07f. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:54:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-233e142a-dead-46d2-9d9c-3c63298bf1c1 req-ec8abd9b-3155-4d22-b816-c38f50662ed6 service nova] Acquiring lock "refresh_cache-caeb76f2-c378-4ca9-ac9d-b21bbda08343" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:54:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-233e142a-dead-46d2-9d9c-3c63298bf1c1 req-ec8abd9b-3155-4d22-b816-c38f50662ed6 service nova] Acquired lock "refresh_cache-caeb76f2-c378-4ca9-ac9d-b21bbda08343" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:54:54 user nova-compute[74247]: DEBUG nova.network.neutron [req-233e142a-dead-46d2-9d9c-3c63298bf1c1 req-ec8abd9b-3155-4d22-b816-c38f50662ed6 service nova] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Refreshing network info cache for port 0f13fea1-9428-4547-8f54-8ba7b9b9e07f {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:54:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Acquiring lock "caeb76f2-c378-4ca9-ac9d-b21bbda08343" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:54:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "caeb76f2-c378-4ca9-ac9d-b21bbda08343" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:54:54 user nova-compute[74247]: DEBUG nova.objects.instance [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lazy-loading 'flavor' on Instance uuid caeb76f2-c378-4ca9-ac9d-b21bbda08343 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:54:54 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Ignoring supplied device name: /dev/vdb
Oct 16 18:54:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "caeb76f2-c378-4ca9-ac9d-b21bbda08343" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:54:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Acquiring lock "caeb76f2-c378-4ca9-ac9d-b21bbda08343" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:54:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "caeb76f2-c378-4ca9-ac9d-b21bbda08343" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:54:54 user nova-compute[74247]: INFO nova.compute.manager [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Attaching volume 06b2e41b-6bfd-4b33-9050-2a96c2281cb6 to /dev/vdb
Oct 16 18:54:54 user nova-compute[74247]: DEBUG nova.network.neutron [req-233e142a-dead-46d2-9d9c-3c63298bf1c1 req-ec8abd9b-3155-4d22-b816-c38f50662ed6 service nova] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Updated VIF entry in instance network info cache for port 0f13fea1-9428-4547-8f54-8ba7b9b9e07f. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:54:54 user nova-compute[74247]: DEBUG nova.network.neutron [req-233e142a-dead-46d2-9d9c-3c63298bf1c1 req-ec8abd9b-3155-4d22-b816-c38f50662ed6 service nova] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Updating instance_info_cache with network_info: [{"id": "0f13fea1-9428-4547-8f54-8ba7b9b9e07f", "address": "fa:16:3e:d1:18:e8", "network": {"id": "8e0ea38d-892f-4f82-a321-93292d5bea90", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-201299230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf6596e67794e1794dc93e8e8523ae7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f13fea1-94", "ovs_interfaceid": "0f13fea1-9428-4547-8f54-8ba7b9b9e07f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:54:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-233e142a-dead-46d2-9d9c-3c63298bf1c1 req-ec8abd9b-3155-4d22-b816-c38f50662ed6 service nova] Releasing lock "refresh_cache-caeb76f2-c378-4ca9-ac9d-b21bbda08343" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:54:54 user nova-compute[74247]: DEBUG os_brick.utils [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:54:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:54:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:54:54 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[24cb5a86-27c1-4d61-bea8-8b449c69ee7b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:54:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:54:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:54:54 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc33a231-c310-4447-b168-e5fc0c1089d1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:54:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:54:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:54:54 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf58609b-c9c5-49be-8348-44dd21910aaf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:54:54 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4faac4b-69bf-4b68-ae2a-8b1af18cb6d5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:54:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:54:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:54:55 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 18:54:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:54:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:54:55 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 18:54:55 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1659a26c-6ee1-4039-a84e-0470380b9a18]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:54:55 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 18:54:55 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 18:54:55 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 18:54:55 user nova-compute[74247]: DEBUG os_brick.utils [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:54:55 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Updating existing volume attachment record: ee85ec0c-ae0b-4dcc-8fcc-ca3e57b904cf {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 18:54:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:54:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:55:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:55:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:55:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:55:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:55:10 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zfhoYDOE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:55:11 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:55:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:55:11 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:55:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:55:11 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:55:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6 -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5300edf7-6a97-4968-b04b-a7da7bca9982]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 18:55:11 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c2067a-586f-487e-a4cd-54791460dcac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6] added
Oct 16 18:55:11 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[550b901c-26e1-42f1-ab7a-196b6dd46130]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a885dcbc-e10a-4053-843a-6db675ec6e59]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zfhoYDOE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zfhoYDOE" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba86160b-8d24-41dc-93e2-767325e23d26]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zfhoYDOE'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f1570d-878a-41be-bd01-1484bd898cb6]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0736dbb9-ec36-4104-8e12-ddcfbb23a88f]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc (non-flash)
Oct 16 18:55:11 user nova-compute[74247]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b (non-flash)
Oct 16 18:55:11 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc (non-flash)
Oct 16 18:55:11 user nova-compute[74247]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b (non-flash)
Oct 16 18:55:11 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6 -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3805dc-e234-4fbc-b8df-3c0a8bbd522d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6, portal: 172.16.0.220,3260]
Oct 16 18:55:11 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6, portal: 172.16.0.220,3260] successful.
Oct 16 18:55:11 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[60563904-8e33-423e-81d5-9ca7bda95dcc]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[154a71cc-3a9b-4b4e-9d24-ce0a6dc0003c]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc (non-flash)
Oct 16 18:55:11 user nova-compute[74247]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b (non-flash)
Oct 16 18:55:11 user nova-compute[74247]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6 (non-flash)
Oct 16 18:55:11 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc (non-flash)
Oct 16 18:55:11 user nova-compute[74247]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b (non-flash)
Oct 16 18:55:11 user nova-compute[74247]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6 (non-flash)
Oct 16 18:55:11 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39b9ac8-0051-42e5-b954-f4a2593088b8]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zfhoYDOE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:55:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:55:12 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:55:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:55:12 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23036633738646661', 'path': '/dev/sdd'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:55:12 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036633738646661', 'path': '/dev/sdd'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:55:12 user nova-compute[74247]: DEBUG nova.objects.instance [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lazy-loading 'flavor' on Instance uuid caeb76f2-c378-4ca9-ac9d-b21bbda08343 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:55:12 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 18:55:12 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:55:12 user nova-compute[74247]:   <source dev="/dev/sdd"/>
Oct 16 18:55:12 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:55:12 user nova-compute[74247]:   <serial>06b2e41b-6bfd-4b33-9050-2a96c2281cb6</serial>
Oct 16 18:55:12 user nova-compute[74247]: </disk>
Oct 16 18:55:12 user nova-compute[74247]:  {{(pid=74247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 18:55:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:55:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:55:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] No VIF found with MAC fa:16:3e:d1:18:e8, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:55:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-01c0074c-8a1c-4ba2-a396-65e07fb0e518 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "caeb76f2-c378-4ca9-ac9d-b21bbda08343" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.548s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:55:15 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:55:15 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Cleaning up deleted instances with incomplete migration  {{(pid=74247) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 16 18:55:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:55:18 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:55:19 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:55:20 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:55:20 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 18:55:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "refresh_cache-75e5e67a-3e02-4bc4-8e28-04125d32c6e9" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:55:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquired lock "refresh_cache-75e5e67a-3e02-4bc4-8e28-04125d32c6e9" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:55:20 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Forcefully refreshing network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 18:55:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:55:21 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Updating instance_info_cache with network_info: [{"id": "fee1b802-a163-42e1-8262-e5553f847cb8", "address": "fa:16:3e:0f:b4:9a", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee1b802-a1", "ovs_interfaceid": "fee1b802-a163-42e1-8262-e5553f847cb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:55:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Releasing lock "refresh_cache-75e5e67a-3e02-4bc4-8e28-04125d32c6e9" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:55:21 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Updated the network info_cache for instance {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 18:55:21 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:55:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:55:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:55:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:55:21 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 18:55:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:55:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:55:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:55:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:55:21 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:55:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:55:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:55:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:55:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:55:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:55:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caeb76f2-c378-4ca9-ac9d-b21bbda08343/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:55:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caeb76f2-c378-4ca9-ac9d-b21bbda08343/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:55:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caeb76f2-c378-4ca9-ac9d-b21bbda08343/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:55:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caeb76f2-c378-4ca9-ac9d-b21bbda08343/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:55:22 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:55:22 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:55:22 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:55:22 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:55:22 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=8300MB free_disk=24.961959838867188GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 18:55:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:55:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:55:23 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance fa1dea31-91bc-4fda-8fb2-638628b66b3f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:55:23 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 75e5e67a-3e02-4bc4-8e28-04125d32c6e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:55:23 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance caeb76f2-c378-4ca9-ac9d-b21bbda08343 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:55:23 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:55:23 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:55:23 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 18:55:23 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 18:55:23 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Refreshing inventories for resource provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 16 18:55:23 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Updating ProviderTree inventory for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 16 18:55:23 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Updating inventory in ProviderTree for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 16 18:55:23 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Refreshing aggregate associations for resource provider 7b8a7b7b-c686-4162-903b-700fbc4d7273, aggregates: None {{(pid=74247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 16 18:55:23 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Refreshing trait associations for resource provider 7b8a7b7b-c686-4162-903b-700fbc4d7273, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=74247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 16 18:55:23 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:55:23 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:55:23 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 18:55:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.609s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:55:23 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:55:23 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:55:23 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:55:23 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 18:55:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:55:26 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:55:26 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Cleaning up deleted instances {{(pid=74247) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 16 18:55:26 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] There are 0 instances to clean {{(pid=74247) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 16 18:55:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:55:28 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:55:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:55:31 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:55:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:55:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:55:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 18:55:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 18:55:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 18:55:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:55:40 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:55:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:55:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ed6430eb-58a1-4637-bff2-847a026c8810 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquiring lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:55:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ed6430eb-58a1-4637-bff2-847a026c8810 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:55:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ed6430eb-58a1-4637-bff2-847a026c8810 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquiring lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:55:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ed6430eb-58a1-4637-bff2-847a026c8810 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:55:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ed6430eb-58a1-4637-bff2-847a026c8810 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:55:46 user nova-compute[74247]: INFO nova.compute.manager [None req-ed6430eb-58a1-4637-bff2-847a026c8810 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Terminating instance
Oct 16 18:55:46 user nova-compute[74247]: DEBUG nova.compute.manager [None req-ed6430eb-58a1-4637-bff2-847a026c8810 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 18:55:46 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:55:46 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:55:46 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:55:46 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:55:46 user nova-compute[74247]: DEBUG nova.compute.manager [req-3f6495b7-b0cd-466a-8a29-49523c1b83a8 req-f1ff686d-05e9-4ab7-820a-fee1a7fa4d7b service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Received event network-vif-unplugged-77ca2d19-f745-461d-9f32-8d42469a6bfc {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:55:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3f6495b7-b0cd-466a-8a29-49523c1b83a8 req-f1ff686d-05e9-4ab7-820a-fee1a7fa4d7b service nova] Acquiring lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:55:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3f6495b7-b0cd-466a-8a29-49523c1b83a8 req-f1ff686d-05e9-4ab7-820a-fee1a7fa4d7b service nova] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:55:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3f6495b7-b0cd-466a-8a29-49523c1b83a8 req-f1ff686d-05e9-4ab7-820a-fee1a7fa4d7b service nova] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:55:46 user nova-compute[74247]: DEBUG nova.compute.manager [req-3f6495b7-b0cd-466a-8a29-49523c1b83a8 req-f1ff686d-05e9-4ab7-820a-fee1a7fa4d7b service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] No waiting events found dispatching network-vif-unplugged-77ca2d19-f745-461d-9f32-8d42469a6bfc {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:55:46 user nova-compute[74247]: DEBUG nova.compute.manager [req-3f6495b7-b0cd-466a-8a29-49523c1b83a8 req-f1ff686d-05e9-4ab7-820a-fee1a7fa4d7b service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Received event network-vif-unplugged-77ca2d19-f745-461d-9f32-8d42469a6bfc for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:55:46 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:55:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:55:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:55:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:55:47 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Instance destroyed successfully.
Oct 16 18:55:47 user nova-compute[74247]: DEBUG nova.objects.instance [None req-ed6430eb-58a1-4637-bff2-847a026c8810 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lazy-loading 'resources' on Instance uuid fa1dea31-91bc-4fda-8fb2-638628b66b3f {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:55:47 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-ed6430eb-58a1-4637-bff2-847a026c8810 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-659707189',display_name='tempest-AttachVolumeTestJSON-server-659707189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-659707189',id=35,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZNyKtinECwQEZs0xtAfyopWvuS0WcUALkCCqBfwO2f0LJvjht0xSFVuqtR8GKspliYK+mf0usf7lCpwlqMVzv4m9PsNpIcERNXyS11WNd3vgzvglK2WxbIqiF5MPTBmg==',key_name='tempest-keypair-1281053187',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:45:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d6d2ba688434391b03a9f3320a360de',ramdisk_id='',reservation_id='r-lyeae496',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1409761379',owner_user_name='tempest-AttachVolumeTestJSON-1409761379-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:54:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82c71a4cbbf8436dbfdc43bb4db65ef1',uuid=fa1dea31-91bc-4fda-8fb2-638628b66b3f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "address": "fa:16:3e:ea:29:cf", "network": {"id": "14ee32da-d0e3-499f-bd47-721e882b2a57", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-700103883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6d2ba688434391b03a9f3320a360de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77ca2d19-f7", "ovs_interfaceid": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:55:47 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-ed6430eb-58a1-4637-bff2-847a026c8810 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Converting VIF {"id": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "address": "fa:16:3e:ea:29:cf", "network": {"id": "14ee32da-d0e3-499f-bd47-721e882b2a57", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-700103883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6d2ba688434391b03a9f3320a360de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77ca2d19-f7", "ovs_interfaceid": "77ca2d19-f745-461d-9f32-8d42469a6bfc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:55:47 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-ed6430eb-58a1-4637-bff2-847a026c8810 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:29:cf,bridge_name='br-int',has_traffic_filtering=True,id=77ca2d19-f745-461d-9f32-8d42469a6bfc,network=Network(14ee32da-d0e3-499f-bd47-721e882b2a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77ca2d19-f7') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:55:47 user nova-compute[74247]: DEBUG os_vif [None req-ed6430eb-58a1-4637-bff2-847a026c8810 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:29:cf,bridge_name='br-int',has_traffic_filtering=True,id=77ca2d19-f745-461d-9f32-8d42469a6bfc,network=Network(14ee32da-d0e3-499f-bd47-721e882b2a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77ca2d19-f7') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:55:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:55:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77ca2d19-f7, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:55:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:55:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:55:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:55:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5ef4577c-d0ec-44ef-974a-81b27ab0e22a) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:55:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:55:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:55:47 user nova-compute[74247]: INFO os_vif [None req-ed6430eb-58a1-4637-bff2-847a026c8810 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:29:cf,bridge_name='br-int',has_traffic_filtering=True,id=77ca2d19-f745-461d-9f32-8d42469a6bfc,network=Network(14ee32da-d0e3-499f-bd47-721e882b2a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77ca2d19-f7')
Oct 16 18:55:47 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-ed6430eb-58a1-4637-bff2-847a026c8810 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Deleting instance files /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f_del
Oct 16 18:55:47 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-ed6430eb-58a1-4637-bff2-847a026c8810 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Deletion of /opt/stack/data/nova/instances/fa1dea31-91bc-4fda-8fb2-638628b66b3f_del complete
Oct 16 18:55:47 user nova-compute[74247]: INFO nova.compute.manager [None req-ed6430eb-58a1-4637-bff2-847a026c8810 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 16 18:55:47 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-ed6430eb-58a1-4637-bff2-847a026c8810 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 18:55:47 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 18:55:47 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 18:55:48 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:55:48 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Took 1.01 seconds to deallocate network for instance.
Oct 16 18:55:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ed6430eb-58a1-4637-bff2-847a026c8810 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:55:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ed6430eb-58a1-4637-bff2-847a026c8810 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:55:48 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-ed6430eb-58a1-4637-bff2-847a026c8810 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:55:48 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-ed6430eb-58a1-4637-bff2-847a026c8810 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:55:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ed6430eb-58a1-4637-bff2-847a026c8810 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.208s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:55:48 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-ed6430eb-58a1-4637-bff2-847a026c8810 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Deleted allocations for instance fa1dea31-91bc-4fda-8fb2-638628b66b3f
Oct 16 18:55:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ed6430eb-58a1-4637-bff2-847a026c8810 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.267s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:55:48 user nova-compute[74247]: DEBUG nova.compute.manager [req-577a7523-b1ae-441c-87ca-5a57d2a53491 req-60eae7ac-69e7-43bb-8a46-d65684ad7841 service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Received event network-vif-plugged-77ca2d19-f745-461d-9f32-8d42469a6bfc {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:55:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-577a7523-b1ae-441c-87ca-5a57d2a53491 req-60eae7ac-69e7-43bb-8a46-d65684ad7841 service nova] Acquiring lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:55:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-577a7523-b1ae-441c-87ca-5a57d2a53491 req-60eae7ac-69e7-43bb-8a46-d65684ad7841 service nova] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:55:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-577a7523-b1ae-441c-87ca-5a57d2a53491 req-60eae7ac-69e7-43bb-8a46-d65684ad7841 service nova] Lock "fa1dea31-91bc-4fda-8fb2-638628b66b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:55:48 user nova-compute[74247]: DEBUG nova.compute.manager [req-577a7523-b1ae-441c-87ca-5a57d2a53491 req-60eae7ac-69e7-43bb-8a46-d65684ad7841 service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] No waiting events found dispatching network-vif-plugged-77ca2d19-f745-461d-9f32-8d42469a6bfc {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:55:48 user nova-compute[74247]: WARNING nova.compute.manager [req-577a7523-b1ae-441c-87ca-5a57d2a53491 req-60eae7ac-69e7-43bb-8a46-d65684ad7841 service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Received unexpected event network-vif-plugged-77ca2d19-f745-461d-9f32-8d42469a6bfc for instance with vm_state deleted and task_state None.
Oct 16 18:55:48 user nova-compute[74247]: DEBUG nova.compute.manager [req-577a7523-b1ae-441c-87ca-5a57d2a53491 req-60eae7ac-69e7-43bb-8a46-d65684ad7841 service nova] [instance: fa1dea31-91bc-4fda-8fb2-638628b66b3f] Received event network-vif-deleted-77ca2d19-f745-461d-9f32-8d42469a6bfc {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:55:52 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:55:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:56:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0f5bb1e2-8d0f-4dc9-861c-154aac3f5936 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Acquiring lock "caeb76f2-c378-4ca9-ac9d-b21bbda08343" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:56:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0f5bb1e2-8d0f-4dc9-861c-154aac3f5936 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "caeb76f2-c378-4ca9-ac9d-b21bbda08343" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:56:01 user nova-compute[74247]: INFO nova.compute.manager [None req-0f5bb1e2-8d0f-4dc9-861c-154aac3f5936 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Detaching volume 06b2e41b-6bfd-4b33-9050-2a96c2281cb6
Oct 16 18:56:01 user nova-compute[74247]: INFO nova.virt.block_device [None req-0f5bb1e2-8d0f-4dc9-861c-154aac3f5936 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Attempting to driver detach volume 06b2e41b-6bfd-4b33-9050-2a96c2281cb6 from mountpoint /dev/vdb
Oct 16 18:56:01 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0f5bb1e2-8d0f-4dc9-861c-154aac3f5936 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Attempting to detach device vdb from instance caeb76f2-c378-4ca9-ac9d-b21bbda08343 from the persistent domain config. {{(pid=74247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 18:56:01 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-0f5bb1e2-8d0f-4dc9-861c-154aac3f5936 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 18:56:01 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:56:01 user nova-compute[74247]:   <source dev="/dev/sdd"/>
Oct 16 18:56:01 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:56:01 user nova-compute[74247]:   <serial>06b2e41b-6bfd-4b33-9050-2a96c2281cb6</serial>
Oct 16 18:56:01 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 18:56:01 user nova-compute[74247]: </disk>
Oct 16 18:56:01 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:56:01 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-0f5bb1e2-8d0f-4dc9-861c-154aac3f5936 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Successfully detached device vdb from instance caeb76f2-c378-4ca9-ac9d-b21bbda08343 from the persistent domain config.
Oct 16 18:56:01 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0f5bb1e2-8d0f-4dc9-861c-154aac3f5936 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance caeb76f2-c378-4ca9-ac9d-b21bbda08343 from the live domain config. {{(pid=74247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 18:56:01 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-0f5bb1e2-8d0f-4dc9-861c-154aac3f5936 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 18:56:01 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:56:01 user nova-compute[74247]:   <source dev="/dev/sdd"/>
Oct 16 18:56:01 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:56:01 user nova-compute[74247]:   <serial>06b2e41b-6bfd-4b33-9050-2a96c2281cb6</serial>
Oct 16 18:56:01 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 18:56:01 user nova-compute[74247]: </disk>
Oct 16 18:56:01 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:56:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a59b8607-b796-47f9-aed5-f945c332bdce tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Acquiring lock "caeb76f2-c378-4ca9-ac9d-b21bbda08343" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:56:02 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0f5bb1e2-8d0f-4dc9-861c-154aac3f5936 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance caeb76f2-c378-4ca9-ac9d-b21bbda08343 {{(pid=74247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 18:56:02 user nova-compute[74247]: DEBUG nova.compute.manager [req-edf3dfe4-409c-40f8-9741-bec70742c6fd req-1ad2802b-f85e-4d31-8dc3-a5ae38e66f04 service nova] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Received event network-changed-05534003-00a8-4e28-9524-aed9e43ecd30 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:56:02 user nova-compute[74247]: DEBUG nova.compute.manager [req-edf3dfe4-409c-40f8-9741-bec70742c6fd req-1ad2802b-f85e-4d31-8dc3-a5ae38e66f04 service nova] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Refreshing instance network info cache due to event network-changed-05534003-00a8-4e28-9524-aed9e43ecd30. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:56:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-edf3dfe4-409c-40f8-9741-bec70742c6fd req-1ad2802b-f85e-4d31-8dc3-a5ae38e66f04 service nova] Acquiring lock "refresh_cache-8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:56:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-edf3dfe4-409c-40f8-9741-bec70742c6fd req-1ad2802b-f85e-4d31-8dc3-a5ae38e66f04 service nova] Acquired lock "refresh_cache-8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:56:02 user nova-compute[74247]: DEBUG nova.network.neutron [req-edf3dfe4-409c-40f8-9741-bec70742c6fd req-1ad2802b-f85e-4d31-8dc3-a5ae38e66f04 service nova] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Refreshing network info cache for port 05534003-00a8-4e28-9524-aed9e43ecd30 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:56:02 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:02 user nova-compute[74247]: DEBUG nova.network.neutron [req-edf3dfe4-409c-40f8-9741-bec70742c6fd req-1ad2802b-f85e-4d31-8dc3-a5ae38e66f04 service nova] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Updated VIF entry in instance network info cache for port 05534003-00a8-4e28-9524-aed9e43ecd30. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:56:02 user nova-compute[74247]: DEBUG nova.network.neutron [req-edf3dfe4-409c-40f8-9741-bec70742c6fd req-1ad2802b-f85e-4d31-8dc3-a5ae38e66f04 service nova] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Updating instance_info_cache with network_info: [{"id": "05534003-00a8-4e28-9524-aed9e43ecd30", "address": "fa:16:3e:ce:95:bf", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05534003-00", "ovs_interfaceid": "05534003-00a8-4e28-9524-aed9e43ecd30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:56:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-edf3dfe4-409c-40f8-9741-bec70742c6fd req-1ad2802b-f85e-4d31-8dc3-a5ae38e66f04 service nova] Releasing lock "refresh_cache-8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:56:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:56:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:56:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:56:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:56:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:56:02 user nova-compute[74247]: INFO nova.compute.manager [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Terminating instance
Oct 16 18:56:02 user nova-compute[74247]: DEBUG nova.compute.manager [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 18:56:02 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:02 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG nova.compute.manager [req-a8748939-1003-41d4-91df-09dfd1b5af06 req-63848680-6c43-48d3-a3f9-46fe7ef2b66b service nova] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Received event network-vif-unplugged-05534003-00a8-4e28-9524-aed9e43ecd30 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a8748939-1003-41d4-91df-09dfd1b5af06 req-63848680-6c43-48d3-a3f9-46fe7ef2b66b service nova] Acquiring lock "8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a8748939-1003-41d4-91df-09dfd1b5af06 req-63848680-6c43-48d3-a3f9-46fe7ef2b66b service nova] Lock "8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a8748939-1003-41d4-91df-09dfd1b5af06 req-63848680-6c43-48d3-a3f9-46fe7ef2b66b service nova] Lock "8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG nova.compute.manager [req-a8748939-1003-41d4-91df-09dfd1b5af06 req-63848680-6c43-48d3-a3f9-46fe7ef2b66b service nova] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] No waiting events found dispatching network-vif-unplugged-05534003-00a8-4e28-9524-aed9e43ecd30 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG nova.compute.manager [req-a8748939-1003-41d4-91df-09dfd1b5af06 req-63848680-6c43-48d3-a3f9-46fe7ef2b66b service nova] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Received event network-vif-unplugged-05534003-00a8-4e28-9524-aed9e43ecd30 for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:03 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Instance destroyed successfully.
Oct 16 18:56:03 user nova-compute[74247]: DEBUG nova.objects.instance [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lazy-loading 'resources' on Instance uuid 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:54:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-604696685',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-604696685',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-604696685',id=41,image_ref='c43661ac-4281-4b10-a15a-b16b5a809a6a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdCV5BAec86OjzjY1vcmPXw9MPS/hqShcGJdoyf8tWwr928BL29mRQFvRxmb5ep2ejAa0iAcJX+915RUQAZ0dujVR9/Q55TsH4qvkAbXi8oLzlBup5WrSQyTqHLvCkABg==',key_name='tempest-keypair-1855829965',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:54:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dca6144ea4e14c28b085e271175bbf67',ramdisk_id='',reservation_id='r-ytte0bal',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1733357121',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1733357121-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1733357121',owner_user_name='tempest-TestVolumeBootPattern-1733357121-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:54:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9608bf58b70248439dbbcc9db38fba08',uuid=8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05534003-00a8-4e28-9524-aed9e43ecd30", "address": "fa:16:3e:ce:95:bf", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05534003-00", "ovs_interfaceid": "05534003-00a8-4e28-9524-aed9e43ecd30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Converting VIF {"id": "05534003-00a8-4e28-9524-aed9e43ecd30", "address": "fa:16:3e:ce:95:bf", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05534003-00", "ovs_interfaceid": "05534003-00a8-4e28-9524-aed9e43ecd30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:95:bf,bridge_name='br-int',has_traffic_filtering=True,id=05534003-00a8-4e28-9524-aed9e43ecd30,network=Network(9688c665-d4b7-4179-9a76-fdf6c3013b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05534003-00') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG os_vif [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:95:bf,bridge_name='br-int',has_traffic_filtering=True,id=05534003-00a8-4e28-9524-aed9e43ecd30,network=Network(9688c665-d4b7-4179-9a76-fdf6c3013b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05534003-00') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05534003-00, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4f33c5fb-e2b1-4a89-8923-9dfb833c8b84) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:03 user nova-compute[74247]: INFO os_vif [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:95:bf,bridge_name='br-int',has_traffic_filtering=True,id=05534003-00a8-4e28-9524-aed9e43ecd30,network=Network(9688c665-d4b7-4179-9a76-fdf6c3013b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05534003-00')
Oct 16 18:56:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ctmUxvYS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:56:03 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:56:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de835da-dad8-4065-bb0f-23b08877623c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 18:56:03 user nova-compute[74247]: No targets found.
Oct 16 18:56:03 user nova-compute[74247]: iSNS:
Oct 16 18:56:03 user nova-compute[74247]: No targets found.
Oct 16 18:56:03 user nova-compute[74247]: STATIC:
Oct 16 18:56:03 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b
Oct 16 18:56:03 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:56:03 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:56:03 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc
Oct 16 18:56:03 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:56:03 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:56:03 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6
Oct 16 18:56:03 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:56:03 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:56:03 user nova-compute[74247]: FIRMWARE:
Oct 16 18:56:03 user nova-compute[74247]: No targets found.
Oct 16 18:56:03 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 18:56:03 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 18:56:03 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fdfad47-faf4-42cc-9d35-2a1135a108ad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[394b6c5e-c559-41f0-925e-a9ea8ace4284]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc (non-flash)
Oct 16 18:56:03 user nova-compute[74247]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b (non-flash)
Oct 16 18:56:03 user nova-compute[74247]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6 (non-flash)
Oct 16 18:56:03 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc (non-flash)
Oct 16 18:56:03 user nova-compute[74247]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b (non-flash)
Oct 16 18:56:03 user nova-compute[74247]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6 (non-flash)
Oct 16 18:56:03 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe07815eb00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b'): ({'sdc'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Removing single pathed devices sdc {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c2243c-e588-426b-b2ef-489fdce8b335]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.029s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f04676-81f8-4b84-be82-6fb84d6b0002]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Flushing IO for device /dev/sdc {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d7cd99-f5e8-445f-9a9f-fec309d61703]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.110s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2941252f-3eec-4f44-aafe-8801758a75de]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] SCSI volumes sdc have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecae813a-4f1e-4551-bea3-2818aaad631b]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:56:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:56:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:56:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:56:04 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b63806-e26a-41fe-b8c6-b2e643657860]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:56:04 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b, portal: 172.16.0.220,3260]
Oct 16 18:56:04 user nova-compute[74247]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b, portal: 172.16.0.220,3260] successful.
Oct 16 18:56:04 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:56:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:56:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f03f477-d31e-4b8c-944b-297e5f555d0b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:56:04 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce39ece-4f70-4335-9ea6-9f17c6fad0a8]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:56:04 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:56:04 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.476s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:56:04 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] <== disconnect_volume: return (478ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:56:04 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 18:56:04 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Deleting instance files /opt/stack/data/nova/instances/8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa_del
Oct 16 18:56:04 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Deletion of /opt/stack/data/nova/instances/8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa_del complete
Oct 16 18:56:04 user nova-compute[74247]: INFO nova.compute.manager [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Took 1.35 seconds to destroy the instance on the hypervisor.
Oct 16 18:56:04 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 18:56:04 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 18:56:04 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 18:56:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-6ea6b30f-04c2-4f48-b555-0aa98e17b2b3 req-b04a886a-a7e8-4dc4-ba62-001bc327ee1f service nova] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Received event network-vif-plugged-05534003-00a8-4e28-9524-aed9e43ecd30 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:56:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-6ea6b30f-04c2-4f48-b555-0aa98e17b2b3 req-b04a886a-a7e8-4dc4-ba62-001bc327ee1f service nova] Acquiring lock "8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:56:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-6ea6b30f-04c2-4f48-b555-0aa98e17b2b3 req-b04a886a-a7e8-4dc4-ba62-001bc327ee1f service nova] Lock "8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:56:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-6ea6b30f-04c2-4f48-b555-0aa98e17b2b3 req-b04a886a-a7e8-4dc4-ba62-001bc327ee1f service nova] Lock "8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:56:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-6ea6b30f-04c2-4f48-b555-0aa98e17b2b3 req-b04a886a-a7e8-4dc4-ba62-001bc327ee1f service nova] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] No waiting events found dispatching network-vif-plugged-05534003-00a8-4e28-9524-aed9e43ecd30 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:56:05 user nova-compute[74247]: WARNING nova.compute.manager [req-6ea6b30f-04c2-4f48-b555-0aa98e17b2b3 req-b04a886a-a7e8-4dc4-ba62-001bc327ee1f service nova] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Received unexpected event network-vif-plugged-05534003-00a8-4e28-9524-aed9e43ecd30 for instance with vm_state active and task_state deleting.
Oct 16 18:56:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-6ea6b30f-04c2-4f48-b555-0aa98e17b2b3 req-b04a886a-a7e8-4dc4-ba62-001bc327ee1f service nova] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Received event network-vif-plugged-05534003-00a8-4e28-9524-aed9e43ecd30 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:56:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-6ea6b30f-04c2-4f48-b555-0aa98e17b2b3 req-b04a886a-a7e8-4dc4-ba62-001bc327ee1f service nova] Acquiring lock "8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:56:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-6ea6b30f-04c2-4f48-b555-0aa98e17b2b3 req-b04a886a-a7e8-4dc4-ba62-001bc327ee1f service nova] Lock "8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:56:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-6ea6b30f-04c2-4f48-b555-0aa98e17b2b3 req-b04a886a-a7e8-4dc4-ba62-001bc327ee1f service nova] Lock "8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:56:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-6ea6b30f-04c2-4f48-b555-0aa98e17b2b3 req-b04a886a-a7e8-4dc4-ba62-001bc327ee1f service nova] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] No waiting events found dispatching network-vif-plugged-05534003-00a8-4e28-9524-aed9e43ecd30 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:56:05 user nova-compute[74247]: WARNING nova.compute.manager [req-6ea6b30f-04c2-4f48-b555-0aa98e17b2b3 req-b04a886a-a7e8-4dc4-ba62-001bc327ee1f service nova] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Received unexpected event network-vif-plugged-05534003-00a8-4e28-9524-aed9e43ecd30 for instance with vm_state active and task_state deleting.
Oct 16 18:56:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-6ea6b30f-04c2-4f48-b555-0aa98e17b2b3 req-b04a886a-a7e8-4dc4-ba62-001bc327ee1f service nova] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Received event network-vif-plugged-05534003-00a8-4e28-9524-aed9e43ecd30 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:56:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-6ea6b30f-04c2-4f48-b555-0aa98e17b2b3 req-b04a886a-a7e8-4dc4-ba62-001bc327ee1f service nova] Acquiring lock "8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:56:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-6ea6b30f-04c2-4f48-b555-0aa98e17b2b3 req-b04a886a-a7e8-4dc4-ba62-001bc327ee1f service nova] Lock "8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:56:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-6ea6b30f-04c2-4f48-b555-0aa98e17b2b3 req-b04a886a-a7e8-4dc4-ba62-001bc327ee1f service nova] Lock "8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:56:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-6ea6b30f-04c2-4f48-b555-0aa98e17b2b3 req-b04a886a-a7e8-4dc4-ba62-001bc327ee1f service nova] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] No waiting events found dispatching network-vif-plugged-05534003-00a8-4e28-9524-aed9e43ecd30 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:56:05 user nova-compute[74247]: WARNING nova.compute.manager [req-6ea6b30f-04c2-4f48-b555-0aa98e17b2b3 req-b04a886a-a7e8-4dc4-ba62-001bc327ee1f service nova] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Received unexpected event network-vif-plugged-05534003-00a8-4e28-9524-aed9e43ecd30 for instance with vm_state active and task_state deleting.
Oct 16 18:56:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-6ea6b30f-04c2-4f48-b555-0aa98e17b2b3 req-b04a886a-a7e8-4dc4-ba62-001bc327ee1f service nova] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Received event network-vif-unplugged-05534003-00a8-4e28-9524-aed9e43ecd30 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:56:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-6ea6b30f-04c2-4f48-b555-0aa98e17b2b3 req-b04a886a-a7e8-4dc4-ba62-001bc327ee1f service nova] Acquiring lock "8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:56:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-6ea6b30f-04c2-4f48-b555-0aa98e17b2b3 req-b04a886a-a7e8-4dc4-ba62-001bc327ee1f service nova] Lock "8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:56:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-6ea6b30f-04c2-4f48-b555-0aa98e17b2b3 req-b04a886a-a7e8-4dc4-ba62-001bc327ee1f service nova] Lock "8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:56:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-6ea6b30f-04c2-4f48-b555-0aa98e17b2b3 req-b04a886a-a7e8-4dc4-ba62-001bc327ee1f service nova] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] No waiting events found dispatching network-vif-unplugged-05534003-00a8-4e28-9524-aed9e43ecd30 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:56:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-6ea6b30f-04c2-4f48-b555-0aa98e17b2b3 req-b04a886a-a7e8-4dc4-ba62-001bc327ee1f service nova] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Received event network-vif-unplugged-05534003-00a8-4e28-9524-aed9e43ecd30 for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:56:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-6ea6b30f-04c2-4f48-b555-0aa98e17b2b3 req-b04a886a-a7e8-4dc4-ba62-001bc327ee1f service nova] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Received event network-vif-plugged-05534003-00a8-4e28-9524-aed9e43ecd30 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:56:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-6ea6b30f-04c2-4f48-b555-0aa98e17b2b3 req-b04a886a-a7e8-4dc4-ba62-001bc327ee1f service nova] Acquiring lock "8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:56:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-6ea6b30f-04c2-4f48-b555-0aa98e17b2b3 req-b04a886a-a7e8-4dc4-ba62-001bc327ee1f service nova] Lock "8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:56:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-6ea6b30f-04c2-4f48-b555-0aa98e17b2b3 req-b04a886a-a7e8-4dc4-ba62-001bc327ee1f service nova] Lock "8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:56:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-6ea6b30f-04c2-4f48-b555-0aa98e17b2b3 req-b04a886a-a7e8-4dc4-ba62-001bc327ee1f service nova] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] No waiting events found dispatching network-vif-plugged-05534003-00a8-4e28-9524-aed9e43ecd30 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:56:05 user nova-compute[74247]: WARNING nova.compute.manager [req-6ea6b30f-04c2-4f48-b555-0aa98e17b2b3 req-b04a886a-a7e8-4dc4-ba62-001bc327ee1f service nova] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Received unexpected event network-vif-plugged-05534003-00a8-4e28-9524-aed9e43ecd30 for instance with vm_state active and task_state deleting.
Oct 16 18:56:05 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:56:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-3e023ac9-d4c9-4f40-91d6-a8a9460ba884 req-29a7ec34-a3f7-48aa-9446-a94514f7b30f service nova] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Received event network-vif-deleted-05534003-00a8-4e28-9524-aed9e43ecd30 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:56:05 user nova-compute[74247]: INFO nova.compute.manager [req-3e023ac9-d4c9-4f40-91d6-a8a9460ba884 req-29a7ec34-a3f7-48aa-9446-a94514f7b30f service nova] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Neutron deleted interface 05534003-00a8-4e28-9524-aed9e43ecd30; detaching it from the instance and deleting it from the info cache
Oct 16 18:56:05 user nova-compute[74247]: DEBUG nova.network.neutron [req-3e023ac9-d4c9-4f40-91d6-a8a9460ba884 req-29a7ec34-a3f7-48aa-9446-a94514f7b30f service nova] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:56:05 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Took 1.08 seconds to deallocate network for instance.
Oct 16 18:56:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-3e023ac9-d4c9-4f40-91d6-a8a9460ba884 req-29a7ec34-a3f7-48aa-9446-a94514f7b30f service nova] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Detach interface failed, port_id=05534003-00a8-4e28-9524-aed9e43ecd30, reason: Instance 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa could not be found. {{(pid=74247) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 18:56:06 user nova-compute[74247]: INFO nova.compute.manager [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Took 0.99 seconds to detach 1 volumes for instance.
Oct 16 18:56:06 user nova-compute[74247]: DEBUG nova.compute.manager [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa] Deleting volume: 8f03f477-d31e-4b8c-944b-297e5f555d0b {{(pid=74247) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 16 18:56:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:56:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:56:06 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:56:06 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:56:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.211s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:56:06 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Deleted allocations for instance 8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa
Oct 16 18:56:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-aedbbe92-3f26-47ab-bed6-3e58bc867b07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "8540a25c-405c-4ae4-b2b4-3e1f89b5c7aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.961s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:56:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:56:14 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:56:15 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:56:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:56:18 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:56:20 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:56:20 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:56:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:56:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:56:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:56:20 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 18:56:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:56:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:56:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:56:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:56:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caeb76f2-c378-4ca9-ac9d-b21bbda08343/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:56:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caeb76f2-c378-4ca9-ac9d-b21bbda08343/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:56:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caeb76f2-c378-4ca9-ac9d-b21bbda08343/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:56:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caeb76f2-c378-4ca9-ac9d-b21bbda08343/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:56:21 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:56:21 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:56:21 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:56:21 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=8567MB free_disk=24.9879150390625GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 18:56:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:56:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:56:22 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-0f5bb1e2-8d0f-4dc9-861c-154aac3f5936 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance caeb76f2-c378-4ca9-ac9d-b21bbda08343 is timed out.
Oct 16 18:56:22 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-0f5bb1e2-8d0f-4dc9-861c-154aac3f5936 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Successfully detached device vdb from instance caeb76f2-c378-4ca9-ac9d-b21bbda08343 from the live domain config.
Oct 16 18:56:22 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f5bb1e2-8d0f-4dc9-861c-154aac3f5936 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f5bb1e2-8d0f-4dc9-861c-154aac3f5936 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zfhoYDOE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:56:22 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-0f5bb1e2-8d0f-4dc9-861c-154aac3f5936 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:56:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-0f5bb1e2-8d0f-4dc9-861c-154aac3f5936 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-0f5bb1e2-8d0f-4dc9-861c-154aac3f5936 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 75e5e67a-3e02-4bc4-8e28-04125d32c6e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance caeb76f2-c378-4ca9-ac9d-b21bbda08343 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3ebf9c-af7c-4c9e-b7cf-767679cf5f8f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f5bb1e2-8d0f-4dc9-861c-154aac3f5936 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 18:56:22 user nova-compute[74247]: No targets found.
Oct 16 18:56:22 user nova-compute[74247]: iSNS:
Oct 16 18:56:22 user nova-compute[74247]: No targets found.
Oct 16 18:56:22 user nova-compute[74247]: STATIC:
Oct 16 18:56:22 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc
Oct 16 18:56:22 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:56:22 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:56:22 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6
Oct 16 18:56:22 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:56:22 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:56:22 user nova-compute[74247]: FIRMWARE:
Oct 16 18:56:22 user nova-compute[74247]: No targets found.
Oct 16 18:56:22 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f5bb1e2-8d0f-4dc9-861c-154aac3f5936 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 18:56:22 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 18:56:22 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f5bb1e2-8d0f-4dc9-861c-154aac3f5936 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[19edebe2-706d-4c08-b6c5-ad79d2cb7d83]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e432e325-c9ab-444a-a950-85c4daaf49c5]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f5bb1e2-8d0f-4dc9-861c-154aac3f5936 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc (non-flash)
Oct 16 18:56:22 user nova-compute[74247]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6 (non-flash)
Oct 16 18:56:22 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f5bb1e2-8d0f-4dc9-861c-154aac3f5936 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc (non-flash)
Oct 16 18:56:22 user nova-compute[74247]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6 (non-flash)
Oct 16 18:56:22 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f5bb1e2-8d0f-4dc9-861c-154aac3f5936 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe048450280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6'): ({'sdd'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-0f5bb1e2-8d0f-4dc9-861c-154aac3f5936 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Removing single pathed devices sdd {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02fb415-6f79-42ea-8feb-cdb422138c8c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ab49e8-a64f-4a88-ae75-922c7e9615dc]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-0f5bb1e2-8d0f-4dc9-861c-154aac3f5936 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Flushing IO for device /dev/sdd {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[19da955f-3b6e-456c-adb0-2be75dd87c1a]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-0f5bb1e2-8d0f-4dc9-861c-154aac3f5936 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.271s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8eaf87-f9e3-4034-84f4-eb8804dc84d6]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-0f5bb1e2-8d0f-4dc9-861c-154aac3f5936 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-0f5bb1e2-8d0f-4dc9-861c-154aac3f5936 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] SCSI volumes sdd have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f5bb1e2-8d0f-4dc9-861c-154aac3f5936 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d3998c-e2fc-4623-b2a6-26fac3b1daa9]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f5bb1e2-8d0f-4dc9-861c-154aac3f5936 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6 -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d67929-bb10-4346-82c4-13a9c51adf43]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f5bb1e2-8d0f-4dc9-861c-154aac3f5936 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6, portal: 172.16.0.220,3260]
Oct 16 18:56:22 user nova-compute[74247]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6, portal: 172.16.0.220,3260] successful.
Oct 16 18:56:22 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6 -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e2e99b-0ba6-4b1d-ac45-ca342a79bf28]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f5bb1e2-8d0f-4dc9-861c-154aac3f5936 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-0f5bb1e2-8d0f-4dc9-861c-154aac3f5936 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f5bb1e2-8d0f-4dc9-861c-154aac3f5936 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] <== disconnect_volume: return (287ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:56:22 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f5bb1e2-8d0f-4dc9-861c-154aac3f5936 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 18:56:23 user nova-compute[74247]: DEBUG nova.objects.instance [None req-0f5bb1e2-8d0f-4dc9-861c-154aac3f5936 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lazy-loading 'flavor' on Instance uuid caeb76f2-c378-4ca9-ac9d-b21bbda08343 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:56:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0f5bb1e2-8d0f-4dc9-861c-154aac3f5936 tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "caeb76f2-c378-4ca9-ac9d-b21bbda08343" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.694s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:56:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a59b8607-b796-47f9-aed5-f945c332bdce tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "caeb76f2-c378-4ca9-ac9d-b21bbda08343" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.555s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:56:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a59b8607-b796-47f9-aed5-f945c332bdce tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Acquiring lock "caeb76f2-c378-4ca9-ac9d-b21bbda08343-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:56:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a59b8607-b796-47f9-aed5-f945c332bdce tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "caeb76f2-c378-4ca9-ac9d-b21bbda08343-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:56:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a59b8607-b796-47f9-aed5-f945c332bdce tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "caeb76f2-c378-4ca9-ac9d-b21bbda08343-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:56:23 user nova-compute[74247]: INFO nova.compute.manager [None req-a59b8607-b796-47f9-aed5-f945c332bdce tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Terminating instance
Oct 16 18:56:23 user nova-compute[74247]: DEBUG nova.compute.manager [None req-a59b8607-b796-47f9-aed5-f945c332bdce tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 18:56:23 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:56:23 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 18:56:23 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Skipping network cache update for instance because it is being deleted. {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9970}}
Oct 16 18:56:23 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Didn't find any instances for network info cache update. {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 18:56:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:23 user nova-compute[74247]: DEBUG nova.compute.manager [req-d77802f5-56a3-45df-8deb-b0101a2cda71 req-31b1ff6c-99c2-4480-abf0-406684dc9699 service nova] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Received event network-vif-unplugged-0f13fea1-9428-4547-8f54-8ba7b9b9e07f {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:56:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d77802f5-56a3-45df-8deb-b0101a2cda71 req-31b1ff6c-99c2-4480-abf0-406684dc9699 service nova] Acquiring lock "caeb76f2-c378-4ca9-ac9d-b21bbda08343-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:56:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d77802f5-56a3-45df-8deb-b0101a2cda71 req-31b1ff6c-99c2-4480-abf0-406684dc9699 service nova] Lock "caeb76f2-c378-4ca9-ac9d-b21bbda08343-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:56:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d77802f5-56a3-45df-8deb-b0101a2cda71 req-31b1ff6c-99c2-4480-abf0-406684dc9699 service nova] Lock "caeb76f2-c378-4ca9-ac9d-b21bbda08343-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:56:23 user nova-compute[74247]: DEBUG nova.compute.manager [req-d77802f5-56a3-45df-8deb-b0101a2cda71 req-31b1ff6c-99c2-4480-abf0-406684dc9699 service nova] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] No waiting events found dispatching network-vif-unplugged-0f13fea1-9428-4547-8f54-8ba7b9b9e07f {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:56:23 user nova-compute[74247]: DEBUG nova.compute.manager [req-d77802f5-56a3-45df-8deb-b0101a2cda71 req-31b1ff6c-99c2-4480-abf0-406684dc9699 service nova] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Received event network-vif-unplugged-0f13fea1-9428-4547-8f54-8ba7b9b9e07f for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:56:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-68fd5912-40f6-4a32-a051-ce927e2845a7 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Acquiring lock "ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:56:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-68fd5912-40f6-4a32-a051-ce927e2845a7 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Lock "ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:56:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-68fd5912-40f6-4a32-a051-ce927e2845a7 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Acquiring lock "ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:56:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-68fd5912-40f6-4a32-a051-ce927e2845a7 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Lock "ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:56:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-68fd5912-40f6-4a32-a051-ce927e2845a7 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Lock "ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:56:23 user nova-compute[74247]: INFO nova.compute.manager [None req-68fd5912-40f6-4a32-a051-ce927e2845a7 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Terminating instance
Oct 16 18:56:23 user nova-compute[74247]: DEBUG nova.compute.manager [None req-68fd5912-40f6-4a32-a051-ce927e2845a7 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 18:56:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:23 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:56:23 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 18:56:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:23 user nova-compute[74247]: DEBUG nova.compute.manager [req-c91b3c1f-edb4-4077-b908-80f6e4d1a1fb req-bde70d1a-81f5-4d60-a533-1901e5ac4f8d service nova] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Received event network-vif-unplugged-ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:56:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c91b3c1f-edb4-4077-b908-80f6e4d1a1fb req-bde70d1a-81f5-4d60-a533-1901e5ac4f8d service nova] Acquiring lock "ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:56:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c91b3c1f-edb4-4077-b908-80f6e4d1a1fb req-bde70d1a-81f5-4d60-a533-1901e5ac4f8d service nova] Lock "ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:56:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c91b3c1f-edb4-4077-b908-80f6e4d1a1fb req-bde70d1a-81f5-4d60-a533-1901e5ac4f8d service nova] Lock "ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:56:23 user nova-compute[74247]: DEBUG nova.compute.manager [req-c91b3c1f-edb4-4077-b908-80f6e4d1a1fb req-bde70d1a-81f5-4d60-a533-1901e5ac4f8d service nova] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] No waiting events found dispatching network-vif-unplugged-ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:56:23 user nova-compute[74247]: DEBUG nova.compute.manager [req-c91b3c1f-edb4-4077-b908-80f6e4d1a1fb req-bde70d1a-81f5-4d60-a533-1901e5ac4f8d service nova] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Received event network-vif-unplugged-ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1 for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:56:24 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Instance destroyed successfully.
Oct 16 18:56:24 user nova-compute[74247]: DEBUG nova.objects.instance [None req-a59b8607-b796-47f9-aed5-f945c332bdce tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lazy-loading 'resources' on Instance uuid caeb76f2-c378-4ca9-ac9d-b21bbda08343 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-a59b8607-b796-47f9-aed5-f945c332bdce tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:53:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-486657457',display_name='tempest-VolumesSnapshotTestJSON-instance-486657457',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-486657457',id=40,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANRpLlA35xp1wxL7Lve2agQRlFcBdevBC36yPFIuP0wtithsfKbO/NDP7lc4Gu5Fd2HBRfgrBPr7wMcWtapdsjNWpGE6IA0YkAzGRYWOJ9K0QBg+jMqUPyzBHI5xhs75Q==',key_name='tempest-keypair-915996718',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:53:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eaf6596e67794e1794dc93e8e8523ae7',ramdisk_id='',reservation_id='r-w0hb22cg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-730943931',owner_user_name='tempest-VolumesSnapshotTestJSON-730943931-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:53:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb73af6700c1406994dab6331939fe1b',uuid=caeb76f2-c378-4ca9-ac9d-b21bbda08343,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f13fea1-9428-4547-8f54-8ba7b9b9e07f", "address": "fa:16:3e:d1:18:e8", "network": {"id": "8e0ea38d-892f-4f82-a321-93292d5bea90", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-201299230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf6596e67794e1794dc93e8e8523ae7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f13fea1-94", "ovs_interfaceid": "0f13fea1-9428-4547-8f54-8ba7b9b9e07f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-a59b8607-b796-47f9-aed5-f945c332bdce tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Converting VIF {"id": "0f13fea1-9428-4547-8f54-8ba7b9b9e07f", "address": "fa:16:3e:d1:18:e8", "network": {"id": "8e0ea38d-892f-4f82-a321-93292d5bea90", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-201299230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf6596e67794e1794dc93e8e8523ae7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f13fea1-94", "ovs_interfaceid": "0f13fea1-9428-4547-8f54-8ba7b9b9e07f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-a59b8607-b796-47f9-aed5-f945c332bdce tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:18:e8,bridge_name='br-int',has_traffic_filtering=True,id=0f13fea1-9428-4547-8f54-8ba7b9b9e07f,network=Network(8e0ea38d-892f-4f82-a321-93292d5bea90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f13fea1-94') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG os_vif [None req-a59b8607-b796-47f9-aed5-f945c332bdce tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:18:e8,bridge_name='br-int',has_traffic_filtering=True,id=0f13fea1-9428-4547-8f54-8ba7b9b9e07f,network=Network(8e0ea38d-892f-4f82-a321-93292d5bea90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f13fea1-94') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f13fea1-94, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=05d2c77b-74a5-47ad-bb9f-eb1bb1f92540) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:24 user nova-compute[74247]: INFO os_vif [None req-a59b8607-b796-47f9-aed5-f945c332bdce tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:18:e8,bridge_name='br-int',has_traffic_filtering=True,id=0f13fea1-9428-4547-8f54-8ba7b9b9e07f,network=Network(8e0ea38d-892f-4f82-a321-93292d5bea90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f13fea1-94')
Oct 16 18:56:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a59b8607-b796-47f9-aed5-f945c332bdce tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59b8607-b796-47f9-aed5-f945c332bdce tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zfhoYDOE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:56:24 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-a59b8607-b796-47f9-aed5-f945c332bdce tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:56:24 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-a59b8607-b796-47f9-aed5-f945c332bdce tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-a59b8607-b796-47f9-aed5-f945c332bdce tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe29fffa-7868-4539-b260-c115a1f5ae34]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59b8607-b796-47f9-aed5-f945c332bdce tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 18:56:24 user nova-compute[74247]: No targets found.
Oct 16 18:56:24 user nova-compute[74247]: iSNS:
Oct 16 18:56:24 user nova-compute[74247]: No targets found.
Oct 16 18:56:24 user nova-compute[74247]: STATIC:
Oct 16 18:56:24 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc
Oct 16 18:56:24 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:56:24 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:56:24 user nova-compute[74247]: FIRMWARE:
Oct 16 18:56:24 user nova-compute[74247]: No targets found.
Oct 16 18:56:24 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59b8607-b796-47f9-aed5-f945c332bdce tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 18:56:24 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 18:56:24 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59b8607-b796-47f9-aed5-f945c332bdce tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06b2e41b-6bfd-4b33-9050-2a96c2281cb6', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[20115064-9370-4880-b034-466ff4951b27]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17503ee-2a74-45a5-a944-e882b534c6d9]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59b8607-b796-47f9-aed5-f945c332bdce tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc (non-flash)
Oct 16 18:56:24 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59b8607-b796-47f9-aed5-f945c332bdce tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc (non-flash)
Oct 16 18:56:24 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59b8607-b796-47f9-aed5-f945c332bdce tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe068210ca0>, {}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59b8607-b796-47f9-aed5-f945c332bdce tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Disconnecting from: [] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-a59b8607-b796-47f9-aed5-f945c332bdce tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.076s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59b8607-b796-47f9-aed5-f945c332bdce tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] <== disconnect_volume: return (77ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a59b8607-b796-47f9-aed5-f945c332bdce tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 18:56:24 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-a59b8607-b796-47f9-aed5-f945c332bdce tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Deleting instance files /opt/stack/data/nova/instances/caeb76f2-c378-4ca9-ac9d-b21bbda08343_del
Oct 16 18:56:24 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-a59b8607-b796-47f9-aed5-f945c332bdce tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Deletion of /opt/stack/data/nova/instances/caeb76f2-c378-4ca9-ac9d-b21bbda08343_del complete
Oct 16 18:56:24 user nova-compute[74247]: INFO nova.compute.manager [None req-a59b8607-b796-47f9-aed5-f945c332bdce tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Took 1.05 seconds to destroy the instance on the hypervisor.
Oct 16 18:56:24 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-a59b8607-b796-47f9-aed5-f945c332bdce tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 18:56:24 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Instance destroyed successfully.
Oct 16 18:56:24 user nova-compute[74247]: DEBUG nova.objects.instance [None req-68fd5912-40f6-4a32-a051-ce927e2845a7 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Lazy-loading 'resources' on Instance uuid ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-68fd5912-40f6-4a32-a051-ce927e2845a7 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:54:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1764612672',display_name='tempest-VolumesActionsTest-instance-1764612672',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1764612672',id=42,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:54:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e978b6d707c46188f74f2ddbf6deb62',ramdisk_id='',reservation_id='r-9w8mfu4k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-524114660',owner_user_name='tempest-VolumesActionsTest-524114660-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:54:41Z,user_data=None,user_id='c3510de5a2cc43f38f7380d53eeab430',uuid=ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1", "address": "fa:16:3e:be:67:7a", "network": {"id": "dccde3f4-f49e-49b6-905e-3aaf51b415b2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-19864196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e978b6d707c46188f74f2ddbf6deb62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecdaa2b2-4a", "ovs_interfaceid": "ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-68fd5912-40f6-4a32-a051-ce927e2845a7 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Converting VIF {"id": "ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1", "address": "fa:16:3e:be:67:7a", "network": {"id": "dccde3f4-f49e-49b6-905e-3aaf51b415b2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-19864196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e978b6d707c46188f74f2ddbf6deb62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecdaa2b2-4a", "ovs_interfaceid": "ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-68fd5912-40f6-4a32-a051-ce927e2845a7 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:67:7a,bridge_name='br-int',has_traffic_filtering=True,id=ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1,network=Network(dccde3f4-f49e-49b6-905e-3aaf51b415b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecdaa2b2-4a') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG os_vif [None req-68fd5912-40f6-4a32-a051-ce927e2845a7 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:67:7a,bridge_name='br-int',has_traffic_filtering=True,id=ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1,network=Network(dccde3f4-f49e-49b6-905e-3aaf51b415b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecdaa2b2-4a') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapecdaa2b2-4a, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f72a3211-3fae-4f8d-ae11-12304ede5908) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:56:24 user nova-compute[74247]: INFO os_vif [None req-68fd5912-40f6-4a32-a051-ce927e2845a7 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:67:7a,bridge_name='br-int',has_traffic_filtering=True,id=ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1,network=Network(dccde3f4-f49e-49b6-905e-3aaf51b415b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecdaa2b2-4a')
Oct 16 18:56:24 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-68fd5912-40f6-4a32-a051-ce927e2845a7 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Deleting instance files /opt/stack/data/nova/instances/ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6_del
Oct 16 18:56:24 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-68fd5912-40f6-4a32-a051-ce927e2845a7 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Deletion of /opt/stack/data/nova/instances/ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6_del complete
Oct 16 18:56:24 user nova-compute[74247]: INFO nova.compute.manager [None req-68fd5912-40f6-4a32-a051-ce927e2845a7 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 16 18:56:24 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-68fd5912-40f6-4a32-a051-ce927e2845a7 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:56:24 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Took 0.39 seconds to deallocate network for instance.
Oct 16 18:56:24 user nova-compute[74247]: DEBUG nova.compute.manager [req-8ffe4943-1379-4682-a5b6-3bd84fa4aa39 req-821daa64-33eb-443b-aa72-bae08cfcab62 service nova] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Received event network-vif-deleted-ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-68fd5912-40f6-4a32-a051-ce927e2845a7 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:56:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-68fd5912-40f6-4a32-a051-ce927e2845a7 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:56:25 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-68fd5912-40f6-4a32-a051-ce927e2845a7 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:56:25 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-68fd5912-40f6-4a32-a051-ce927e2845a7 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:56:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-68fd5912-40f6-4a32-a051-ce927e2845a7 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.213s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:56:25 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-68fd5912-40f6-4a32-a051-ce927e2845a7 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Deleted allocations for instance ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6
Oct 16 18:56:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-68fd5912-40f6-4a32-a051-ce927e2845a7 tempest-VolumesActionsTest-524114660 tempest-VolumesActionsTest-524114660-project-member] Lock "ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.670s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:56:25 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:56:25 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Took 1.16 seconds to deallocate network for instance.
Oct 16 18:56:25 user nova-compute[74247]: WARNING nova.volume.cinder [None req-a59b8607-b796-47f9-aed5-f945c332bdce tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Attachment ee85ec0c-ae0b-4dcc-8fcc-ca3e57b904cf does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = ee85ec0c-ae0b-4dcc-8fcc-ca3e57b904cf. (HTTP 404) (Request-ID: req-b53bd152-66d4-4003-908d-7338be0946f4)
Oct 16 18:56:25 user nova-compute[74247]: INFO nova.compute.manager [None req-a59b8607-b796-47f9-aed5-f945c332bdce tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Took 0.02 seconds to detach 1 volumes for instance.
Oct 16 18:56:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a59b8607-b796-47f9-aed5-f945c332bdce tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:56:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a59b8607-b796-47f9-aed5-f945c332bdce tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:56:25 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-a59b8607-b796-47f9-aed5-f945c332bdce tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:56:25 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-a59b8607-b796-47f9-aed5-f945c332bdce tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:56:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a59b8607-b796-47f9-aed5-f945c332bdce tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.123s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:56:25 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:56:25 user nova-compute[74247]: DEBUG nova.compute.manager [req-8270a413-91d9-4742-9efc-462a527fee01 req-d0c85222-5c58-4456-894f-f3dd074cb563 service nova] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Received event network-vif-plugged-0f13fea1-9428-4547-8f54-8ba7b9b9e07f {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:56:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-8270a413-91d9-4742-9efc-462a527fee01 req-d0c85222-5c58-4456-894f-f3dd074cb563 service nova] Acquiring lock "caeb76f2-c378-4ca9-ac9d-b21bbda08343-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:56:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-8270a413-91d9-4742-9efc-462a527fee01 req-d0c85222-5c58-4456-894f-f3dd074cb563 service nova] Lock "caeb76f2-c378-4ca9-ac9d-b21bbda08343-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:56:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-8270a413-91d9-4742-9efc-462a527fee01 req-d0c85222-5c58-4456-894f-f3dd074cb563 service nova] Lock "caeb76f2-c378-4ca9-ac9d-b21bbda08343-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:56:25 user nova-compute[74247]: DEBUG nova.compute.manager [req-8270a413-91d9-4742-9efc-462a527fee01 req-d0c85222-5c58-4456-894f-f3dd074cb563 service nova] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] No waiting events found dispatching network-vif-plugged-0f13fea1-9428-4547-8f54-8ba7b9b9e07f {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:56:25 user nova-compute[74247]: WARNING nova.compute.manager [req-8270a413-91d9-4742-9efc-462a527fee01 req-d0c85222-5c58-4456-894f-f3dd074cb563 service nova] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Received unexpected event network-vif-plugged-0f13fea1-9428-4547-8f54-8ba7b9b9e07f for instance with vm_state deleted and task_state None.
Oct 16 18:56:25 user nova-compute[74247]: DEBUG nova.compute.manager [req-8270a413-91d9-4742-9efc-462a527fee01 req-d0c85222-5c58-4456-894f-f3dd074cb563 service nova] [instance: caeb76f2-c378-4ca9-ac9d-b21bbda08343] Received event network-vif-deleted-0f13fea1-9428-4547-8f54-8ba7b9b9e07f {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:56:25 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-a59b8607-b796-47f9-aed5-f945c332bdce tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Deleted allocations for instance caeb76f2-c378-4ca9-ac9d-b21bbda08343
Oct 16 18:56:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a59b8607-b796-47f9-aed5-f945c332bdce tempest-VolumesSnapshotTestJSON-730943931 tempest-VolumesSnapshotTestJSON-730943931-project-member] Lock "caeb76f2-c378-4ca9-ac9d-b21bbda08343" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.551s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:56:25 user nova-compute[74247]: DEBUG nova.compute.manager [req-216edb18-c5eb-40a3-9a0d-03fd95a65395 req-26a01635-b9c8-4ad1-a184-d226a0d5dc39 service nova] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Received event network-vif-plugged-ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:56:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-216edb18-c5eb-40a3-9a0d-03fd95a65395 req-26a01635-b9c8-4ad1-a184-d226a0d5dc39 service nova] Acquiring lock "ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:56:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-216edb18-c5eb-40a3-9a0d-03fd95a65395 req-26a01635-b9c8-4ad1-a184-d226a0d5dc39 service nova] Lock "ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:56:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-216edb18-c5eb-40a3-9a0d-03fd95a65395 req-26a01635-b9c8-4ad1-a184-d226a0d5dc39 service nova] Lock "ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:56:25 user nova-compute[74247]: DEBUG nova.compute.manager [req-216edb18-c5eb-40a3-9a0d-03fd95a65395 req-26a01635-b9c8-4ad1-a184-d226a0d5dc39 service nova] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] No waiting events found dispatching network-vif-plugged-ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:56:25 user nova-compute[74247]: WARNING nova.compute.manager [req-216edb18-c5eb-40a3-9a0d-03fd95a65395 req-26a01635-b9c8-4ad1-a184-d226a0d5dc39 service nova] [instance: ae0e9df9-8a4e-4de1-8873-2c5cd234c4f6] Received unexpected event network-vif-plugged-ecdaa2b2-4a7b-42d4-930e-7b6fbbe196a1 for instance with vm_state deleted and task_state None.
Oct 16 18:56:29 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:29 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:56:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:56:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:56:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquiring lock "21858df7-6fd1-40cc-8a10-9a3da556907a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:56:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "21858df7-6fd1-40cc-8a10-9a3da556907a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:56:40 user nova-compute[74247]: DEBUG nova.compute.manager [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 18:56:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:56:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:56:40 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:56:40 user nova-compute[74247]: INFO nova.compute.claims [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Claim successful on node user
Oct 16 18:56:40 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:56:40 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:56:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.227s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:56:40 user nova-compute[74247]: DEBUG nova.compute.manager [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 18:56:40 user nova-compute[74247]: DEBUG nova.compute.manager [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 18:56:40 user nova-compute[74247]: DEBUG nova.network.neutron [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 18:56:40 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 18:56:40 user nova-compute[74247]: DEBUG nova.compute.manager [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 18:56:40 user nova-compute[74247]: DEBUG nova.policy [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '82c71a4cbbf8436dbfdc43bb4db65ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6d2ba688434391b03a9f3320a360de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 18:56:40 user nova-compute[74247]: DEBUG nova.compute.manager [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 18:56:40 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:56:40 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Creating image(s)
Oct 16 18:56:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquiring lock "/opt/stack/data/nova/instances/21858df7-6fd1-40cc-8a10-9a3da556907a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:56:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "/opt/stack/data/nova/instances/21858df7-6fd1-40cc-8a10-9a3da556907a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:56:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "/opt/stack/data/nova/instances/21858df7-6fd1-40cc-8a10-9a3da556907a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:56:40 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:56:40 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.176s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:56:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquiring lock "37399febbd18f60b85fd0f833558f6a3539ab231" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:56:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:56:40 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:56:41 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.177s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:56:41 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/21858df7-6fd1-40cc-8a10-9a3da556907a/disk 1073741824 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:56:41 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/21858df7-6fd1-40cc-8a10-9a3da556907a/disk 1073741824" returned: 0 in 0.131s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:56:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.314s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:56:41 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:56:41 user nova-compute[74247]: DEBUG nova.network.neutron [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Successfully created port: 39edf3ea-59f0-4c49-a29a-35891ae05d66 {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:56:41 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.169s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:56:41 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Checking if we can resize image /opt/stack/data/nova/instances/21858df7-6fd1-40cc-8a10-9a3da556907a/disk. size=1073741824 {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 18:56:41 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21858df7-6fd1-40cc-8a10-9a3da556907a/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:56:41 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21858df7-6fd1-40cc-8a10-9a3da556907a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:56:41 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Cannot resize image /opt/stack/data/nova/instances/21858df7-6fd1-40cc-8a10-9a3da556907a/disk to a smaller size. {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 18:56:41 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 18:56:41 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Ensure instance console log exists: /opt/stack/data/nova/instances/21858df7-6fd1-40cc-8a10-9a3da556907a/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:56:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:56:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:56:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:56:41 user nova-compute[74247]: DEBUG nova.network.neutron [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Successfully updated port: 39edf3ea-59f0-4c49-a29a-35891ae05d66 {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:56:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquiring lock "refresh_cache-21858df7-6fd1-40cc-8a10-9a3da556907a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:56:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquired lock "refresh_cache-21858df7-6fd1-40cc-8a10-9a3da556907a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:56:41 user nova-compute[74247]: DEBUG nova.network.neutron [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:56:41 user nova-compute[74247]: DEBUG nova.network.neutron [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:56:41 user nova-compute[74247]: DEBUG nova.compute.manager [req-6bf129b6-a725-4d28-bd06-1fe8dcff4ec2 req-0a8248a0-fca5-4866-9a7c-e27d6d10c34f service nova] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Received event network-changed-39edf3ea-59f0-4c49-a29a-35891ae05d66 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:56:41 user nova-compute[74247]: DEBUG nova.compute.manager [req-6bf129b6-a725-4d28-bd06-1fe8dcff4ec2 req-0a8248a0-fca5-4866-9a7c-e27d6d10c34f service nova] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Refreshing instance network info cache due to event network-changed-39edf3ea-59f0-4c49-a29a-35891ae05d66. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:56:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-6bf129b6-a725-4d28-bd06-1fe8dcff4ec2 req-0a8248a0-fca5-4866-9a7c-e27d6d10c34f service nova] Acquiring lock "refresh_cache-21858df7-6fd1-40cc-8a10-9a3da556907a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG nova.network.neutron [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Updating instance_info_cache with network_info: [{"id": "39edf3ea-59f0-4c49-a29a-35891ae05d66", "address": "fa:16:3e:f0:f7:81", "network": {"id": "14ee32da-d0e3-499f-bd47-721e882b2a57", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-700103883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6d2ba688434391b03a9f3320a360de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39edf3ea-59", "ovs_interfaceid": "39edf3ea-59f0-4c49-a29a-35891ae05d66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Releasing lock "refresh_cache-21858df7-6fd1-40cc-8a10-9a3da556907a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG nova.compute.manager [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Instance network_info: |[{"id": "39edf3ea-59f0-4c49-a29a-35891ae05d66", "address": "fa:16:3e:f0:f7:81", "network": {"id": "14ee32da-d0e3-499f-bd47-721e882b2a57", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-700103883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6d2ba688434391b03a9f3320a360de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39edf3ea-59", "ovs_interfaceid": "39edf3ea-59f0-4c49-a29a-35891ae05d66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-6bf129b6-a725-4d28-bd06-1fe8dcff4ec2 req-0a8248a0-fca5-4866-9a7c-e27d6d10c34f service nova] Acquired lock "refresh_cache-21858df7-6fd1-40cc-8a10-9a3da556907a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG nova.network.neutron [req-6bf129b6-a725-4d28-bd06-1fe8dcff4ec2 req-0a8248a0-fca5-4866-9a7c-e27d6d10c34f service nova] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Refreshing network info cache for port 39edf3ea-59f0-4c49-a29a-35891ae05d66 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Start _get_guest_xml network_info=[{"id": "39edf3ea-59f0-4c49-a29a-35891ae05d66", "address": "fa:16:3e:f0:f7:81", "network": {"id": "14ee32da-d0e3-499f-bd47-721e882b2a57", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-700103883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6d2ba688434391b03a9f3320a360de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39edf3ea-59", "ovs_interfaceid": "39edf3ea-59f0-4c49-a29a-35891ae05d66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': '83126bb1-29f5-42fe-8620-72ab0797f776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:56:42 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:56:42 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:56:42 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:56:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1531065292',display_name='tempest-AttachVolumeTestJSON-server-1531065292',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1531065292',id=43,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJEqzSgXHBN7C+HieFjFe62sYAqeULyzrja3mgIUnaSldFC5YDlqYJCEUBMKNnoZxaUFdxoK3EtY3ZdMUwv1kY2jRpxTxWveDCmqed2My+CAlBHl/kVg7RhGKoufk0XTYg==',key_name='tempest-keypair-947137152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d6d2ba688434391b03a9f3320a360de',ramdisk_id='',reservation_id='r-m0u45cpj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1409761379',owner_user_name='tempest-AttachVolumeTestJSON-1409761379-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:56:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82c71a4cbbf8436dbfdc43bb4db65ef1',uuid=21858df7-6fd1-40cc-8a10-9a3da556907a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39edf3ea-59f0-4c49-a29a-35891ae05d66", "address": "fa:16:3e:f0:f7:81", "network": {"id": "14ee32da-d0e3-499f-bd47-721e882b2a57", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-700103883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6d2ba688434391b03a9f3320a360de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39edf3ea-59", "ovs_interfaceid": "39edf3ea-59f0-4c49-a29a-35891ae05d66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Converting VIF {"id": "39edf3ea-59f0-4c49-a29a-35891ae05d66", "address": "fa:16:3e:f0:f7:81", "network": {"id": "14ee32da-d0e3-499f-bd47-721e882b2a57", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-700103883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6d2ba688434391b03a9f3320a360de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39edf3ea-59", "ovs_interfaceid": "39edf3ea-59f0-4c49-a29a-35891ae05d66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:f7:81,bridge_name='br-int',has_traffic_filtering=True,id=39edf3ea-59f0-4c49-a29a-35891ae05d66,network=Network(14ee32da-d0e3-499f-bd47-721e882b2a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39edf3ea-59') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG nova.objects.instance [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lazy-loading 'pci_devices' on Instance uuid 21858df7-6fd1-40cc-8a10-9a3da556907a {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:56:42 user nova-compute[74247]:   <uuid>21858df7-6fd1-40cc-8a10-9a3da556907a</uuid>
Oct 16 18:56:42 user nova-compute[74247]:   <name>instance-0000002b</name>
Oct 16 18:56:42 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:56:42 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:56:42 user nova-compute[74247]:   <metadata>
Oct 16 18:56:42 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:56:42 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:56:42 user nova-compute[74247]:       <nova:name>tempest-AttachVolumeTestJSON-server-1531065292</nova:name>
Oct 16 18:56:42 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:56:42</nova:creationTime>
Oct 16 18:56:42 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:56:42 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:56:42 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:56:42 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:56:42 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:56:42 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:56:42 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:56:42 user nova-compute[74247]:       <nova:owner>
Oct 16 18:56:42 user nova-compute[74247]:         <nova:user uuid="82c71a4cbbf8436dbfdc43bb4db65ef1">tempest-AttachVolumeTestJSON-1409761379-project-member</nova:user>
Oct 16 18:56:42 user nova-compute[74247]:         <nova:project uuid="1d6d2ba688434391b03a9f3320a360de">tempest-AttachVolumeTestJSON-1409761379</nova:project>
Oct 16 18:56:42 user nova-compute[74247]:       </nova:owner>
Oct 16 18:56:42 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 18:56:42 user nova-compute[74247]:       <nova:ports>
Oct 16 18:56:42 user nova-compute[74247]:         <nova:port uuid="39edf3ea-59f0-4c49-a29a-35891ae05d66">
Oct 16 18:56:42 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 16 18:56:42 user nova-compute[74247]:         </nova:port>
Oct 16 18:56:42 user nova-compute[74247]:       </nova:ports>
Oct 16 18:56:42 user nova-compute[74247]:     </nova:instance>
Oct 16 18:56:42 user nova-compute[74247]:   </metadata>
Oct 16 18:56:42 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:56:42 user nova-compute[74247]:     <system>
Oct 16 18:56:42 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:56:42 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:56:42 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:56:42 user nova-compute[74247]:       <entry name="serial">21858df7-6fd1-40cc-8a10-9a3da556907a</entry>
Oct 16 18:56:42 user nova-compute[74247]:       <entry name="uuid">21858df7-6fd1-40cc-8a10-9a3da556907a</entry>
Oct 16 18:56:42 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:56:42 user nova-compute[74247]:     </system>
Oct 16 18:56:42 user nova-compute[74247]:   </sysinfo>
Oct 16 18:56:42 user nova-compute[74247]:   <os>
Oct 16 18:56:42 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:56:42 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:56:42 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:56:42 user nova-compute[74247]:   </os>
Oct 16 18:56:42 user nova-compute[74247]:   <features>
Oct 16 18:56:42 user nova-compute[74247]:     <acpi/>
Oct 16 18:56:42 user nova-compute[74247]:     <apic/>
Oct 16 18:56:42 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:56:42 user nova-compute[74247]:   </features>
Oct 16 18:56:42 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:56:42 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:56:42 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:56:42 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:56:42 user nova-compute[74247]:   </clock>
Oct 16 18:56:42 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:56:42 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:56:42 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:56:42 user nova-compute[74247]:   </cpu>
Oct 16 18:56:42 user nova-compute[74247]:   <devices>
Oct 16 18:56:42 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 18:56:42 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 18:56:42 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/21858df7-6fd1-40cc-8a10-9a3da556907a/disk"/>
Oct 16 18:56:42 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:56:42 user nova-compute[74247]:     </disk>
Oct 16 18:56:42 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:56:42 user nova-compute[74247]:       <mac address="fa:16:3e:f0:f7:81"/>
Oct 16 18:56:42 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:56:42 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:56:42 user nova-compute[74247]:       <target dev="tap39edf3ea-59"/>
Oct 16 18:56:42 user nova-compute[74247]:     </interface>
Oct 16 18:56:42 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:56:42 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/21858df7-6fd1-40cc-8a10-9a3da556907a/console.log" append="off"/>
Oct 16 18:56:42 user nova-compute[74247]:     </serial>
Oct 16 18:56:42 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:56:42 user nova-compute[74247]:     <video>
Oct 16 18:56:42 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:56:42 user nova-compute[74247]:     </video>
Oct 16 18:56:42 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:56:42 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:56:42 user nova-compute[74247]:     </rng>
Oct 16 18:56:42 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:56:42 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:56:42 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:56:42 user nova-compute[74247]:     </memballoon>
Oct 16 18:56:42 user nova-compute[74247]:   </devices>
Oct 16 18:56:42 user nova-compute[74247]: </domain>
Oct 16 18:56:42 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:56:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1531065292',display_name='tempest-AttachVolumeTestJSON-server-1531065292',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1531065292',id=43,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJEqzSgXHBN7C+HieFjFe62sYAqeULyzrja3mgIUnaSldFC5YDlqYJCEUBMKNnoZxaUFdxoK3EtY3ZdMUwv1kY2jRpxTxWveDCmqed2My+CAlBHl/kVg7RhGKoufk0XTYg==',key_name='tempest-keypair-947137152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d6d2ba688434391b03a9f3320a360de',ramdisk_id='',reservation_id='r-m0u45cpj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1409761379',owner_user_name='tempest-AttachVolumeTestJSON-1409761379-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:56:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82c71a4cbbf8436dbfdc43bb4db65ef1',uuid=21858df7-6fd1-40cc-8a10-9a3da556907a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39edf3ea-59f0-4c49-a29a-35891ae05d66", "address": "fa:16:3e:f0:f7:81", "network": {"id": "14ee32da-d0e3-499f-bd47-721e882b2a57", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-700103883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6d2ba688434391b03a9f3320a360de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39edf3ea-59", "ovs_interfaceid": "39edf3ea-59f0-4c49-a29a-35891ae05d66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Converting VIF {"id": "39edf3ea-59f0-4c49-a29a-35891ae05d66", "address": "fa:16:3e:f0:f7:81", "network": {"id": "14ee32da-d0e3-499f-bd47-721e882b2a57", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-700103883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6d2ba688434391b03a9f3320a360de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39edf3ea-59", "ovs_interfaceid": "39edf3ea-59f0-4c49-a29a-35891ae05d66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:f7:81,bridge_name='br-int',has_traffic_filtering=True,id=39edf3ea-59f0-4c49-a29a-35891ae05d66,network=Network(14ee32da-d0e3-499f-bd47-721e882b2a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39edf3ea-59') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG os_vif [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:f7:81,bridge_name='br-int',has_traffic_filtering=True,id=39edf3ea-59f0-4c49-a29a-35891ae05d66,network=Network(14ee32da-d0e3-499f-bd47-721e882b2a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39edf3ea-59') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c25a37f0-b0a5-5914-98f6-c51e31f1bed8', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap39edf3ea-59, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap39edf3ea-59, col_values=(('qos', UUID('76c81754-b79c-439f-a3ec-954d4ce316ca')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap39edf3ea-59, col_values=(('external_ids', {'iface-id': '39edf3ea-59f0-4c49-a29a-35891ae05d66', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:f7:81', 'vm-uuid': '21858df7-6fd1-40cc-8a10-9a3da556907a'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:42 user nova-compute[74247]: INFO os_vif [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:f7:81,bridge_name='br-int',has_traffic_filtering=True,id=39edf3ea-59f0-4c49-a29a-35891ae05d66,network=Network(14ee32da-d0e3-499f-bd47-721e882b2a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39edf3ea-59')
Oct 16 18:56:42 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] No VIF found with MAC fa:16:3e:f0:f7:81, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG nova.network.neutron [req-6bf129b6-a725-4d28-bd06-1fe8dcff4ec2 req-0a8248a0-fca5-4866-9a7c-e27d6d10c34f service nova] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Updated VIF entry in instance network info cache for port 39edf3ea-59f0-4c49-a29a-35891ae05d66. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG nova.network.neutron [req-6bf129b6-a725-4d28-bd06-1fe8dcff4ec2 req-0a8248a0-fca5-4866-9a7c-e27d6d10c34f service nova] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Updating instance_info_cache with network_info: [{"id": "39edf3ea-59f0-4c49-a29a-35891ae05d66", "address": "fa:16:3e:f0:f7:81", "network": {"id": "14ee32da-d0e3-499f-bd47-721e882b2a57", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-700103883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6d2ba688434391b03a9f3320a360de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39edf3ea-59", "ovs_interfaceid": "39edf3ea-59f0-4c49-a29a-35891ae05d66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:56:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-6bf129b6-a725-4d28-bd06-1fe8dcff4ec2 req-0a8248a0-fca5-4866-9a7c-e27d6d10c34f service nova] Releasing lock "refresh_cache-21858df7-6fd1-40cc-8a10-9a3da556907a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:56:43 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:43 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:43 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:43 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:43 user nova-compute[74247]: DEBUG nova.compute.manager [req-e5629925-069b-40b8-8a95-6c1592f83f8e req-41f01910-460f-4cf6-badb-02d382dc3a21 service nova] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Received event network-vif-plugged-39edf3ea-59f0-4c49-a29a-35891ae05d66 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:56:43 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e5629925-069b-40b8-8a95-6c1592f83f8e req-41f01910-460f-4cf6-badb-02d382dc3a21 service nova] Acquiring lock "21858df7-6fd1-40cc-8a10-9a3da556907a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:56:43 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e5629925-069b-40b8-8a95-6c1592f83f8e req-41f01910-460f-4cf6-badb-02d382dc3a21 service nova] Lock "21858df7-6fd1-40cc-8a10-9a3da556907a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:56:43 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e5629925-069b-40b8-8a95-6c1592f83f8e req-41f01910-460f-4cf6-badb-02d382dc3a21 service nova] Lock "21858df7-6fd1-40cc-8a10-9a3da556907a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:56:43 user nova-compute[74247]: DEBUG nova.compute.manager [req-e5629925-069b-40b8-8a95-6c1592f83f8e req-41f01910-460f-4cf6-badb-02d382dc3a21 service nova] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] No waiting events found dispatching network-vif-plugged-39edf3ea-59f0-4c49-a29a-35891ae05d66 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:56:43 user nova-compute[74247]: WARNING nova.compute.manager [req-e5629925-069b-40b8-8a95-6c1592f83f8e req-41f01910-460f-4cf6-badb-02d382dc3a21 service nova] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Received unexpected event network-vif-plugged-39edf3ea-59f0-4c49-a29a-35891ae05d66 for instance with vm_state building and task_state spawning.
Oct 16 18:56:44 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:44 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:44 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:45 user nova-compute[74247]: DEBUG nova.compute.manager [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:56:45 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:56:45 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Instance spawned successfully.
Oct 16 18:56:45 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 18:56:45 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:56:45 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:56:45 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:56:45 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:56:45 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:56:45 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:56:45 user nova-compute[74247]: INFO nova.compute.manager [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Took 5.15 seconds to spawn the instance on the hypervisor.
Oct 16 18:56:45 user nova-compute[74247]: DEBUG nova.compute.manager [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:56:45 user nova-compute[74247]: INFO nova.compute.manager [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Took 5.70 seconds to build instance.
Oct 16 18:56:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e3195ac4-00e8-4d11-98b0-ddffd0e7b2f1 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "21858df7-6fd1-40cc-8a10-9a3da556907a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.803s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:56:45 user nova-compute[74247]: DEBUG nova.compute.manager [req-843f8089-7a24-4e08-a8c5-61bfb540d1ca req-32e47358-b39f-4241-89c6-eef78ed54696 service nova] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Received event network-vif-plugged-39edf3ea-59f0-4c49-a29a-35891ae05d66 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:56:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-843f8089-7a24-4e08-a8c5-61bfb540d1ca req-32e47358-b39f-4241-89c6-eef78ed54696 service nova] Acquiring lock "21858df7-6fd1-40cc-8a10-9a3da556907a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:56:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-843f8089-7a24-4e08-a8c5-61bfb540d1ca req-32e47358-b39f-4241-89c6-eef78ed54696 service nova] Lock "21858df7-6fd1-40cc-8a10-9a3da556907a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:56:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-843f8089-7a24-4e08-a8c5-61bfb540d1ca req-32e47358-b39f-4241-89c6-eef78ed54696 service nova] Lock "21858df7-6fd1-40cc-8a10-9a3da556907a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:56:46 user nova-compute[74247]: DEBUG nova.compute.manager [req-843f8089-7a24-4e08-a8c5-61bfb540d1ca req-32e47358-b39f-4241-89c6-eef78ed54696 service nova] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] No waiting events found dispatching network-vif-plugged-39edf3ea-59f0-4c49-a29a-35891ae05d66 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:56:46 user nova-compute[74247]: WARNING nova.compute.manager [req-843f8089-7a24-4e08-a8c5-61bfb540d1ca req-32e47358-b39f-4241-89c6-eef78ed54696 service nova] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Received unexpected event network-vif-plugged-39edf3ea-59f0-4c49-a29a-35891ae05d66 for instance with vm_state active and task_state None.
Oct 16 18:56:46 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:52 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:56:52 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:52 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 18:56:52 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 18:56:52 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 18:56:52 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:56:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:57:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:57:02 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:57:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "75e5e67a-3e02-4bc4-8e28-04125d32c6e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:57:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "75e5e67a-3e02-4bc4-8e28-04125d32c6e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:57:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "75e5e67a-3e02-4bc4-8e28-04125d32c6e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:57:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "75e5e67a-3e02-4bc4-8e28-04125d32c6e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:57:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "75e5e67a-3e02-4bc4-8e28-04125d32c6e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:57:02 user nova-compute[74247]: INFO nova.compute.manager [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Terminating instance
Oct 16 18:57:02 user nova-compute[74247]: DEBUG nova.compute.manager [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 18:57:02 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:57:02 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:57:02 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:57:02 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG nova.compute.manager [req-b0cf903b-6e73-4ebb-9443-26e56e38d3fc req-830bfe80-0f8c-429b-9077-d864f0a17a1e service nova] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Received event network-vif-unplugged-fee1b802-a163-42e1-8262-e5553f847cb8 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-b0cf903b-6e73-4ebb-9443-26e56e38d3fc req-830bfe80-0f8c-429b-9077-d864f0a17a1e service nova] Acquiring lock "75e5e67a-3e02-4bc4-8e28-04125d32c6e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-b0cf903b-6e73-4ebb-9443-26e56e38d3fc req-830bfe80-0f8c-429b-9077-d864f0a17a1e service nova] Lock "75e5e67a-3e02-4bc4-8e28-04125d32c6e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-b0cf903b-6e73-4ebb-9443-26e56e38d3fc req-830bfe80-0f8c-429b-9077-d864f0a17a1e service nova] Lock "75e5e67a-3e02-4bc4-8e28-04125d32c6e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG nova.compute.manager [req-b0cf903b-6e73-4ebb-9443-26e56e38d3fc req-830bfe80-0f8c-429b-9077-d864f0a17a1e service nova] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] No waiting events found dispatching network-vif-unplugged-fee1b802-a163-42e1-8262-e5553f847cb8 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG nova.compute.manager [req-b0cf903b-6e73-4ebb-9443-26e56e38d3fc req-830bfe80-0f8c-429b-9077-d864f0a17a1e service nova] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Received event network-vif-unplugged-fee1b802-a163-42e1-8262-e5553f847cb8 for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:57:03 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Instance destroyed successfully.
Oct 16 18:57:03 user nova-compute[74247]: DEBUG nova.objects.instance [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lazy-loading 'resources' on Instance uuid 75e5e67a-3e02-4bc4-8e28-04125d32c6e9 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:52:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1975418206',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1975418206',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1975418206',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpiMU33jnpS+L2JxWC8FEv2iwcfNEMgEjHfwHxWgFPj4+NrGnOYH5UuinYTvQJL19+ev+y0UnbjN1D2cdq3wWZnNdns4J5aOFbJjCk3sUrzEU+ID89gy8BtFJIEOrsmeA==',key_name='tempest-keypair-1736404231',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:52:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dca6144ea4e14c28b085e271175bbf67',ramdisk_id='',reservation_id='r-wdcq3l8h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1733357121',owner_user_name='tempest-TestVolumeBootPattern-1733357121-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:52:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9608bf58b70248439dbbcc9db38fba08',uuid=75e5e67a-3e02-4bc4-8e28-04125d32c6e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fee1b802-a163-42e1-8262-e5553f847cb8", "address": "fa:16:3e:0f:b4:9a", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee1b802-a1", "ovs_interfaceid": "fee1b802-a163-42e1-8262-e5553f847cb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Converting VIF {"id": "fee1b802-a163-42e1-8262-e5553f847cb8", "address": "fa:16:3e:0f:b4:9a", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee1b802-a1", "ovs_interfaceid": "fee1b802-a163-42e1-8262-e5553f847cb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:b4:9a,bridge_name='br-int',has_traffic_filtering=True,id=fee1b802-a163-42e1-8262-e5553f847cb8,network=Network(9688c665-d4b7-4179-9a76-fdf6c3013b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfee1b802-a1') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG os_vif [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:b4:9a,bridge_name='br-int',has_traffic_filtering=True,id=fee1b802-a163-42e1-8262-e5553f847cb8,network=Network(9688c665-d4b7-4179-9a76-fdf6c3013b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfee1b802-a1') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfee1b802-a1, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b023ae17-1f23-47b3-8ae3-020e835375a9) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:57:03 user nova-compute[74247]: INFO os_vif [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:b4:9a,bridge_name='br-int',has_traffic_filtering=True,id=fee1b802-a163-42e1-8262-e5553f847cb8,network=Network(9688c665-d4b7-4179-9a76-fdf6c3013b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfee1b802-a1')
Oct 16 18:57:03 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qePKIuBF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:57:03 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:57:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e319b9-3297-4846-8e50-545f5ededa03]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:095ceb95-19ce-49b3-8ba9-4f8b719860a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca4d1e22-785a-41da-bff6-ddf5553e82f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 18:57:03 user nova-compute[74247]: No targets found.
Oct 16 18:57:03 user nova-compute[74247]: iSNS:
Oct 16 18:57:03 user nova-compute[74247]: No targets found.
Oct 16 18:57:03 user nova-compute[74247]: STATIC:
Oct 16 18:57:03 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc
Oct 16 18:57:03 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:57:03 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:57:03 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:095ceb95-19ce-49b3-8ba9-4f8b719860a3
Oct 16 18:57:03 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:57:03 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:57:03 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:ca4d1e22-785a-41da-bff6-ddf5553e82f9
Oct 16 18:57:03 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:57:03 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:57:03 user nova-compute[74247]: FIRMWARE:
Oct 16 18:57:03 user nova-compute[74247]: No targets found.
Oct 16 18:57:03 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 18:57:03 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 18:57:03 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.033s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d6ed6e-d1b7-484a-bd68-e1a910833dd1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:095ceb95-19ce-49b3-8ba9-4f8b719860a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca4d1e22-785a-41da-bff6-ddf5553e82f9\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[18089636-daab-45d4-a3b0-bd5bee7ddcc7]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4d1e22-785a-41da-bff6-ddf5553e82f9 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:095ceb95-19ce-49b3-8ba9-4f8b719860a3 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc (non-flash)
Oct 16 18:57:03 user nova-compute[74247]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4d1e22-785a-41da-bff6-ddf5553e82f9 (non-flash)
Oct 16 18:57:03 user nova-compute[74247]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:095ceb95-19ce-49b3-8ba9-4f8b719860a3 (non-flash)
Oct 16 18:57:03 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc (non-flash)
Oct 16 18:57:03 user nova-compute[74247]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4d1e22-785a-41da-bff6-ddf5553e82f9 (non-flash)
Oct 16 18:57:03 user nova-compute[74247]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:095ceb95-19ce-49b3-8ba9-4f8b719860a3 (non-flash)
Oct 16 18:57:03 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe068212440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc'): ({'sdb'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Removing single pathed devices sdb {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f33c49-bbf1-419c-b2cd-144b235ca587]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.032s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8438b7d-406a-46fc-949e-13a0ff7bb6e1]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Flushing IO for device /dev/sdb {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c24df4-0d4f-470e-81bf-4707a16b547f]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.080s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2482fab3-5631-43c4-95a6-250e5d07d346]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] SCSI volumes sdb have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26537653161343066', '/dev/disk/by-id/scsi-1SCST_BIOdc351af3-e7e1a40f61e762b5', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_dc351af3') {{(pid=85128) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[03abf14d-c62f-4bd1-b4f6-fe16407802ea]: (4, None) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fca403e-fbc7-44e3-9390-21bd10e3f3f0]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:57:03 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:57:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:57:04 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea85a25-d469-443a-8527-df042c39b63b]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:57:04 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc, portal: 172.16.0.220,3260]
Oct 16 18:57:04 user nova-compute[74247]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc, portal: 172.16.0.220,3260] successful.
Oct 16 18:57:04 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:57:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:57:04 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fe1e4f8-289f-4932-a993-19d652c7f5dc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:57:04 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd3b020-c921-4689-a4a4-83207e80854d]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:57:04 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:57:04 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.463s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:57:04 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] <== disconnect_volume: return (464ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:57:04 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 18:57:04 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Deleting instance files /opt/stack/data/nova/instances/75e5e67a-3e02-4bc4-8e28-04125d32c6e9_del
Oct 16 18:57:04 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Deletion of /opt/stack/data/nova/instances/75e5e67a-3e02-4bc4-8e28-04125d32c6e9_del complete
Oct 16 18:57:04 user nova-compute[74247]: INFO nova.compute.manager [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Took 1.49 seconds to destroy the instance on the hypervisor.
Oct 16 18:57:04 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 18:57:04 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 18:57:04 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 18:57:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:57:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:57:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:57:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:57:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:57:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-06c7a22f-fd9d-424a-bef1-8d3654c2c42e req-6f2bcfa9-c22a-4c77-b544-608ebcb8a998 service nova] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Received event network-vif-plugged-fee1b802-a163-42e1-8262-e5553f847cb8 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:57:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-06c7a22f-fd9d-424a-bef1-8d3654c2c42e req-6f2bcfa9-c22a-4c77-b544-608ebcb8a998 service nova] Acquiring lock "75e5e67a-3e02-4bc4-8e28-04125d32c6e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:57:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-06c7a22f-fd9d-424a-bef1-8d3654c2c42e req-6f2bcfa9-c22a-4c77-b544-608ebcb8a998 service nova] Lock "75e5e67a-3e02-4bc4-8e28-04125d32c6e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:57:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-06c7a22f-fd9d-424a-bef1-8d3654c2c42e req-6f2bcfa9-c22a-4c77-b544-608ebcb8a998 service nova] Lock "75e5e67a-3e02-4bc4-8e28-04125d32c6e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:57:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-06c7a22f-fd9d-424a-bef1-8d3654c2c42e req-6f2bcfa9-c22a-4c77-b544-608ebcb8a998 service nova] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] No waiting events found dispatching network-vif-plugged-fee1b802-a163-42e1-8262-e5553f847cb8 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:57:05 user nova-compute[74247]: WARNING nova.compute.manager [req-06c7a22f-fd9d-424a-bef1-8d3654c2c42e req-6f2bcfa9-c22a-4c77-b544-608ebcb8a998 service nova] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Received unexpected event network-vif-plugged-fee1b802-a163-42e1-8262-e5553f847cb8 for instance with vm_state active and task_state deleting.
Oct 16 18:57:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-06c7a22f-fd9d-424a-bef1-8d3654c2c42e req-6f2bcfa9-c22a-4c77-b544-608ebcb8a998 service nova] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Received event network-vif-plugged-fee1b802-a163-42e1-8262-e5553f847cb8 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:57:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-06c7a22f-fd9d-424a-bef1-8d3654c2c42e req-6f2bcfa9-c22a-4c77-b544-608ebcb8a998 service nova] Acquiring lock "75e5e67a-3e02-4bc4-8e28-04125d32c6e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:57:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-06c7a22f-fd9d-424a-bef1-8d3654c2c42e req-6f2bcfa9-c22a-4c77-b544-608ebcb8a998 service nova] Lock "75e5e67a-3e02-4bc4-8e28-04125d32c6e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:57:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-06c7a22f-fd9d-424a-bef1-8d3654c2c42e req-6f2bcfa9-c22a-4c77-b544-608ebcb8a998 service nova] Lock "75e5e67a-3e02-4bc4-8e28-04125d32c6e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:57:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-06c7a22f-fd9d-424a-bef1-8d3654c2c42e req-6f2bcfa9-c22a-4c77-b544-608ebcb8a998 service nova] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] No waiting events found dispatching network-vif-plugged-fee1b802-a163-42e1-8262-e5553f847cb8 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:57:05 user nova-compute[74247]: WARNING nova.compute.manager [req-06c7a22f-fd9d-424a-bef1-8d3654c2c42e req-6f2bcfa9-c22a-4c77-b544-608ebcb8a998 service nova] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Received unexpected event network-vif-plugged-fee1b802-a163-42e1-8262-e5553f847cb8 for instance with vm_state active and task_state deleting.
Oct 16 18:57:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-06c7a22f-fd9d-424a-bef1-8d3654c2c42e req-6f2bcfa9-c22a-4c77-b544-608ebcb8a998 service nova] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Received event network-vif-plugged-fee1b802-a163-42e1-8262-e5553f847cb8 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:57:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-06c7a22f-fd9d-424a-bef1-8d3654c2c42e req-6f2bcfa9-c22a-4c77-b544-608ebcb8a998 service nova] Acquiring lock "75e5e67a-3e02-4bc4-8e28-04125d32c6e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:57:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-06c7a22f-fd9d-424a-bef1-8d3654c2c42e req-6f2bcfa9-c22a-4c77-b544-608ebcb8a998 service nova] Lock "75e5e67a-3e02-4bc4-8e28-04125d32c6e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:57:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-06c7a22f-fd9d-424a-bef1-8d3654c2c42e req-6f2bcfa9-c22a-4c77-b544-608ebcb8a998 service nova] Lock "75e5e67a-3e02-4bc4-8e28-04125d32c6e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:57:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-06c7a22f-fd9d-424a-bef1-8d3654c2c42e req-6f2bcfa9-c22a-4c77-b544-608ebcb8a998 service nova] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] No waiting events found dispatching network-vif-plugged-fee1b802-a163-42e1-8262-e5553f847cb8 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:57:05 user nova-compute[74247]: WARNING nova.compute.manager [req-06c7a22f-fd9d-424a-bef1-8d3654c2c42e req-6f2bcfa9-c22a-4c77-b544-608ebcb8a998 service nova] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Received unexpected event network-vif-plugged-fee1b802-a163-42e1-8262-e5553f847cb8 for instance with vm_state active and task_state deleting.
Oct 16 18:57:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-06c7a22f-fd9d-424a-bef1-8d3654c2c42e req-6f2bcfa9-c22a-4c77-b544-608ebcb8a998 service nova] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Received event network-vif-unplugged-fee1b802-a163-42e1-8262-e5553f847cb8 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:57:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-06c7a22f-fd9d-424a-bef1-8d3654c2c42e req-6f2bcfa9-c22a-4c77-b544-608ebcb8a998 service nova] Acquiring lock "75e5e67a-3e02-4bc4-8e28-04125d32c6e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:57:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-06c7a22f-fd9d-424a-bef1-8d3654c2c42e req-6f2bcfa9-c22a-4c77-b544-608ebcb8a998 service nova] Lock "75e5e67a-3e02-4bc4-8e28-04125d32c6e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:57:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-06c7a22f-fd9d-424a-bef1-8d3654c2c42e req-6f2bcfa9-c22a-4c77-b544-608ebcb8a998 service nova] Lock "75e5e67a-3e02-4bc4-8e28-04125d32c6e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:57:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-06c7a22f-fd9d-424a-bef1-8d3654c2c42e req-6f2bcfa9-c22a-4c77-b544-608ebcb8a998 service nova] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] No waiting events found dispatching network-vif-unplugged-fee1b802-a163-42e1-8262-e5553f847cb8 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:57:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-06c7a22f-fd9d-424a-bef1-8d3654c2c42e req-6f2bcfa9-c22a-4c77-b544-608ebcb8a998 service nova] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Received event network-vif-unplugged-fee1b802-a163-42e1-8262-e5553f847cb8 for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 18:57:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-06c7a22f-fd9d-424a-bef1-8d3654c2c42e req-6f2bcfa9-c22a-4c77-b544-608ebcb8a998 service nova] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Received event network-vif-plugged-fee1b802-a163-42e1-8262-e5553f847cb8 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:57:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-06c7a22f-fd9d-424a-bef1-8d3654c2c42e req-6f2bcfa9-c22a-4c77-b544-608ebcb8a998 service nova] Acquiring lock "75e5e67a-3e02-4bc4-8e28-04125d32c6e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:57:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-06c7a22f-fd9d-424a-bef1-8d3654c2c42e req-6f2bcfa9-c22a-4c77-b544-608ebcb8a998 service nova] Lock "75e5e67a-3e02-4bc4-8e28-04125d32c6e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:57:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-06c7a22f-fd9d-424a-bef1-8d3654c2c42e req-6f2bcfa9-c22a-4c77-b544-608ebcb8a998 service nova] Lock "75e5e67a-3e02-4bc4-8e28-04125d32c6e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:57:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-06c7a22f-fd9d-424a-bef1-8d3654c2c42e req-6f2bcfa9-c22a-4c77-b544-608ebcb8a998 service nova] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] No waiting events found dispatching network-vif-plugged-fee1b802-a163-42e1-8262-e5553f847cb8 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:57:05 user nova-compute[74247]: WARNING nova.compute.manager [req-06c7a22f-fd9d-424a-bef1-8d3654c2c42e req-6f2bcfa9-c22a-4c77-b544-608ebcb8a998 service nova] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Received unexpected event network-vif-plugged-fee1b802-a163-42e1-8262-e5553f847cb8 for instance with vm_state active and task_state deleting.
Oct 16 18:57:05 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:57:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-a92695a5-3918-43cd-a422-acf9a72eab89 req-e107a6dd-26b7-4e86-8d0a-a603067bac78 service nova] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Received event network-vif-deleted-fee1b802-a163-42e1-8262-e5553f847cb8 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:57:05 user nova-compute[74247]: INFO nova.compute.manager [req-a92695a5-3918-43cd-a422-acf9a72eab89 req-e107a6dd-26b7-4e86-8d0a-a603067bac78 service nova] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Neutron deleted interface fee1b802-a163-42e1-8262-e5553f847cb8; detaching it from the instance and deleting it from the info cache
Oct 16 18:57:05 user nova-compute[74247]: DEBUG nova.network.neutron [req-a92695a5-3918-43cd-a422-acf9a72eab89 req-e107a6dd-26b7-4e86-8d0a-a603067bac78 service nova] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:57:05 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Took 1.14 seconds to deallocate network for instance.
Oct 16 18:57:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-a92695a5-3918-43cd-a422-acf9a72eab89 req-e107a6dd-26b7-4e86-8d0a-a603067bac78 service nova] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Detach interface failed, port_id=fee1b802-a163-42e1-8262-e5553f847cb8, reason: Instance 75e5e67a-3e02-4bc4-8e28-04125d32c6e9 could not be found. {{(pid=74247) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 18:57:06 user nova-compute[74247]: INFO nova.compute.manager [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Took 1.03 seconds to detach 1 volumes for instance.
Oct 16 18:57:06 user nova-compute[74247]: DEBUG nova.compute.manager [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: 75e5e67a-3e02-4bc4-8e28-04125d32c6e9] Deleting volume: 9fe1e4f8-289f-4932-a993-19d652c7f5dc {{(pid=74247) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 16 18:57:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:57:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:57:06 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:57:06 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:57:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.172s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:57:06 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Deleted allocations for instance 75e5e67a-3e02-4bc4-8e28-04125d32c6e9
Oct 16 18:57:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3ec3dde0-f6e1-4691-b54e-81a2a4ec709f tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "75e5e67a-3e02-4bc4-8e28-04125d32c6e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.157s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:57:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:57:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:57:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:57:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:57:16 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:57:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:57:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:57:18 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:57:20 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:57:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:57:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:57:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:57:20 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 18:57:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21858df7-6fd1-40cc-8a10-9a3da556907a/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:57:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21858df7-6fd1-40cc-8a10-9a3da556907a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:57:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21858df7-6fd1-40cc-8a10-9a3da556907a/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:57:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21858df7-6fd1-40cc-8a10-9a3da556907a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:57:21 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:57:21 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:57:21 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=8710MB free_disk=25.011985778808594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 18:57:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:57:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:57:21 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 21858df7-6fd1-40cc-8a10-9a3da556907a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:57:21 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 18:57:21 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 18:57:21 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:57:21 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:57:21 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 18:57:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:57:22 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:57:22 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 18:57:22 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Rebuilding the list of instances to heal {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 18:57:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "refresh_cache-21858df7-6fd1-40cc-8a10-9a3da556907a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:57:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquired lock "refresh_cache-21858df7-6fd1-40cc-8a10-9a3da556907a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:57:22 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Forcefully refreshing network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 18:57:22 user nova-compute[74247]: DEBUG nova.objects.instance [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lazy-loading 'info_cache' on Instance uuid 21858df7-6fd1-40cc-8a10-9a3da556907a {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:57:23 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Updating instance_info_cache with network_info: [{"id": "39edf3ea-59f0-4c49-a29a-35891ae05d66", "address": "fa:16:3e:f0:f7:81", "network": {"id": "14ee32da-d0e3-499f-bd47-721e882b2a57", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-700103883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6d2ba688434391b03a9f3320a360de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39edf3ea-59", "ovs_interfaceid": "39edf3ea-59f0-4c49-a29a-35891ae05d66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:57:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Releasing lock "refresh_cache-21858df7-6fd1-40cc-8a10-9a3da556907a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:57:23 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Updated the network info_cache for instance {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 18:57:23 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:57:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:57:25 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:57:25 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:57:25 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 18:57:27 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:57:28 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:57:28 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:57:28 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 18:57:28 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 18:57:28 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 18:57:28 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:57:30 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:57:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:57:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:57:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:57:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 18:57:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 18:57:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 18:57:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:57:43 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:57:48 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:57:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:57:54 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:57:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:58:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:58:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:58:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:58:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:58:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:58:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "e32e77fe-e842-433a-afa8-7d5a1f2c520c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:58:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "e32e77fe-e842-433a-afa8-7d5a1f2c520c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:58:13 user nova-compute[74247]: DEBUG nova.compute.manager [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 18:58:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:58:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:58:13 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:58:13 user nova-compute[74247]: INFO nova.compute.claims [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Claim successful on node user
Oct 16 18:58:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:58:14 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:58:14 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:58:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.272s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:58:14 user nova-compute[74247]: DEBUG nova.compute.manager [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 18:58:14 user nova-compute[74247]: DEBUG nova.compute.manager [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 18:58:14 user nova-compute[74247]: DEBUG nova.network.neutron [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 18:58:14 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 18:58:14 user nova-compute[74247]: DEBUG nova.compute.manager [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 18:58:14 user nova-compute[74247]: DEBUG nova.policy [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9608bf58b70248439dbbcc9db38fba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6144ea4e14c28b085e271175bbf67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 18:58:14 user nova-compute[74247]: INFO nova.virt.block_device [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Booting with volume 16745855-2614-4ce8-a013-451d116c1dec at /dev/vda
Oct 16 18:58:14 user nova-compute[74247]: DEBUG os_brick.utils [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:58:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:58:14 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[368bb5d2-8a76-4aaa-bb5f-20696cf4fca9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:58:14 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbe0a62-3745-4dc2-9ae1-d67b166194cc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:58:14 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[85cc2edd-7827-4f0f-b68a-98af27af907d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:14 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72a6baa-83b8-42c2-b5c9-0083e3b33d9c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:58:14 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 18:58:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:58:14 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 18:58:14 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4baa2b00-3c2e-41b6-8be4-3651b590bc2e]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:14 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 18:58:14 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 18:58:14 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 18:58:14 user nova-compute[74247]: DEBUG os_brick.utils [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:58:14 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Updating existing volume attachment record: 43e37110-baef-4be6-82e5-4700f752d0c3 {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 18:58:15 user nova-compute[74247]: DEBUG nova.network.neutron [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Successfully created port: bfe88395-ff2c-4fc3-bf1d-b4e165044b8a {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:58:15 user nova-compute[74247]: DEBUG nova.network.neutron [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Successfully updated port: bfe88395-ff2c-4fc3-bf1d-b4e165044b8a {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:58:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "refresh_cache-e32e77fe-e842-433a-afa8-7d5a1f2c520c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:58:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquired lock "refresh_cache-e32e77fe-e842-433a-afa8-7d5a1f2c520c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:58:15 user nova-compute[74247]: DEBUG nova.network.neutron [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:58:15 user nova-compute[74247]: DEBUG nova.compute.manager [req-813bd577-8340-4c33-9c26-aa44e49a31d2 req-c6ac1c34-3836-42af-badf-b88a4b66d449 service nova] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Received event network-changed-bfe88395-ff2c-4fc3-bf1d-b4e165044b8a {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:58:15 user nova-compute[74247]: DEBUG nova.compute.manager [req-813bd577-8340-4c33-9c26-aa44e49a31d2 req-c6ac1c34-3836-42af-badf-b88a4b66d449 service nova] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Refreshing instance network info cache due to event network-changed-bfe88395-ff2c-4fc3-bf1d-b4e165044b8a. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:58:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-813bd577-8340-4c33-9c26-aa44e49a31d2 req-c6ac1c34-3836-42af-badf-b88a4b66d449 service nova] Acquiring lock "refresh_cache-e32e77fe-e842-433a-afa8-7d5a1f2c520c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:58:15 user nova-compute[74247]: DEBUG nova.network.neutron [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:58:16 user nova-compute[74247]: DEBUG nova.network.neutron [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Updating instance_info_cache with network_info: [{"id": "bfe88395-ff2c-4fc3-bf1d-b4e165044b8a", "address": "fa:16:3e:e6:e4:9f", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe88395-ff", "ovs_interfaceid": "bfe88395-ff2c-4fc3-bf1d-b4e165044b8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:58:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Releasing lock "refresh_cache-e32e77fe-e842-433a-afa8-7d5a1f2c520c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:58:16 user nova-compute[74247]: DEBUG nova.compute.manager [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Instance network_info: |[{"id": "bfe88395-ff2c-4fc3-bf1d-b4e165044b8a", "address": "fa:16:3e:e6:e4:9f", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe88395-ff", "ovs_interfaceid": "bfe88395-ff2c-4fc3-bf1d-b4e165044b8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 18:58:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-813bd577-8340-4c33-9c26-aa44e49a31d2 req-c6ac1c34-3836-42af-badf-b88a4b66d449 service nova] Acquired lock "refresh_cache-e32e77fe-e842-433a-afa8-7d5a1f2c520c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:58:16 user nova-compute[74247]: DEBUG nova.network.neutron [req-813bd577-8340-4c33-9c26-aa44e49a31d2 req-c6ac1c34-3836-42af-badf-b88a4b66d449 service nova] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Refreshing network info cache for port bfe88395-ff2c-4fc3-bf1d-b4e165044b8a {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:58:16 user nova-compute[74247]: DEBUG nova.network.neutron [req-813bd577-8340-4c33-9c26-aa44e49a31d2 req-c6ac1c34-3836-42af-badf-b88a4b66d449 service nova] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Updated VIF entry in instance network info cache for port bfe88395-ff2c-4fc3-bf1d-b4e165044b8a. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:58:16 user nova-compute[74247]: DEBUG nova.network.neutron [req-813bd577-8340-4c33-9c26-aa44e49a31d2 req-c6ac1c34-3836-42af-badf-b88a4b66d449 service nova] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Updating instance_info_cache with network_info: [{"id": "bfe88395-ff2c-4fc3-bf1d-b4e165044b8a", "address": "fa:16:3e:e6:e4:9f", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe88395-ff", "ovs_interfaceid": "bfe88395-ff2c-4fc3-bf1d-b4e165044b8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:58:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-813bd577-8340-4c33-9c26-aa44e49a31d2 req-c6ac1c34-3836-42af-badf-b88a4b66d449 service nova] Releasing lock "refresh_cache-e32e77fe-e842-433a-afa8-7d5a1f2c520c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:58:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:58:17 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:58:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:58:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:58:18 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:58:19 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:58:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:58:20 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:58:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:58:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:58:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:58:20 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 18:58:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21858df7-6fd1-40cc-8a10-9a3da556907a/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21858df7-6fd1-40cc-8a10-9a3da556907a/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:58:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21858df7-6fd1-40cc-8a10-9a3da556907a/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21858df7-6fd1-40cc-8a10-9a3da556907a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:58:21 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:58:21 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:58:21 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=8815MB free_disk=24.99985122680664GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 18:58:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:58:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:58:21 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 21858df7-6fd1-40cc-8a10-9a3da556907a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:58:21 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance e32e77fe-e842-433a-afa8-7d5a1f2c520c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:58:21 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 18:58:21 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 18:58:21 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:58:21 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:58:21 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 18:58:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.219s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:58:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:58:22 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:58:22 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 18:58:22 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Rebuilding the list of instances to heal {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 18:58:22 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Skipping network cache update for instance because it is Building. {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 16 18:58:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "refresh_cache-21858df7-6fd1-40cc-8a10-9a3da556907a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:58:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquired lock "refresh_cache-21858df7-6fd1-40cc-8a10-9a3da556907a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:58:22 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Forcefully refreshing network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 18:58:22 user nova-compute[74247]: DEBUG nova.objects.instance [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lazy-loading 'info_cache' on Instance uuid 21858df7-6fd1-40cc-8a10-9a3da556907a {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:58:23 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Updating instance_info_cache with network_info: [{"id": "39edf3ea-59f0-4c49-a29a-35891ae05d66", "address": "fa:16:3e:f0:f7:81", "network": {"id": "14ee32da-d0e3-499f-bd47-721e882b2a57", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-700103883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6d2ba688434391b03a9f3320a360de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39edf3ea-59", "ovs_interfaceid": "39edf3ea-59f0-4c49-a29a-35891ae05d66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:58:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Releasing lock "refresh_cache-21858df7-6fd1-40cc-8a10-9a3da556907a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:58:23 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Updated the network info_cache for instance {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 18:58:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:58:24 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:58:25 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:58:26 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:58:26 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 18:58:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:58:28 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:58:29 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG nova.compute.manager [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:58:31 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Creating image(s)
Oct 16 18:58:31 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Did not create local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Ensure instance console log exists: /opt/stack/data/nova/instances/e32e77fe-e842-433a-afa8-7d5a1f2c520c/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Start _get_guest_xml network_info=[{"id": "bfe88395-ff2c-4fc3-bf1d-b4e165044b8a", "address": "fa:16:3e:e6:e4:9f", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe88395-ff", "ovs_interfaceid": "bfe88395-ff2c-4fc3-bf1d-b4e165044b8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jYJEeRfp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e32e77fe-e842-433a-afa8-7d5a1f2c520c', 'attached_at': '', 'detached_at': '', 'volume_id': '16745855-2614-4ce8-a013-451d116c1dec', 'serial': '16745855-2614-4ce8-a013-451d116c1dec'}, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '43e37110-baef-4be6-82e5-4700f752d0c3', 'guest_format': None, 'volume_type': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:58:31 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:58:31 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:58:31 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jYJEeRfp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:58:31 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:58:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:58:31 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:58:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:58:31 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:58:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3067f4f-9746-47c5-83a7-fec9413a3e14]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 18:58:31 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[259befc2-771a-4ecf-8e1f-5ec71de044dd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec] added
Oct 16 18:58:31 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4433fcb3-9617-4322-b6a9-b0c2a547a62d]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f65ec1-a5a4-4001-8936-01dab80113ea]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jYJEeRfp {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jYJEeRfp" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2990c56-37bf-40c8-a102-677b301ce43f]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jYJEeRfp'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a3f979-eab9-444a-8b0d-3446bd15f765]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[423b91be-5b25-451b-bf00-d12c2e17ebed]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 16 18:58:31 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 16 18:58:31 user nova-compute[74247]:  {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:58:31 user nova-compute[74247]: WARNING os_brick.initiator.connectors.iscsi [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 16 18:58:31 user nova-compute[74247]: 
Oct 16 18:58:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57acc67-6849-4505-9103-24225887870a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec, portal: 172.16.0.220,3260]
Oct 16 18:58:31 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec, portal: 172.16.0.220,3260] successful.
Oct 16 18:58:31 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35aab2f-ea8d-4036-bc7a-95ddeec35c7d]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4895377d-589f-4a16-9668-b52954a51778]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)
Oct 16 18:58:31 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)
Oct 16 18:58:31 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c79bc66-5e50-4501-ad16-d0ad6147e823]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: None {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG nova.compute.manager [req-10dd53bd-4cde-40db-91b0-04d217fc52ac req-f53d21ad-c432-4aea-90d6-8ddd0c11effb service nova] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Received event network-changed-39edf3ea-59f0-4c49-a29a-35891ae05d66 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG nova.compute.manager [req-10dd53bd-4cde-40db-91b0-04d217fc52ac req-f53d21ad-c432-4aea-90d6-8ddd0c11effb service nova] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Refreshing instance network info cache due to event network-changed-39edf3ea-59f0-4c49-a29a-35891ae05d66. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-10dd53bd-4cde-40db-91b0-04d217fc52ac req-f53d21ad-c432-4aea-90d6-8ddd0c11effb service nova] Acquiring lock "refresh_cache-21858df7-6fd1-40cc-8a10-9a3da556907a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-10dd53bd-4cde-40db-91b0-04d217fc52ac req-f53d21ad-c432-4aea-90d6-8ddd0c11effb service nova] Acquired lock "refresh_cache-21858df7-6fd1-40cc-8a10-9a3da556907a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG nova.network.neutron [req-10dd53bd-4cde-40db-91b0-04d217fc52ac req-f53d21ad-c432-4aea-90d6-8ddd0c11effb service nova] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Refreshing network info cache for port 39edf3ea-59f0-4c49-a29a-35891ae05d66 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:58:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:58:32 user nova-compute[74247]: DEBUG nova.network.neutron [req-10dd53bd-4cde-40db-91b0-04d217fc52ac req-f53d21ad-c432-4aea-90d6-8ddd0c11effb service nova] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Updated VIF entry in instance network info cache for port 39edf3ea-59f0-4c49-a29a-35891ae05d66. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 18:58:32 user nova-compute[74247]: DEBUG nova.network.neutron [req-10dd53bd-4cde-40db-91b0-04d217fc52ac req-f53d21ad-c432-4aea-90d6-8ddd0c11effb service nova] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Updating instance_info_cache with network_info: [{"id": "39edf3ea-59f0-4c49-a29a-35891ae05d66", "address": "fa:16:3e:f0:f7:81", "network": {"id": "14ee32da-d0e3-499f-bd47-721e882b2a57", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-700103883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6d2ba688434391b03a9f3320a360de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39edf3ea-59", "ovs_interfaceid": "39edf3ea-59f0-4c49-a29a-35891ae05d66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:58:32 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-10dd53bd-4cde-40db-91b0-04d217fc52ac req-f53d21ad-c432-4aea-90d6-8ddd0c11effb service nova] Releasing lock "refresh_cache-21858df7-6fd1-40cc-8a10-9a3da556907a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:58:32 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:58:32 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jYJEeRfp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:58:32 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:58:32 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23261653335633538', 'path': '/dev/sdb'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:58:32 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261653335633538', 'path': '/dev/sdb'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:58:32 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:58:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-430871348',display_name='tempest-TestVolumeBootPattern-server-430871348',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-430871348',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjgu1PdB/VXTN5rZ7oE5e7ovtw+8pzQ24n8jIU2366r669SEEAxAB/9LNF+VOEmvr2qFXyje/n1vbSVuotOeSuaNNrodAuV6fmL4YsSSNhGH3oIDcKRDUc8ro4Dw/7HjQ==',key_name='tempest-TestVolumeBootPattern-34627609',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dca6144ea4e14c28b085e271175bbf67',ramdisk_id='',reservation_id='r-at27gnjp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1733357121',owner_user_name='tempest-TestVolumeBootPattern-1733357121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:58:14Z,user_data=None,user_id='9608bf58b70248439dbbcc9db38fba08',uuid=e32e77fe-e842-433a-afa8-7d5a1f2c520c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfe88395-ff2c-4fc3-bf1d-b4e165044b8a", "address": "fa:16:3e:e6:e4:9f", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe88395-ff", "ovs_interfaceid": "bfe88395-ff2c-4fc3-bf1d-b4e165044b8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:58:32 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Converting VIF {"id": "bfe88395-ff2c-4fc3-bf1d-b4e165044b8a", "address": "fa:16:3e:e6:e4:9f", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe88395-ff", "ovs_interfaceid": "bfe88395-ff2c-4fc3-bf1d-b4e165044b8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:58:32 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:e4:9f,bridge_name='br-int',has_traffic_filtering=True,id=bfe88395-ff2c-4fc3-bf1d-b4e165044b8a,network=Network(9688c665-d4b7-4179-9a76-fdf6c3013b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfe88395-ff') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:58:32 user nova-compute[74247]: DEBUG nova.objects.instance [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lazy-loading 'pci_devices' on Instance uuid e32e77fe-e842-433a-afa8-7d5a1f2c520c {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:58:32 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:58:32 user nova-compute[74247]:   <uuid>e32e77fe-e842-433a-afa8-7d5a1f2c520c</uuid>
Oct 16 18:58:32 user nova-compute[74247]:   <name>instance-0000002c</name>
Oct 16 18:58:32 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:58:32 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:58:32 user nova-compute[74247]:   <metadata>
Oct 16 18:58:32 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:58:32 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:58:32 user nova-compute[74247]:       <nova:name>tempest-TestVolumeBootPattern-server-430871348</nova:name>
Oct 16 18:58:32 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:58:31</nova:creationTime>
Oct 16 18:58:32 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:58:32 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:58:32 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:58:32 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:58:32 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:58:32 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:58:32 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:58:32 user nova-compute[74247]:       <nova:owner>
Oct 16 18:58:32 user nova-compute[74247]:         <nova:user uuid="9608bf58b70248439dbbcc9db38fba08">tempest-TestVolumeBootPattern-1733357121-project-member</nova:user>
Oct 16 18:58:32 user nova-compute[74247]:         <nova:project uuid="dca6144ea4e14c28b085e271175bbf67">tempest-TestVolumeBootPattern-1733357121</nova:project>
Oct 16 18:58:32 user nova-compute[74247]:       </nova:owner>
Oct 16 18:58:32 user nova-compute[74247]:       <nova:ports>
Oct 16 18:58:32 user nova-compute[74247]:         <nova:port uuid="bfe88395-ff2c-4fc3-bf1d-b4e165044b8a">
Oct 16 18:58:32 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 16 18:58:32 user nova-compute[74247]:         </nova:port>
Oct 16 18:58:32 user nova-compute[74247]:       </nova:ports>
Oct 16 18:58:32 user nova-compute[74247]:     </nova:instance>
Oct 16 18:58:32 user nova-compute[74247]:   </metadata>
Oct 16 18:58:32 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:58:32 user nova-compute[74247]:     <system>
Oct 16 18:58:32 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:58:32 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:58:32 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:58:32 user nova-compute[74247]:       <entry name="serial">e32e77fe-e842-433a-afa8-7d5a1f2c520c</entry>
Oct 16 18:58:32 user nova-compute[74247]:       <entry name="uuid">e32e77fe-e842-433a-afa8-7d5a1f2c520c</entry>
Oct 16 18:58:32 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:58:32 user nova-compute[74247]:     </system>
Oct 16 18:58:32 user nova-compute[74247]:   </sysinfo>
Oct 16 18:58:32 user nova-compute[74247]:   <os>
Oct 16 18:58:32 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:58:32 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:58:32 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:58:32 user nova-compute[74247]:   </os>
Oct 16 18:58:32 user nova-compute[74247]:   <features>
Oct 16 18:58:32 user nova-compute[74247]:     <acpi/>
Oct 16 18:58:32 user nova-compute[74247]:     <apic/>
Oct 16 18:58:32 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:58:32 user nova-compute[74247]:   </features>
Oct 16 18:58:32 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:58:32 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:58:32 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:58:32 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:58:32 user nova-compute[74247]:   </clock>
Oct 16 18:58:32 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:58:32 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:58:32 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:58:32 user nova-compute[74247]:   </cpu>
Oct 16 18:58:32 user nova-compute[74247]:   <devices>
Oct 16 18:58:32 user nova-compute[74247]:     <disk type="block" device="disk">
Oct 16 18:58:32 user nova-compute[74247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:58:32 user nova-compute[74247]:       <source dev="/dev/sdb"/>
Oct 16 18:58:32 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:58:32 user nova-compute[74247]:       <serial>16745855-2614-4ce8-a013-451d116c1dec</serial>
Oct 16 18:58:32 user nova-compute[74247]:     </disk>
Oct 16 18:58:32 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:58:32 user nova-compute[74247]:       <mac address="fa:16:3e:e6:e4:9f"/>
Oct 16 18:58:32 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:58:32 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:58:32 user nova-compute[74247]:       <target dev="tapbfe88395-ff"/>
Oct 16 18:58:32 user nova-compute[74247]:     </interface>
Oct 16 18:58:32 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:58:32 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/e32e77fe-e842-433a-afa8-7d5a1f2c520c/console.log" append="off"/>
Oct 16 18:58:32 user nova-compute[74247]:     </serial>
Oct 16 18:58:32 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:58:32 user nova-compute[74247]:     <video>
Oct 16 18:58:32 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:58:32 user nova-compute[74247]:     </video>
Oct 16 18:58:32 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:58:32 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:58:32 user nova-compute[74247]:     </rng>
Oct 16 18:58:32 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:58:32 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:58:32 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:58:32 user nova-compute[74247]:     </memballoon>
Oct 16 18:58:32 user nova-compute[74247]:   </devices>
Oct 16 18:58:32 user nova-compute[74247]: </domain>
Oct 16 18:58:32 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:58:32 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:58:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-430871348',display_name='tempest-TestVolumeBootPattern-server-430871348',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-430871348',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjgu1PdB/VXTN5rZ7oE5e7ovtw+8pzQ24n8jIU2366r669SEEAxAB/9LNF+VOEmvr2qFXyje/n1vbSVuotOeSuaNNrodAuV6fmL4YsSSNhGH3oIDcKRDUc8ro4Dw/7HjQ==',key_name='tempest-TestVolumeBootPattern-34627609',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dca6144ea4e14c28b085e271175bbf67',ramdisk_id='',reservation_id='r-at27gnjp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1733357121',owner_user_name='tempest-TestVolumeBootPattern-1733357121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:58:14Z,user_data=None,user_id='9608bf58b70248439dbbcc9db38fba08',uuid=e32e77fe-e842-433a-afa8-7d5a1f2c520c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfe88395-ff2c-4fc3-bf1d-b4e165044b8a", "address": "fa:16:3e:e6:e4:9f", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe88395-ff", "ovs_interfaceid": "bfe88395-ff2c-4fc3-bf1d-b4e165044b8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:58:32 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Converting VIF {"id": "bfe88395-ff2c-4fc3-bf1d-b4e165044b8a", "address": "fa:16:3e:e6:e4:9f", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe88395-ff", "ovs_interfaceid": "bfe88395-ff2c-4fc3-bf1d-b4e165044b8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:58:32 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:e4:9f,bridge_name='br-int',has_traffic_filtering=True,id=bfe88395-ff2c-4fc3-bf1d-b4e165044b8a,network=Network(9688c665-d4b7-4179-9a76-fdf6c3013b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfe88395-ff') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:58:32 user nova-compute[74247]: DEBUG os_vif [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:e4:9f,bridge_name='br-int',has_traffic_filtering=True,id=bfe88395-ff2c-4fc3-bf1d-b4e165044b8a,network=Network(9688c665-d4b7-4179-9a76-fdf6c3013b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfe88395-ff') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:58:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:58:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:58:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:58:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:58:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '977702e5-76e7-5204-8255-98cee53ad6cb', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:58:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:58:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:58:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:58:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbfe88395-ff, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:58:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbfe88395-ff, col_values=(('qos', UUID('cf0cd7f8-661d-42c2-93f5-782ab180fadb')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:58:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbfe88395-ff, col_values=(('external_ids', {'iface-id': 'bfe88395-ff2c-4fc3-bf1d-b4e165044b8a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:e4:9f', 'vm-uuid': 'e32e77fe-e842-433a-afa8-7d5a1f2c520c'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:58:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:58:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:58:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:58:32 user nova-compute[74247]: INFO os_vif [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:e4:9f,bridge_name='br-int',has_traffic_filtering=True,id=bfe88395-ff2c-4fc3-bf1d-b4e165044b8a,network=Network(9688c665-d4b7-4179-9a76-fdf6c3013b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfe88395-ff')
Oct 16 18:58:32 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:58:32 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] No VIF found with MAC fa:16:3e:e6:e4:9f, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:58:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:58:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:58:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:58:34 user nova-compute[74247]: DEBUG nova.compute.manager [req-5c3b4dcf-3b53-49d1-9d4c-6845326040d1 req-7580998b-211c-4fb0-85be-05b92e730fa4 service nova] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Received event network-vif-plugged-bfe88395-ff2c-4fc3-bf1d-b4e165044b8a {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:58:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-5c3b4dcf-3b53-49d1-9d4c-6845326040d1 req-7580998b-211c-4fb0-85be-05b92e730fa4 service nova] Acquiring lock "e32e77fe-e842-433a-afa8-7d5a1f2c520c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:58:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-5c3b4dcf-3b53-49d1-9d4c-6845326040d1 req-7580998b-211c-4fb0-85be-05b92e730fa4 service nova] Lock "e32e77fe-e842-433a-afa8-7d5a1f2c520c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:58:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-5c3b4dcf-3b53-49d1-9d4c-6845326040d1 req-7580998b-211c-4fb0-85be-05b92e730fa4 service nova] Lock "e32e77fe-e842-433a-afa8-7d5a1f2c520c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:58:34 user nova-compute[74247]: DEBUG nova.compute.manager [req-5c3b4dcf-3b53-49d1-9d4c-6845326040d1 req-7580998b-211c-4fb0-85be-05b92e730fa4 service nova] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] No waiting events found dispatching network-vif-plugged-bfe88395-ff2c-4fc3-bf1d-b4e165044b8a {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:58:34 user nova-compute[74247]: WARNING nova.compute.manager [req-5c3b4dcf-3b53-49d1-9d4c-6845326040d1 req-7580998b-211c-4fb0-85be-05b92e730fa4 service nova] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Received unexpected event network-vif-plugged-bfe88395-ff2c-4fc3-bf1d-b4e165044b8a for instance with vm_state building and task_state spawning.
Oct 16 18:58:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:58:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:58:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:58:36 user nova-compute[74247]: DEBUG nova.compute.manager [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:58:36 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:58:36 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Instance spawned successfully.
Oct 16 18:58:36 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 18:58:36 user nova-compute[74247]: DEBUG nova.compute.manager [req-566d244f-4f8a-4b1d-a475-3b19b2ed4c71 req-b8ce701e-85a6-43b2-b37b-70f3d4d05bf5 service nova] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Received event network-vif-plugged-bfe88395-ff2c-4fc3-bf1d-b4e165044b8a {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:58:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-566d244f-4f8a-4b1d-a475-3b19b2ed4c71 req-b8ce701e-85a6-43b2-b37b-70f3d4d05bf5 service nova] Acquiring lock "e32e77fe-e842-433a-afa8-7d5a1f2c520c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:58:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-566d244f-4f8a-4b1d-a475-3b19b2ed4c71 req-b8ce701e-85a6-43b2-b37b-70f3d4d05bf5 service nova] Lock "e32e77fe-e842-433a-afa8-7d5a1f2c520c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:58:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-566d244f-4f8a-4b1d-a475-3b19b2ed4c71 req-b8ce701e-85a6-43b2-b37b-70f3d4d05bf5 service nova] Lock "e32e77fe-e842-433a-afa8-7d5a1f2c520c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:58:36 user nova-compute[74247]: DEBUG nova.compute.manager [req-566d244f-4f8a-4b1d-a475-3b19b2ed4c71 req-b8ce701e-85a6-43b2-b37b-70f3d4d05bf5 service nova] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] No waiting events found dispatching network-vif-plugged-bfe88395-ff2c-4fc3-bf1d-b4e165044b8a {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:58:36 user nova-compute[74247]: WARNING nova.compute.manager [req-566d244f-4f8a-4b1d-a475-3b19b2ed4c71 req-b8ce701e-85a6-43b2-b37b-70f3d4d05bf5 service nova] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Received unexpected event network-vif-plugged-bfe88395-ff2c-4fc3-bf1d-b4e165044b8a for instance with vm_state building and task_state spawning.
Oct 16 18:58:36 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:58:36 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:58:36 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:58:36 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:58:36 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:58:36 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:58:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquiring lock "21858df7-6fd1-40cc-8a10-9a3da556907a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:58:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "21858df7-6fd1-40cc-8a10-9a3da556907a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:58:36 user nova-compute[74247]: INFO nova.compute.manager [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Took 5.61 seconds to spawn the instance on the hypervisor.
Oct 16 18:58:36 user nova-compute[74247]: DEBUG nova.compute.manager [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:58:36 user nova-compute[74247]: DEBUG nova.objects.instance [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lazy-loading 'flavor' on Instance uuid 21858df7-6fd1-40cc-8a10-9a3da556907a {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:58:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "21858df7-6fd1-40cc-8a10-9a3da556907a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:58:36 user nova-compute[74247]: INFO nova.compute.manager [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Took 22.89 seconds to build instance.
Oct 16 18:58:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-456cbdce-7351-448f-bf44-582b4224cb07 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "e32e77fe-e842-433a-afa8-7d5a1f2c520c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.013s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:58:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquiring lock "21858df7-6fd1-40cc-8a10-9a3da556907a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:58:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "21858df7-6fd1-40cc-8a10-9a3da556907a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:58:36 user nova-compute[74247]: INFO nova.compute.manager [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Attaching volume 5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c to /dev/vdb
Oct 16 18:58:36 user nova-compute[74247]: DEBUG os_brick.utils [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:58:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:58:36 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8afb6a-3e96-4d96-89b7-dd0a0ba119e5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:58:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:58:36 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c3210f-109c-47f0-ab50-07bde6240078]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:58:36 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0612228-de19-47b8-9611-60b24a467e87]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:36 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[458f8db1-4cb9-414c-b266-352b1c9810f7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:58:36 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 18:58:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:58:36 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 18:58:36 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49f5422-8455-4133-8ead-83ab18a00850]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 18:58:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 18:58:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 18:58:37 user nova-compute[74247]: DEBUG os_brick.utils [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:58:37 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Updating existing volume attachment record: f07ab6a8-be34-4897-95c4-be3a90d974df {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 18:58:37 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:58:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Acquiring lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:58:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:58:39 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 18:58:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:58:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:58:39 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 18:58:39 user nova-compute[74247]: INFO nova.compute.claims [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Claim successful on node user
Oct 16 18:58:39 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:58:39 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:58:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.295s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:58:39 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 18:58:39 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 18:58:39 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 18:58:39 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 18:58:39 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 18:58:39 user nova-compute[74247]: DEBUG nova.policy [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b18bdb21bba141089a9de12a98b7d976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863980f09120465ebbfb273efa0f07df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 18:58:39 user nova-compute[74247]: INFO nova.virt.block_device [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Booting with volume 35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d at /dev/vda
Oct 16 18:58:40 user nova-compute[74247]: DEBUG os_brick.utils [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:58:40 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:40 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:58:40 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf470b93-0b82-435f-87ce-6a94329f1dcd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:40 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:40 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:58:40 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[253eab05-c20a-44dd-8d0c-b7a76e83937d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:40 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:40 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:58:40 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7a7bd3-d00c-48dd-8658-a6cac0f4028f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:40 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1bc22b-e314-4d80-90d2-4bdc5177bde0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:40 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:40 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:58:40 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 18:58:40 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:40 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:58:40 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 18:58:40 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a02d09d-5bd2-4988-bed5-ced919c491cd]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:40 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 18:58:40 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 18:58:40 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 18:58:40 user nova-compute[74247]: DEBUG os_brick.utils [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:58:40 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Updating existing volume attachment record: acf8e394-80f7-455c-9b34-98806d0cec19 {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 18:58:40 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Successfully created port: f9d88799-cade-4fd4-a9d3-d2ac928f20c7 {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 18:58:41 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Successfully updated port: f9d88799-cade-4fd4-a9d3-d2ac928f20c7 {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 18:58:41 user nova-compute[74247]: DEBUG nova.compute.manager [req-a508bb0d-42ea-4101-9ac3-efedaeb7cc39 req-7e60a865-10ed-4043-bce0-6d251f384169 service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Received event network-changed-f9d88799-cade-4fd4-a9d3-d2ac928f20c7 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:58:41 user nova-compute[74247]: DEBUG nova.compute.manager [req-a508bb0d-42ea-4101-9ac3-efedaeb7cc39 req-7e60a865-10ed-4043-bce0-6d251f384169 service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Refreshing instance network info cache due to event network-changed-f9d88799-cade-4fd4-a9d3-d2ac928f20c7. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 18:58:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a508bb0d-42ea-4101-9ac3-efedaeb7cc39 req-7e60a865-10ed-4043-bce0-6d251f384169 service nova] Acquiring lock "refresh_cache-7f04ea2b-a029-44d9-ac7a-ea2b870d20eb" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:58:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a508bb0d-42ea-4101-9ac3-efedaeb7cc39 req-7e60a865-10ed-4043-bce0-6d251f384169 service nova] Acquired lock "refresh_cache-7f04ea2b-a029-44d9-ac7a-ea2b870d20eb" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:58:41 user nova-compute[74247]: DEBUG nova.network.neutron [req-a508bb0d-42ea-4101-9ac3-efedaeb7cc39 req-7e60a865-10ed-4043-bce0-6d251f384169 service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Refreshing network info cache for port f9d88799-cade-4fd4-a9d3-d2ac928f20c7 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 18:58:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Acquiring lock "refresh_cache-7f04ea2b-a029-44d9-ac7a-ea2b870d20eb" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:58:41 user nova-compute[74247]: DEBUG nova.network.neutron [req-a508bb0d-42ea-4101-9ac3-efedaeb7cc39 req-7e60a865-10ed-4043-bce0-6d251f384169 service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:58:41 user nova-compute[74247]: DEBUG nova.network.neutron [req-a508bb0d-42ea-4101-9ac3-efedaeb7cc39 req-7e60a865-10ed-4043-bce0-6d251f384169 service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:58:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a508bb0d-42ea-4101-9ac3-efedaeb7cc39 req-7e60a865-10ed-4043-bce0-6d251f384169 service nova] Releasing lock "refresh_cache-7f04ea2b-a029-44d9-ac7a-ea2b870d20eb" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:58:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Acquired lock "refresh_cache-7f04ea2b-a029-44d9-ac7a-ea2b870d20eb" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:58:41 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 18:58:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:58:41 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 18:58:42 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Updating instance_info_cache with network_info: [{"id": "f9d88799-cade-4fd4-a9d3-d2ac928f20c7", "address": "fa:16:3e:75:c0:0d", "network": {"id": "17f634c2-25e8-4655-8439-6a5e5d9c7e77", "bridge": "br-int", "label": "tempest-TestShelveInstance-161802280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863980f09120465ebbfb273efa0f07df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9d88799-ca", "ovs_interfaceid": "f9d88799-cade-4fd4-a9d3-d2ac928f20c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:58:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Releasing lock "refresh_cache-7f04ea2b-a029-44d9-ac7a-ea2b870d20eb" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:58:42 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Instance network_info: |[{"id": "f9d88799-cade-4fd4-a9d3-d2ac928f20c7", "address": "fa:16:3e:75:c0:0d", "network": {"id": "17f634c2-25e8-4655-8439-6a5e5d9c7e77", "bridge": "br-int", "label": "tempest-TestShelveInstance-161802280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863980f09120465ebbfb273efa0f07df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9d88799-ca", "ovs_interfaceid": "f9d88799-cade-4fd4-a9d3-d2ac928f20c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 18:58:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:58:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:58:46 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:58:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:58:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:58:52 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:58:54 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:58:54 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'viURMFEw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:58:54 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:58:54 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:58:54 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:58:54 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:58:54 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:58:54 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:58:54 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:58:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:58:54 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf67d3d5-e0a5-4070-a0f9-c44a66a32a43]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:54 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 18:58:54 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:58:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:58:54 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ddc4b99-0955-43aa-a08d-acb528ca59c1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:54 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c] added
Oct 16 18:58:54 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:58:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:58:54 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b98c443-d611-4f81-b131-9c591c1990d5]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:54 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:58:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:58:54 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1018d449-b620-4673-bb93-486596acc2d2]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:54 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:58:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v viURMFEw {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v viURMFEw" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:58:54 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96b6bea-1728-4caa-8e6f-8087041d5fe1]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:54 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'viURMFEw'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:58:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:58:54 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c15a866-f1e0-4942-81e8-af774fa0cadf]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:54 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:58:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:58:54 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e744d9-f59b-4774-9008-d4ebbe5ab49a]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:54 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)
Oct 16 18:58:54 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:58:54 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)
Oct 16 18:58:54 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:58:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:58:54 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[33312b78-b7e4-4e9b-9f48-99a7ca206f01]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:54 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c, portal: 172.16.0.220,3260]
Oct 16 18:58:54 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c, portal: 172.16.0.220,3260] successful.
Oct 16 18:58:54 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:58:54 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:58:55 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cfbd109-6bc3-4ac3-b554-a7d2a483382c]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:55 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:58:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:58:55 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e112aa-4b61-4db0-bf6d-940a5dd9d174]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:55 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)
Oct 16 18:58:55 user nova-compute[74247]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c (non-flash)
Oct 16 18:58:55 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:58:55 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)
Oct 16 18:58:55 user nova-compute[74247]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c (non-flash)
Oct 16 18:58:55 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:58:55 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:58:55 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:58:55 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:58:55 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:58:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:55 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:58:55 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0baf25e5-988c-425f-9aaa-2b271d040d2a]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:55 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: None {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:58:56 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:58:56 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'viURMFEw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:58:56 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:58:56 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23536336530336164', 'path': '/dev/sdc'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:58:56 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536336530336164', 'path': '/dev/sdc'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:58:56 user nova-compute[74247]: DEBUG nova.objects.instance [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lazy-loading 'flavor' on Instance uuid 21858df7-6fd1-40cc-8a10-9a3da556907a {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:58:56 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 18:58:56 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:58:56 user nova-compute[74247]:   <source dev="/dev/sdc"/>
Oct 16 18:58:56 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:58:56 user nova-compute[74247]:   <serial>5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c</serial>
Oct 16 18:58:56 user nova-compute[74247]: </disk>
Oct 16 18:58:56 user nova-compute[74247]:  {{(pid=74247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 18:58:56 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:58:56 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:58:56 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] No VIF found with MAC fa:16:3e:f0:f7:81, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:58:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-33d93dd9-58d6-410d-ac32-6b65c9a5a63f tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "21858df7-6fd1-40cc-8a10-9a3da556907a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.884s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:58:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:58:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:58:57 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 18:58:57 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 18:58:57 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Creating image(s)
Oct 16 18:58:57 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Did not create local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 18:58:57 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Ensure instance console log exists: /opt/stack/data/nova/instances/7f04ea2b-a029-44d9-ac7a-ea2b870d20eb/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 18:58:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:58:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:58:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:58:57 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Start _get_guest_xml network_info=[{"id": "f9d88799-cade-4fd4-a9d3-d2ac928f20c7", "address": "fa:16:3e:75:c0:0d", "network": {"id": "17f634c2-25e8-4655-8439-6a5e5d9c7e77", "bridge": "br-int", "label": "tempest-TestShelveInstance-161802280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863980f09120465ebbfb273efa0f07df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9d88799-ca", "ovs_interfaceid": "f9d88799-cade-4fd4-a9d3-d2ac928f20c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cLCfxgKw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7f04ea2b-a029-44d9-ac7a-ea2b870d20eb', 'attached_at': '', 'detached_at': '', 'volume_id': '35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d', 'serial': '35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d'}, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'acf8e394-80f7-455c-9b34-98806d0cec19', 'guest_format': None, 'volume_type': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 18:58:57 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:58:57 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:58:57 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 18:58:57 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 18:58:57 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 18:58:57 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 18:58:57 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 18:58:57 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 18:58:57 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 18:58:57 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 18:58:57 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 18:58:57 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 18:58:57 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 18:58:57 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 18:58:57 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 18:58:57 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 18:58:57 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 18:58:57 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 18:58:57 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:58:57 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cLCfxgKw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:58:57 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:58:57 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:58:57 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:58:57 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:58:57 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:58:57 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:58:57 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:58:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:58:57 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bf330c-12a6-41f2-92b4-eab447e1560e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:57 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 18:58:57 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:58:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:58:57 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[129e8165-cac4-440a-9b36-86ea4b8e1aa0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:57 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d] added
Oct 16 18:58:57 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:58:57 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:58:58 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d056522-14a3-471f-9584-237a740ff08b]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:58:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:58:58 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bd742d-06b3-4031-bd97-1503b8de0dff]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:58:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cLCfxgKw {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cLCfxgKw" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:58:58 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5a789f-aaae-4c0a-9835-7f87a7e5340c]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cLCfxgKw'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:58:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:58:58 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4ade3b-df7d-4786-9a64-ff5f863f55dd]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:58:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:58:58 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f070321-95e6-4faf-89e6-96c6da4a286a]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)
Oct 16 18:58:58 user nova-compute[74247]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c (non-flash)
Oct 16 18:58:58 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:58:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)
Oct 16 18:58:58 user nova-compute[74247]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c (non-flash)
Oct 16 18:58:58 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:58:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:58:58 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1104d1-9d55-47e2-af8f-6973d7f76a4a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d, portal: 172.16.0.220,3260]
Oct 16 18:58:58 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d, portal: 172.16.0.220,3260] successful.
Oct 16 18:58:58 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:58:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:58:58 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[319a1c8b-b5f6-4460-bfdf-c5a7bf80d7f3]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:58:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:58:58 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[69edf650-938f-41f6-8d5e-531d3b7fa13d]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)
Oct 16 18:58:58 user nova-compute[74247]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c (non-flash)
Oct 16 18:58:58 user nova-compute[74247]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d (non-flash)
Oct 16 18:58:58 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:58:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)
Oct 16 18:58:58 user nova-compute[74247]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c (non-flash)
Oct 16 18:58:58 user nova-compute[74247]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d (non-flash)
Oct 16 18:58:58 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:58:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:58:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:58:58 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] HCTL ('35', '-', '-', 0) found on session 49 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:58:58 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:58:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:58:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:58:58 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2680a4-23ad-40ec-8f0e-ecb7beede44f]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:58:58 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: None {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:58:59 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:58:59 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cLCfxgKw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:58:59 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:58:59 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23264336230653133', 'path': '/dev/sdd'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:58:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264336230653133', 'path': '/dev/sdd'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:58:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:58:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-245644659',display_name='tempest-TestShelveInstance-server-245644659',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-245644659',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/wf3BAEOMqughkEq4Tr/5OFR/Et8qfg2eC6E01VThl/SE94s5bUkzrQ94y/QPhbXlS9dcM60h3HYQrp5CekWdEAALbss9fke59qoj5EpsJOSElLn9HSV7oXrxf0+PLHQ==',key_name='tempest-TestShelveInstance-1763650089',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='863980f09120465ebbfb273efa0f07df',ramdisk_id='',reservation_id='r-sduxnmst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-565913270',owner_user_name='tempest-TestShelveInstance-565913270-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:58:40Z,user_data=None,user_id='b18bdb21bba141089a9de12a98b7d976',uuid=7f04ea2b-a029-44d9-ac7a-ea2b870d20eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9d88799-cade-4fd4-a9d3-d2ac928f20c7", "address": "fa:16:3e:75:c0:0d", "network": {"id": "17f634c2-25e8-4655-8439-6a5e5d9c7e77", "bridge": "br-int", "label": "tempest-TestShelveInstance-161802280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863980f09120465ebbfb273efa0f07df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9d88799-ca", "ovs_interfaceid": "f9d88799-cade-4fd4-a9d3-d2ac928f20c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 18:58:59 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Converting VIF {"id": "f9d88799-cade-4fd4-a9d3-d2ac928f20c7", "address": "fa:16:3e:75:c0:0d", "network": {"id": "17f634c2-25e8-4655-8439-6a5e5d9c7e77", "bridge": "br-int", "label": "tempest-TestShelveInstance-161802280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863980f09120465ebbfb273efa0f07df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9d88799-ca", "ovs_interfaceid": "f9d88799-cade-4fd4-a9d3-d2ac928f20c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:58:59 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:c0:0d,bridge_name='br-int',has_traffic_filtering=True,id=f9d88799-cade-4fd4-a9d3-d2ac928f20c7,network=Network(17f634c2-25e8-4655-8439-6a5e5d9c7e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9d88799-ca') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:58:59 user nova-compute[74247]: DEBUG nova.objects.instance [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Lazy-loading 'pci_devices' on Instance uuid 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:58:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] End _get_guest_xml xml=<domain type="kvm">
Oct 16 18:58:59 user nova-compute[74247]:   <uuid>7f04ea2b-a029-44d9-ac7a-ea2b870d20eb</uuid>
Oct 16 18:58:59 user nova-compute[74247]:   <name>instance-0000002d</name>
Oct 16 18:58:59 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 18:58:59 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 18:58:59 user nova-compute[74247]:   <metadata>
Oct 16 18:58:59 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 18:58:59 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 18:58:59 user nova-compute[74247]:       <nova:name>tempest-TestShelveInstance-server-245644659</nova:name>
Oct 16 18:58:59 user nova-compute[74247]:       <nova:creationTime>2023-10-16 18:58:57</nova:creationTime>
Oct 16 18:58:59 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 18:58:59 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 18:58:59 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 18:58:59 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 18:58:59 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 18:58:59 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 18:58:59 user nova-compute[74247]:       </nova:flavor>
Oct 16 18:58:59 user nova-compute[74247]:       <nova:owner>
Oct 16 18:58:59 user nova-compute[74247]:         <nova:user uuid="b18bdb21bba141089a9de12a98b7d976">tempest-TestShelveInstance-565913270-project-member</nova:user>
Oct 16 18:58:59 user nova-compute[74247]:         <nova:project uuid="863980f09120465ebbfb273efa0f07df">tempest-TestShelveInstance-565913270</nova:project>
Oct 16 18:58:59 user nova-compute[74247]:       </nova:owner>
Oct 16 18:58:59 user nova-compute[74247]:       <nova:ports>
Oct 16 18:58:59 user nova-compute[74247]:         <nova:port uuid="f9d88799-cade-4fd4-a9d3-d2ac928f20c7">
Oct 16 18:58:59 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 16 18:58:59 user nova-compute[74247]:         </nova:port>
Oct 16 18:58:59 user nova-compute[74247]:       </nova:ports>
Oct 16 18:58:59 user nova-compute[74247]:     </nova:instance>
Oct 16 18:58:59 user nova-compute[74247]:   </metadata>
Oct 16 18:58:59 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 18:58:59 user nova-compute[74247]:     <system>
Oct 16 18:58:59 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 18:58:59 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 18:58:59 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 18:58:59 user nova-compute[74247]:       <entry name="serial">7f04ea2b-a029-44d9-ac7a-ea2b870d20eb</entry>
Oct 16 18:58:59 user nova-compute[74247]:       <entry name="uuid">7f04ea2b-a029-44d9-ac7a-ea2b870d20eb</entry>
Oct 16 18:58:59 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 18:58:59 user nova-compute[74247]:     </system>
Oct 16 18:58:59 user nova-compute[74247]:   </sysinfo>
Oct 16 18:58:59 user nova-compute[74247]:   <os>
Oct 16 18:58:59 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 18:58:59 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 18:58:59 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 18:58:59 user nova-compute[74247]:   </os>
Oct 16 18:58:59 user nova-compute[74247]:   <features>
Oct 16 18:58:59 user nova-compute[74247]:     <acpi/>
Oct 16 18:58:59 user nova-compute[74247]:     <apic/>
Oct 16 18:58:59 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 18:58:59 user nova-compute[74247]:   </features>
Oct 16 18:58:59 user nova-compute[74247]:   <clock offset="utc">
Oct 16 18:58:59 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 18:58:59 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 18:58:59 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 18:58:59 user nova-compute[74247]:   </clock>
Oct 16 18:58:59 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 18:58:59 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 18:58:59 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 18:58:59 user nova-compute[74247]:   </cpu>
Oct 16 18:58:59 user nova-compute[74247]:   <devices>
Oct 16 18:58:59 user nova-compute[74247]:     <disk type="block" device="disk">
Oct 16 18:58:59 user nova-compute[74247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:58:59 user nova-compute[74247]:       <source dev="/dev/sdd"/>
Oct 16 18:58:59 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 18:58:59 user nova-compute[74247]:       <serial>35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d</serial>
Oct 16 18:58:59 user nova-compute[74247]:     </disk>
Oct 16 18:58:59 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 18:58:59 user nova-compute[74247]:       <mac address="fa:16:3e:75:c0:0d"/>
Oct 16 18:58:59 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:58:59 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 18:58:59 user nova-compute[74247]:       <target dev="tapf9d88799-ca"/>
Oct 16 18:58:59 user nova-compute[74247]:     </interface>
Oct 16 18:58:59 user nova-compute[74247]:     <serial type="pty">
Oct 16 18:58:59 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/7f04ea2b-a029-44d9-ac7a-ea2b870d20eb/console.log" append="off"/>
Oct 16 18:58:59 user nova-compute[74247]:     </serial>
Oct 16 18:58:59 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 18:58:59 user nova-compute[74247]:     <video>
Oct 16 18:58:59 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 18:58:59 user nova-compute[74247]:     </video>
Oct 16 18:58:59 user nova-compute[74247]:     <rng model="virtio">
Oct 16 18:58:59 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 18:58:59 user nova-compute[74247]:     </rng>
Oct 16 18:58:59 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 18:58:59 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 18:58:59 user nova-compute[74247]:       <stats period="10"/>
Oct 16 18:58:59 user nova-compute[74247]:     </memballoon>
Oct 16 18:58:59 user nova-compute[74247]:   </devices>
Oct 16 18:58:59 user nova-compute[74247]: </domain>
Oct 16 18:58:59 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 18:58:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:58:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-245644659',display_name='tempest-TestShelveInstance-server-245644659',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-245644659',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/wf3BAEOMqughkEq4Tr/5OFR/Et8qfg2eC6E01VThl/SE94s5bUkzrQ94y/QPhbXlS9dcM60h3HYQrp5CekWdEAALbss9fke59qoj5EpsJOSElLn9HSV7oXrxf0+PLHQ==',key_name='tempest-TestShelveInstance-1763650089',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='863980f09120465ebbfb273efa0f07df',ramdisk_id='',reservation_id='r-sduxnmst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-565913270',owner_user_name='tempest-TestShelveInstance-565913270-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T18:58:40Z,user_data=None,user_id='b18bdb21bba141089a9de12a98b7d976',uuid=7f04ea2b-a029-44d9-ac7a-ea2b870d20eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9d88799-cade-4fd4-a9d3-d2ac928f20c7", "address": "fa:16:3e:75:c0:0d", "network": {"id": "17f634c2-25e8-4655-8439-6a5e5d9c7e77", "bridge": "br-int", "label": "tempest-TestShelveInstance-161802280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863980f09120465ebbfb273efa0f07df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9d88799-ca", "ovs_interfaceid": "f9d88799-cade-4fd4-a9d3-d2ac928f20c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 18:58:59 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Converting VIF {"id": "f9d88799-cade-4fd4-a9d3-d2ac928f20c7", "address": "fa:16:3e:75:c0:0d", "network": {"id": "17f634c2-25e8-4655-8439-6a5e5d9c7e77", "bridge": "br-int", "label": "tempest-TestShelveInstance-161802280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863980f09120465ebbfb273efa0f07df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9d88799-ca", "ovs_interfaceid": "f9d88799-cade-4fd4-a9d3-d2ac928f20c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 18:58:59 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:c0:0d,bridge_name='br-int',has_traffic_filtering=True,id=f9d88799-cade-4fd4-a9d3-d2ac928f20c7,network=Network(17f634c2-25e8-4655-8439-6a5e5d9c7e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9d88799-ca') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 18:58:59 user nova-compute[74247]: DEBUG os_vif [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:c0:0d,bridge_name='br-int',has_traffic_filtering=True,id=f9d88799-cade-4fd4-a9d3-d2ac928f20c7,network=Network(17f634c2-25e8-4655-8439-6a5e5d9c7e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9d88799-ca') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 18:58:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:58:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:58:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 18:58:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:58:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6988aae1-2a73-5f77-809d-8ece8661a9b5', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:58:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:58:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:58:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:58:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9d88799-ca, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:58:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf9d88799-ca, col_values=(('qos', UUID('9cabd7dc-518a-4c5d-9af5-d8cdce7b39a0')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:58:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf9d88799-ca, col_values=(('external_ids', {'iface-id': 'f9d88799-cade-4fd4-a9d3-d2ac928f20c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:c0:0d', 'vm-uuid': '7f04ea2b-a029-44d9-ac7a-ea2b870d20eb'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 18:58:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:58:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:58:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:58:59 user nova-compute[74247]: INFO os_vif [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:c0:0d,bridge_name='br-int',has_traffic_filtering=True,id=f9d88799-cade-4fd4-a9d3-d2ac928f20c7,network=Network(17f634c2-25e8-4655-8439-6a5e5d9c7e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9d88799-ca')
Oct 16 18:58:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:58:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] No VIF found with MAC fa:16:3e:75:c0:0d, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:59:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:59:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:59:00 user nova-compute[74247]: DEBUG nova.compute.manager [req-3cff630b-308e-4afe-bffd-05af402ac79e req-5d851e81-276d-4080-99d1-b5a969a07ffd service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Received event network-vif-plugged-f9d88799-cade-4fd4-a9d3-d2ac928f20c7 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:59:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3cff630b-308e-4afe-bffd-05af402ac79e req-5d851e81-276d-4080-99d1-b5a969a07ffd service nova] Acquiring lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:59:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3cff630b-308e-4afe-bffd-05af402ac79e req-5d851e81-276d-4080-99d1-b5a969a07ffd service nova] Lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:59:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3cff630b-308e-4afe-bffd-05af402ac79e req-5d851e81-276d-4080-99d1-b5a969a07ffd service nova] Lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:59:00 user nova-compute[74247]: DEBUG nova.compute.manager [req-3cff630b-308e-4afe-bffd-05af402ac79e req-5d851e81-276d-4080-99d1-b5a969a07ffd service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] No waiting events found dispatching network-vif-plugged-f9d88799-cade-4fd4-a9d3-d2ac928f20c7 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:59:00 user nova-compute[74247]: WARNING nova.compute.manager [req-3cff630b-308e-4afe-bffd-05af402ac79e req-5d851e81-276d-4080-99d1-b5a969a07ffd service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Received unexpected event network-vif-plugged-f9d88799-cade-4fd4-a9d3-d2ac928f20c7 for instance with vm_state building and task_state spawning.
Oct 16 18:59:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:59:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:59:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:59:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:59:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:59:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquiring lock "21858df7-6fd1-40cc-8a10-9a3da556907a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:59:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "21858df7-6fd1-40cc-8a10-9a3da556907a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:59:02 user nova-compute[74247]: DEBUG nova.objects.instance [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lazy-loading 'flavor' on Instance uuid 21858df7-6fd1-40cc-8a10-9a3da556907a {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:59:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "21858df7-6fd1-40cc-8a10-9a3da556907a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:59:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquiring lock "21858df7-6fd1-40cc-8a10-9a3da556907a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:59:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "21858df7-6fd1-40cc-8a10-9a3da556907a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:59:02 user nova-compute[74247]: INFO nova.compute.manager [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Attaching volume 113a74ce-04e9-4b4c-b362-8560482139d2 to /dev/vdc
Oct 16 18:59:02 user nova-compute[74247]: DEBUG os_brick.utils [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:59:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:59:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:59:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6c922d-3fa6-46ef-acf0-c4136ec05ca0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:59:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:59:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:59:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6d1b42-1830-4cce-8aa6-43787d88c674]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:59:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:59:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:59:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec93cf6-f3d2-40ba-88ba-e6514f2c0364]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:59:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db4d41b-5f64-43c4-9a21-185ae737e4df]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:59:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:59:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:59:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 18:59:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:59:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 18:59:02 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 18:59:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd37e9e-aa6c-4021-8b26-e74dc854c01c]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:59:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 18:59:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 18:59:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 18:59:02 user nova-compute[74247]: DEBUG os_brick.utils [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:59:02 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Updating existing volume attachment record: c9af7594-24e4-48fa-ab89-7266894142f9 {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 18:59:02 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 18:59:02 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 18:59:02 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Instance spawned successfully.
Oct 16 18:59:02 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 18:59:02 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:59:02 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:59:02 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:59:02 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:59:02 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:59:02 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 18:59:02 user nova-compute[74247]: DEBUG nova.compute.manager [req-d441da73-94f5-4f6c-a1ce-df04e7a791da req-893a6e9c-4b55-428d-b877-df3ea7c5979d service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Received event network-vif-plugged-f9d88799-cade-4fd4-a9d3-d2ac928f20c7 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 18:59:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d441da73-94f5-4f6c-a1ce-df04e7a791da req-893a6e9c-4b55-428d-b877-df3ea7c5979d service nova] Acquiring lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:59:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d441da73-94f5-4f6c-a1ce-df04e7a791da req-893a6e9c-4b55-428d-b877-df3ea7c5979d service nova] Lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:59:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d441da73-94f5-4f6c-a1ce-df04e7a791da req-893a6e9c-4b55-428d-b877-df3ea7c5979d service nova] Lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:59:02 user nova-compute[74247]: DEBUG nova.compute.manager [req-d441da73-94f5-4f6c-a1ce-df04e7a791da req-893a6e9c-4b55-428d-b877-df3ea7c5979d service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] No waiting events found dispatching network-vif-plugged-f9d88799-cade-4fd4-a9d3-d2ac928f20c7 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 18:59:02 user nova-compute[74247]: WARNING nova.compute.manager [req-d441da73-94f5-4f6c-a1ce-df04e7a791da req-893a6e9c-4b55-428d-b877-df3ea7c5979d service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Received unexpected event network-vif-plugged-f9d88799-cade-4fd4-a9d3-d2ac928f20c7 for instance with vm_state building and task_state spawning.
Oct 16 18:59:02 user nova-compute[74247]: INFO nova.compute.manager [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Took 5.13 seconds to spawn the instance on the hypervisor.
Oct 16 18:59:02 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 18:59:03 user nova-compute[74247]: INFO nova.compute.manager [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Took 23.67 seconds to build instance.
Oct 16 18:59:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4bf7b710-d3c3-4f87-b7e3-21303e8599d9 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.810s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:59:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:59:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:59:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:59:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:59:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:59:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 18:59:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 18:59:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 18:59:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:59:17 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:59:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MknKAdNy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:59:20 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:59:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:59:20 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:59:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:59:20 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 18:59:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2 -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f50295-44f2-4bf2-bcfd-6c44eff2360e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 18:59:20 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33ce11c-54a0-4d29-97ac-2bfc3ebacc6c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2] added
Oct 16 18:59:20 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba642d3-c28b-4d9c-9de9-1fc426c422de]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d061413c-74de-48dd-a679-a07cd8b45ece]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MknKAdNy {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MknKAdNy" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47c6784-6bee-4fec-b77b-eff4a6e9232c]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MknKAdNy'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3cc83c-29df-46b1-9322-1ad9c40d1d75]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[348639cf-17e6-4be9-b974-b1dacd341538]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)
Oct 16 18:59:20 user nova-compute[74247]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c (non-flash)
Oct 16 18:59:20 user nova-compute[74247]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d (non-flash)
Oct 16 18:59:20 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)
Oct 16 18:59:20 user nova-compute[74247]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c (non-flash)
Oct 16 18:59:20 user nova-compute[74247]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d (non-flash)
Oct 16 18:59:20 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2 -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ded3f86-1e7f-494f-8256-e803b3e218be]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2, portal: 172.16.0.220,3260]
Oct 16 18:59:20 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2, portal: 172.16.0.220,3260] successful.
Oct 16 18:59:20 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8954df29-9088-49e0-a8df-2e4d0a007e93]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00720af-ff2f-4922-9563-db62ee22de6c]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)
Oct 16 18:59:20 user nova-compute[74247]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c (non-flash)
Oct 16 18:59:20 user nova-compute[74247]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d (non-flash)
Oct 16 18:59:20 user nova-compute[74247]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2 (non-flash)
Oct 16 18:59:20 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)
Oct 16 18:59:20 user nova-compute[74247]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c (non-flash)
Oct 16 18:59:20 user nova-compute[74247]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d (non-flash)
Oct 16 18:59:20 user nova-compute[74247]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2 (non-flash)
Oct 16 18:59:20 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] HCTL ('36', '-', '-', 0) found on session 50 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfddb51-7533-4130-9ff6-52c9c82cb953]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Searching for a device in session 50 and hctl ['36', '*', '*', 0] yield: None {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:59:20 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:59:21 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Searching for a device in session 50 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 18:59:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MknKAdNy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 18:59:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:59:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23962356637663633', 'path': '/dev/sde'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:59:21 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962356637663633', 'path': '/dev/sde'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 18:59:21 user nova-compute[74247]: DEBUG nova.objects.instance [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lazy-loading 'flavor' on Instance uuid 21858df7-6fd1-40cc-8a10-9a3da556907a {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:59:21 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 18:59:21 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:59:21 user nova-compute[74247]:   <source dev="/dev/sde"/>
Oct 16 18:59:21 user nova-compute[74247]:   <target dev="vdc" bus="virtio"/>
Oct 16 18:59:21 user nova-compute[74247]:   <serial>113a74ce-04e9-4b4c-b362-8560482139d2</serial>
Oct 16 18:59:21 user nova-compute[74247]: </disk>
Oct 16 18:59:21 user nova-compute[74247]:  {{(pid=74247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 18:59:21 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:59:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:59:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:59:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:59:21 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 18:59:21 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:59:21 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:59:21 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 18:59:21 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] No VIF found with MAC fa:16:3e:f0:f7:81, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 18:59:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21858df7-6fd1-40cc-8a10-9a3da556907a/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:59:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:59:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21858df7-6fd1-40cc-8a10-9a3da556907a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:59:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21858df7-6fd1-40cc-8a10-9a3da556907a/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:59:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3f1d97b4-3b0b-4783-ae27-6a9e99523b1b tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "21858df7-6fd1-40cc-8a10-9a3da556907a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.742s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:59:22 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21858df7-6fd1-40cc-8a10-9a3da556907a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:59:22 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:59:22 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:59:22 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:59:22 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 18:59:22 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:59:22 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 18:59:22 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=8490MB free_disk=24.98757553100586GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 18:59:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:59:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:59:22 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 21858df7-6fd1-40cc-8a10-9a3da556907a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:59:22 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance e32e77fe-e842-433a-afa8-7d5a1f2c520c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:59:22 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 18:59:22 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 18:59:22 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 18:59:22 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 18:59:22 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 18:59:22 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 18:59:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.240s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:59:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3cc78d17-9c85-4ac6-a8c2-026ed0f661a9 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquiring lock "21858df7-6fd1-40cc-8a10-9a3da556907a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:59:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3cc78d17-9c85-4ac6-a8c2-026ed0f661a9 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "21858df7-6fd1-40cc-8a10-9a3da556907a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:59:23 user nova-compute[74247]: INFO nova.compute.manager [None req-3cc78d17-9c85-4ac6-a8c2-026ed0f661a9 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Detaching volume 5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c
Oct 16 18:59:23 user nova-compute[74247]: INFO nova.virt.block_device [None req-3cc78d17-9c85-4ac6-a8c2-026ed0f661a9 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Attempting to driver detach volume 5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c from mountpoint /dev/vdb
Oct 16 18:59:23 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3cc78d17-9c85-4ac6-a8c2-026ed0f661a9 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Attempting to detach device vdb from instance 21858df7-6fd1-40cc-8a10-9a3da556907a from the persistent domain config. {{(pid=74247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 18:59:23 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-3cc78d17-9c85-4ac6-a8c2-026ed0f661a9 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 18:59:23 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:59:23 user nova-compute[74247]:   <source dev="/dev/sdc"/>
Oct 16 18:59:23 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:59:23 user nova-compute[74247]:   <serial>5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c</serial>
Oct 16 18:59:23 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 18:59:23 user nova-compute[74247]: </disk>
Oct 16 18:59:23 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:59:23 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-3cc78d17-9c85-4ac6-a8c2-026ed0f661a9 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Successfully detached device vdb from instance 21858df7-6fd1-40cc-8a10-9a3da556907a from the persistent domain config.
Oct 16 18:59:23 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3cc78d17-9c85-4ac6-a8c2-026ed0f661a9 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 21858df7-6fd1-40cc-8a10-9a3da556907a from the live domain config. {{(pid=74247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 18:59:23 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-3cc78d17-9c85-4ac6-a8c2-026ed0f661a9 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 18:59:23 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:59:23 user nova-compute[74247]:   <source dev="/dev/sdc"/>
Oct 16 18:59:23 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 18:59:23 user nova-compute[74247]:   <serial>5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c</serial>
Oct 16 18:59:23 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 18:59:23 user nova-compute[74247]: </disk>
Oct 16 18:59:23 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:59:23 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3cc78d17-9c85-4ac6-a8c2-026ed0f661a9 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 21858df7-6fd1-40cc-8a10-9a3da556907a {{(pid=74247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 18:59:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:59:24 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:59:24 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 18:59:24 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Rebuilding the list of instances to heal {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 18:59:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "refresh_cache-21858df7-6fd1-40cc-8a10-9a3da556907a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 18:59:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquired lock "refresh_cache-21858df7-6fd1-40cc-8a10-9a3da556907a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 18:59:24 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Forcefully refreshing network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 18:59:24 user nova-compute[74247]: DEBUG nova.objects.instance [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lazy-loading 'info_cache' on Instance uuid 21858df7-6fd1-40cc-8a10-9a3da556907a {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:59:25 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Updating instance_info_cache with network_info: [{"id": "39edf3ea-59f0-4c49-a29a-35891ae05d66", "address": "fa:16:3e:f0:f7:81", "network": {"id": "14ee32da-d0e3-499f-bd47-721e882b2a57", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-700103883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6d2ba688434391b03a9f3320a360de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39edf3ea-59", "ovs_interfaceid": "39edf3ea-59f0-4c49-a29a-35891ae05d66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 18:59:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Releasing lock "refresh_cache-21858df7-6fd1-40cc-8a10-9a3da556907a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 18:59:25 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Updated the network info_cache for instance {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 18:59:25 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:59:26 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:59:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:59:27 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:59:27 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 18:59:29 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:59:29 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:59:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:59:32 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:59:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:59:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:59:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:59:43 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-3cc78d17-9c85-4ac6-a8c2-026ed0f661a9 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 21858df7-6fd1-40cc-8a10-9a3da556907a is timed out.
Oct 16 18:59:43 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-3cc78d17-9c85-4ac6-a8c2-026ed0f661a9 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Successfully detached device vdb from instance 21858df7-6fd1-40cc-8a10-9a3da556907a from the live domain config.
Oct 16 18:59:43 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cc78d17-9c85-4ac6-a8c2-026ed0f661a9 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 18:59:43 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc78d17-9c85-4ac6-a8c2-026ed0f661a9 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'viURMFEw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 18:59:43 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-3cc78d17-9c85-4ac6-a8c2-026ed0f661a9 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 18:59:43 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-3cc78d17-9c85-4ac6-a8c2-026ed0f661a9 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 18:59:43 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-3cc78d17-9c85-4ac6-a8c2-026ed0f661a9 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 18:59:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:59:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:59:43 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7db4fb-bc52-4e63-80d8-d614e3779530]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:59:43 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc78d17-9c85-4ac6-a8c2-026ed0f661a9 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 18:59:43 user nova-compute[74247]: No targets found.
Oct 16 18:59:43 user nova-compute[74247]: iSNS:
Oct 16 18:59:43 user nova-compute[74247]: No targets found.
Oct 16 18:59:43 user nova-compute[74247]: STATIC:
Oct 16 18:59:43 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d
Oct 16 18:59:43 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:59:43 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:59:43 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec
Oct 16 18:59:43 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:59:43 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:59:43 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c
Oct 16 18:59:43 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:59:43 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:59:43 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2
Oct 16 18:59:43 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 18:59:43 user nova-compute[74247]:                 Iface Name: default
Oct 16 18:59:43 user nova-compute[74247]: FIRMWARE:
Oct 16 18:59:43 user nova-compute[74247]: No targets found.
Oct 16 18:59:43 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:59:43 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc78d17-9c85-4ac6-a8c2-026ed0f661a9 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 18:59:43 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 18:59:43 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 18:59:43 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc78d17-9c85-4ac6-a8c2-026ed0f661a9 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 18:59:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:59:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:59:43 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5508670-d908-42e9-8b6f-8bbf7271999c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:59:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:59:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:59:43 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e95dba3-50af-49f6-adea-f69f2b0008d1]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:59:43 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc78d17-9c85-4ac6-a8c2-026ed0f661a9 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)
Oct 16 18:59:43 user nova-compute[74247]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c (non-flash)
Oct 16 18:59:43 user nova-compute[74247]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d (non-flash)
Oct 16 18:59:43 user nova-compute[74247]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2 (non-flash)
Oct 16 18:59:43 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 18:59:43 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc78d17-9c85-4ac6-a8c2-026ed0f661a9 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)
Oct 16 18:59:43 user nova-compute[74247]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c (non-flash)
Oct 16 18:59:43 user nova-compute[74247]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d (non-flash)
Oct 16 18:59:43 user nova-compute[74247]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2 (non-flash)
Oct 16 18:59:43 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 18:59:43 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc78d17-9c85-4ac6-a8c2-026ed0f661a9 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe0483e0ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c'): ({'sdc'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 18:59:43 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-3cc78d17-9c85-4ac6-a8c2-026ed0f661a9 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Removing single pathed devices sdc {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 18:59:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:59:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:59:43 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6191779f-d7d8-4677-a924-849d34538f8f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:59:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:59:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:59:43 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6322252e-2477-4dc8-bb7f-b81e40f13d1f]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:59:43 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-3cc78d17-9c85-4ac6-a8c2-026ed0f661a9 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Flushing IO for device /dev/sdc {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 18:59:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:59:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:59:43 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd36458a-2a57-456d-a36a-5a89ec54e741]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:59:43 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-3cc78d17-9c85-4ac6-a8c2-026ed0f661a9 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 18:59:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:59:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:59:43 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[358c0d55-c40e-4817-b1d2-0d9b47a65764]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:59:43 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-3cc78d17-9c85-4ac6-a8c2-026ed0f661a9 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 18:59:43 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-3cc78d17-9c85-4ac6-a8c2-026ed0f661a9 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] SCSI volumes sdc have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 18:59:43 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc78d17-9c85-4ac6-a8c2-026ed0f661a9 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 18:59:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:59:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:59:43 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[77415850-55ac-4e3b-af7b-ce51c2709af0]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:59:43 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc78d17-9c85-4ac6-a8c2-026ed0f661a9 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:59:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:59:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:59:44 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfec97a-a5ea-488b-9127-fae95aea737b]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:59:44 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc78d17-9c85-4ac6-a8c2-026ed0f661a9 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c, portal: 172.16.0.220,3260]
Oct 16 18:59:44 user nova-compute[74247]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c, portal: 172.16.0.220,3260] successful.
Oct 16 18:59:44 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:59:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:59:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dc2c3f7-02e8-4f37-8fc9-b4e84733c42c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:59:44 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94a8686-b94c-4801-86f0-e4ac6e7547df]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 18:59:44 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc78d17-9c85-4ac6-a8c2-026ed0f661a9 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 18:59:44 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-3cc78d17-9c85-4ac6-a8c2-026ed0f661a9 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 18:59:44 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc78d17-9c85-4ac6-a8c2-026ed0f661a9 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] <== disconnect_volume: return (314ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 18:59:44 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cc78d17-9c85-4ac6-a8c2-026ed0f661a9 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 18:59:44 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:59:44 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:59:44 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 18:59:44 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 18:59:44 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 18:59:44 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 18:59:45 user nova-compute[74247]: DEBUG nova.objects.instance [None req-3cc78d17-9c85-4ac6-a8c2-026ed0f661a9 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lazy-loading 'flavor' on Instance uuid 21858df7-6fd1-40cc-8a10-9a3da556907a {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 18:59:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3cc78d17-9c85-4ac6-a8c2-026ed0f661a9 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "21858df7-6fd1-40cc-8a10-9a3da556907a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.910s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:59:45 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 18:59:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:59:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:59:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:59:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:59:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:59:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 18:59:45 user nova-compute[74247]: DEBUG nova.virt.libvirt.imagecache [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Verify base images {{(pid=74247) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Oct 16 18:59:45 user nova-compute[74247]: DEBUG nova.virt.libvirt.imagecache [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74247) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 16 18:59:45 user nova-compute[74247]: DEBUG nova.virt.libvirt.imagecache [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Image id 83126bb1-29f5-42fe-8620-72ab0797f776 yields fingerprint 37399febbd18f60b85fd0f833558f6a3539ab231 {{(pid=74247) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 16 18:59:45 user nova-compute[74247]: INFO nova.virt.libvirt.imagecache [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] image 83126bb1-29f5-42fe-8620-72ab0797f776 at (/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231): checking
Oct 16 18:59:45 user nova-compute[74247]: DEBUG nova.virt.libvirt.imagecache [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] image 83126bb1-29f5-42fe-8620-72ab0797f776 at (/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231): image is in use {{(pid=74247) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Oct 16 18:59:45 user nova-compute[74247]: DEBUG nova.virt.libvirt.imagecache [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb is a valid instance name {{(pid=74247) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 16 18:59:45 user nova-compute[74247]: DEBUG nova.virt.libvirt.imagecache [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] e32e77fe-e842-433a-afa8-7d5a1f2c520c is a valid instance name {{(pid=74247) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 16 18:59:45 user nova-compute[74247]: DEBUG nova.virt.libvirt.imagecache [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] 21858df7-6fd1-40cc-8a10-9a3da556907a is a valid instance name {{(pid=74247) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 16 18:59:45 user nova-compute[74247]: DEBUG nova.virt.libvirt.imagecache [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] 21858df7-6fd1-40cc-8a10-9a3da556907a has a disk file {{(pid=74247) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 16 18:59:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21858df7-6fd1-40cc-8a10-9a3da556907a/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 18:59:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-385bdb22-117f-4877-9cc0-c19dffa54703 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquiring lock "21858df7-6fd1-40cc-8a10-9a3da556907a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 18:59:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-385bdb22-117f-4877-9cc0-c19dffa54703 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "21858df7-6fd1-40cc-8a10-9a3da556907a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 18:59:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21858df7-6fd1-40cc-8a10-9a3da556907a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 18:59:45 user nova-compute[74247]: DEBUG nova.virt.libvirt.imagecache [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 21858df7-6fd1-40cc-8a10-9a3da556907a is backed by 37399febbd18f60b85fd0f833558f6a3539ab231 {{(pid=74247) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 16 18:59:45 user nova-compute[74247]: WARNING nova.virt.libvirt.imagecache [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Unknown base file: /opt/stack/data/nova/instances/_base/549a5a2e227ed3b16aa088b87fe231d162d8dbeb
Oct 16 18:59:45 user nova-compute[74247]: WARNING nova.virt.libvirt.imagecache [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Unknown base file: /opt/stack/data/nova/instances/_base/0898cd6fc334f222de8047fd54b36971b7e86a9a
Oct 16 18:59:45 user nova-compute[74247]: WARNING nova.virt.libvirt.imagecache [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Unknown base file: /opt/stack/data/nova/instances/_base/ad817f0592afee347eb12ccd44fc0daef262fd01
Oct 16 18:59:45 user nova-compute[74247]: WARNING nova.virt.libvirt.imagecache [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Unknown base file: /opt/stack/data/nova/instances/_base/3d545e1a8f373cd8cf1ca41ef642a6fe078779dd
Oct 16 18:59:45 user nova-compute[74247]: WARNING nova.virt.libvirt.imagecache [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Unknown base file: /opt/stack/data/nova/instances/_base/59135e1b0fa50f04cac3a2f62863e34646a9e058
Oct 16 18:59:45 user nova-compute[74247]: WARNING nova.virt.libvirt.imagecache [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Unknown base file: /opt/stack/data/nova/instances/_base/d277c484e2e431185468996468b02e6a3473c85c
Oct 16 18:59:45 user nova-compute[74247]: INFO nova.virt.libvirt.imagecache [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Active base files: /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231
Oct 16 18:59:45 user nova-compute[74247]: INFO nova.virt.libvirt.imagecache [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Removable base files: /opt/stack/data/nova/instances/_base/549a5a2e227ed3b16aa088b87fe231d162d8dbeb /opt/stack/data/nova/instances/_base/0898cd6fc334f222de8047fd54b36971b7e86a9a /opt/stack/data/nova/instances/_base/ad817f0592afee347eb12ccd44fc0daef262fd01 /opt/stack/data/nova/instances/_base/3d545e1a8f373cd8cf1ca41ef642a6fe078779dd /opt/stack/data/nova/instances/_base/59135e1b0fa50f04cac3a2f62863e34646a9e058 /opt/stack/data/nova/instances/_base/d277c484e2e431185468996468b02e6a3473c85c
Oct 16 18:59:45 user nova-compute[74247]: INFO nova.virt.libvirt.imagecache [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/549a5a2e227ed3b16aa088b87fe231d162d8dbeb
Oct 16 18:59:45 user nova-compute[74247]: INFO nova.virt.libvirt.imagecache [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0898cd6fc334f222de8047fd54b36971b7e86a9a
Oct 16 18:59:45 user nova-compute[74247]: INFO nova.virt.libvirt.imagecache [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ad817f0592afee347eb12ccd44fc0daef262fd01
Oct 16 18:59:45 user nova-compute[74247]: INFO nova.virt.libvirt.imagecache [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3d545e1a8f373cd8cf1ca41ef642a6fe078779dd
Oct 16 18:59:45 user nova-compute[74247]: INFO nova.virt.libvirt.imagecache [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/59135e1b0fa50f04cac3a2f62863e34646a9e058
Oct 16 18:59:45 user nova-compute[74247]: INFO nova.virt.libvirt.imagecache [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d277c484e2e431185468996468b02e6a3473c85c
Oct 16 18:59:45 user nova-compute[74247]: DEBUG nova.virt.libvirt.imagecache [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Verification complete {{(pid=74247) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Oct 16 18:59:45 user nova-compute[74247]: DEBUG nova.virt.libvirt.imagecache [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Verify swap images {{(pid=74247) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Oct 16 18:59:45 user nova-compute[74247]: DEBUG nova.virt.libvirt.imagecache [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Verify ephemeral images {{(pid=74247) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Oct 16 18:59:45 user nova-compute[74247]: INFO nova.compute.manager [None req-385bdb22-117f-4877-9cc0-c19dffa54703 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Detaching volume 113a74ce-04e9-4b4c-b362-8560482139d2
Oct 16 18:59:45 user nova-compute[74247]: INFO nova.virt.block_device [None req-385bdb22-117f-4877-9cc0-c19dffa54703 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Attempting to driver detach volume 113a74ce-04e9-4b4c-b362-8560482139d2 from mountpoint /dev/vdc
Oct 16 18:59:45 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-385bdb22-117f-4877-9cc0-c19dffa54703 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Attempting to detach device vdc from instance 21858df7-6fd1-40cc-8a10-9a3da556907a from the persistent domain config. {{(pid=74247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 18:59:45 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-385bdb22-117f-4877-9cc0-c19dffa54703 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 18:59:45 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:59:45 user nova-compute[74247]:   <source dev="/dev/sde"/>
Oct 16 18:59:45 user nova-compute[74247]:   <target dev="vdc" bus="virtio"/>
Oct 16 18:59:45 user nova-compute[74247]:   <serial>113a74ce-04e9-4b4c-b362-8560482139d2</serial>
Oct 16 18:59:45 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 16 18:59:45 user nova-compute[74247]: </disk>
Oct 16 18:59:45 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:59:45 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-385bdb22-117f-4877-9cc0-c19dffa54703 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Successfully detached device vdc from instance 21858df7-6fd1-40cc-8a10-9a3da556907a from the persistent domain config.
Oct 16 18:59:45 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-385bdb22-117f-4877-9cc0-c19dffa54703 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 21858df7-6fd1-40cc-8a10-9a3da556907a from the live domain config. {{(pid=74247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 18:59:45 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-385bdb22-117f-4877-9cc0-c19dffa54703 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 18:59:45 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 18:59:45 user nova-compute[74247]:   <source dev="/dev/sde"/>
Oct 16 18:59:45 user nova-compute[74247]:   <target dev="vdc" bus="virtio"/>
Oct 16 18:59:45 user nova-compute[74247]:   <serial>113a74ce-04e9-4b4c-b362-8560482139d2</serial>
Oct 16 18:59:45 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 16 18:59:45 user nova-compute[74247]: </disk>
Oct 16 18:59:45 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 18:59:46 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-385bdb22-117f-4877-9cc0-c19dffa54703 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 21858df7-6fd1-40cc-8a10-9a3da556907a {{(pid=74247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 18:59:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:59:54 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:59:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:59:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 18:59:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 18:59:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 18:59:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 18:59:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG nova.compute.manager [req-6bdb695e-3822-471e-a128-a2e5fd0a9e16 req-fa37e1d6-ee07-4917-a0b2-c3e0dd7f7190 service nova] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Received event network-changed-bfe88395-ff2c-4fc3-bf1d-b4e165044b8a {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG nova.compute.manager [req-6bdb695e-3822-471e-a128-a2e5fd0a9e16 req-fa37e1d6-ee07-4917-a0b2-c3e0dd7f7190 service nova] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Refreshing instance network info cache due to event network-changed-bfe88395-ff2c-4fc3-bf1d-b4e165044b8a. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-6bdb695e-3822-471e-a128-a2e5fd0a9e16 req-fa37e1d6-ee07-4917-a0b2-c3e0dd7f7190 service nova] Acquiring lock "refresh_cache-e32e77fe-e842-433a-afa8-7d5a1f2c520c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-6bdb695e-3822-471e-a128-a2e5fd0a9e16 req-fa37e1d6-ee07-4917-a0b2-c3e0dd7f7190 service nova] Acquired lock "refresh_cache-e32e77fe-e842-433a-afa8-7d5a1f2c520c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG nova.network.neutron [req-6bdb695e-3822-471e-a128-a2e5fd0a9e16 req-fa37e1d6-ee07-4917-a0b2-c3e0dd7f7190 service nova] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Refreshing network info cache for port bfe88395-ff2c-4fc3-bf1d-b4e165044b8a {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 19:00:06 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-385bdb22-117f-4877-9cc0-c19dffa54703 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 21858df7-6fd1-40cc-8a10-9a3da556907a is timed out.
Oct 16 19:00:06 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-385bdb22-117f-4877-9cc0-c19dffa54703 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Successfully detached device vdc from instance 21858df7-6fd1-40cc-8a10-9a3da556907a from the live domain config.
Oct 16 19:00:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-385bdb22-117f-4877-9cc0-c19dffa54703 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-385bdb22-117f-4877-9cc0-c19dffa54703 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MknKAdNy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 19:00:06 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-385bdb22-117f-4877-9cc0-c19dffa54703 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 19:00:06 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-385bdb22-117f-4877-9cc0-c19dffa54703 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-385bdb22-117f-4877-9cc0-c19dffa54703 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c758671-7e4e-4dbd-83be-0527ca482e25]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-385bdb22-117f-4877-9cc0-c19dffa54703 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 19:00:06 user nova-compute[74247]: No targets found.
Oct 16 19:00:06 user nova-compute[74247]: iSNS:
Oct 16 19:00:06 user nova-compute[74247]: No targets found.
Oct 16 19:00:06 user nova-compute[74247]: STATIC:
Oct 16 19:00:06 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d
Oct 16 19:00:06 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 19:00:06 user nova-compute[74247]:                 Iface Name: default
Oct 16 19:00:06 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec
Oct 16 19:00:06 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 19:00:06 user nova-compute[74247]:                 Iface Name: default
Oct 16 19:00:06 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2
Oct 16 19:00:06 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 19:00:06 user nova-compute[74247]:                 Iface Name: default
Oct 16 19:00:06 user nova-compute[74247]: FIRMWARE:
Oct 16 19:00:06 user nova-compute[74247]: No targets found.
Oct 16 19:00:06 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-385bdb22-117f-4877-9cc0-c19dffa54703 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 19:00:06 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 19:00:06 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-385bdb22-117f-4877-9cc0-c19dffa54703 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG nova.network.neutron [req-6bdb695e-3822-471e-a128-a2e5fd0a9e16 req-fa37e1d6-ee07-4917-a0b2-c3e0dd7f7190 service nova] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Updated VIF entry in instance network info cache for port bfe88395-ff2c-4fc3-bf1d-b4e165044b8a. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG nova.network.neutron [req-6bdb695e-3822-471e-a128-a2e5fd0a9e16 req-fa37e1d6-ee07-4917-a0b2-c3e0dd7f7190 service nova] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Updating instance_info_cache with network_info: [{"id": "bfe88395-ff2c-4fc3-bf1d-b4e165044b8a", "address": "fa:16:3e:e6:e4:9f", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe88395-ff", "ovs_interfaceid": "bfe88395-ff2c-4fc3-bf1d-b4e165044b8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[735dd144-59d1-4bd0-b563-581854e59267]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-6bdb695e-3822-471e-a128-a2e5fd0a9e16 req-fa37e1d6-ee07-4917-a0b2-c3e0dd7f7190 service nova] Releasing lock "refresh_cache-e32e77fe-e842-433a-afa8-7d5a1f2c520c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f69ae4-8bd6-47f7-af1e-8109102aec49]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-385bdb22-117f-4877-9cc0-c19dffa54703 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)
Oct 16 19:00:06 user nova-compute[74247]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d (non-flash)
Oct 16 19:00:06 user nova-compute[74247]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2 (non-flash)
Oct 16 19:00:06 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-385bdb22-117f-4877-9cc0-c19dffa54703 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)
Oct 16 19:00:06 user nova-compute[74247]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d (non-flash)
Oct 16 19:00:06 user nova-compute[74247]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2 (non-flash)
Oct 16 19:00:06 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-385bdb22-117f-4877-9cc0-c19dffa54703 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe048798af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2'): ({'sde'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-385bdb22-117f-4877-9cc0-c19dffa54703 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Removing single pathed devices sde {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c472b1-735c-4829-af00-a790c391db98]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e774445-3856-489c-9de6-c86b9157e4ea]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-385bdb22-117f-4877-9cc0-c19dffa54703 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Flushing IO for device /dev/sde {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4490a1-71f5-4f72-9944-2ec6b577e014]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-385bdb22-117f-4877-9cc0-c19dffa54703 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "e32e77fe-e842-433a-afa8-7d5a1f2c520c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "e32e77fe-e842-433a-afa8-7d5a1f2c520c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "e32e77fe-e842-433a-afa8-7d5a1f2c520c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "e32e77fe-e842-433a-afa8-7d5a1f2c520c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "e32e77fe-e842-433a-afa8-7d5a1f2c520c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:00:06 user nova-compute[74247]: INFO nova.compute.manager [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Terminating instance
Oct 16 19:00:06 user nova-compute[74247]: DEBUG nova.compute.manager [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d7e491-4389-4541-9c0e-338a87a485ff]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-385bdb22-117f-4877-9cc0-c19dffa54703 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-385bdb22-117f-4877-9cc0-c19dffa54703 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] SCSI volumes sde have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-385bdb22-117f-4877-9cc0-c19dffa54703 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d965b5-9ba3-4630-9711-345df83edc6b]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-385bdb22-117f-4877-9cc0-c19dffa54703 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2 -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[947227f2-d17b-4800-b4bb-3f7b69b3e358]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-385bdb22-117f-4877-9cc0-c19dffa54703 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2, portal: 172.16.0.220,3260]
Oct 16 19:00:06 user nova-compute[74247]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2, portal: 172.16.0.220,3260] successful.
Oct 16 19:00:06 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2 -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113a74ce-04e9-4b4c-b362-8560482139d2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e2a2b5-0b2e-4a38-8ce7-3b28b615f3b8]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-385bdb22-117f-4877-9cc0-c19dffa54703 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-385bdb22-117f-4877-9cc0-c19dffa54703 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-385bdb22-117f-4877-9cc0-c19dffa54703 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] <== disconnect_volume: return (346ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-385bdb22-117f-4877-9cc0-c19dffa54703 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG nova.compute.manager [req-7641b17d-7b65-4c4c-99ee-85c2b4ca01e4 req-5fd02301-80f4-4ace-9cb8-f49e5846152f service nova] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Received event network-vif-unplugged-bfe88395-ff2c-4fc3-bf1d-b4e165044b8a {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7641b17d-7b65-4c4c-99ee-85c2b4ca01e4 req-5fd02301-80f4-4ace-9cb8-f49e5846152f service nova] Acquiring lock "e32e77fe-e842-433a-afa8-7d5a1f2c520c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7641b17d-7b65-4c4c-99ee-85c2b4ca01e4 req-5fd02301-80f4-4ace-9cb8-f49e5846152f service nova] Lock "e32e77fe-e842-433a-afa8-7d5a1f2c520c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7641b17d-7b65-4c4c-99ee-85c2b4ca01e4 req-5fd02301-80f4-4ace-9cb8-f49e5846152f service nova] Lock "e32e77fe-e842-433a-afa8-7d5a1f2c520c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG nova.compute.manager [req-7641b17d-7b65-4c4c-99ee-85c2b4ca01e4 req-5fd02301-80f4-4ace-9cb8-f49e5846152f service nova] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] No waiting events found dispatching network-vif-unplugged-bfe88395-ff2c-4fc3-bf1d-b4e165044b8a {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG nova.compute.manager [req-7641b17d-7b65-4c4c-99ee-85c2b4ca01e4 req-5fd02301-80f4-4ace-9cb8-f49e5846152f service nova] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Received event network-vif-unplugged-bfe88395-ff2c-4fc3-bf1d-b4e165044b8a for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 19:00:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:07 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Instance destroyed successfully.
Oct 16 19:00:07 user nova-compute[74247]: DEBUG nova.objects.instance [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lazy-loading 'resources' on Instance uuid e32e77fe-e842-433a-afa8-7d5a1f2c520c {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:58:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-430871348',display_name='tempest-TestVolumeBootPattern-server-430871348',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-430871348',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjgu1PdB/VXTN5rZ7oE5e7ovtw+8pzQ24n8jIU2366r669SEEAxAB/9LNF+VOEmvr2qFXyje/n1vbSVuotOeSuaNNrodAuV6fmL4YsSSNhGH3oIDcKRDUc8ro4Dw/7HjQ==',key_name='tempest-TestVolumeBootPattern-34627609',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:58:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dca6144ea4e14c28b085e271175bbf67',ramdisk_id='',reservation_id='r-at27gnjp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1733357121',owner_user_name='tempest-TestVolumeBootPattern-1733357121-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:58:37Z,user_data=None,user_id='9608bf58b70248439dbbcc9db38fba08',uuid=e32e77fe-e842-433a-afa8-7d5a1f2c520c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bfe88395-ff2c-4fc3-bf1d-b4e165044b8a", "address": "fa:16:3e:e6:e4:9f", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe88395-ff", "ovs_interfaceid": "bfe88395-ff2c-4fc3-bf1d-b4e165044b8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Converting VIF {"id": "bfe88395-ff2c-4fc3-bf1d-b4e165044b8a", "address": "fa:16:3e:e6:e4:9f", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe88395-ff", "ovs_interfaceid": "bfe88395-ff2c-4fc3-bf1d-b4e165044b8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:e4:9f,bridge_name='br-int',has_traffic_filtering=True,id=bfe88395-ff2c-4fc3-bf1d-b4e165044b8a,network=Network(9688c665-d4b7-4179-9a76-fdf6c3013b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfe88395-ff') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG os_vif [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:e4:9f,bridge_name='br-int',has_traffic_filtering=True,id=bfe88395-ff2c-4fc3-bf1d-b4e165044b8a,network=Network(9688c665-d4b7-4179-9a76-fdf6c3013b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfe88395-ff') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbfe88395-ff, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cf0cd7f8-661d-42c2-93f5-782ab180fadb) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:00:07 user nova-compute[74247]: INFO os_vif [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:e4:9f,bridge_name='br-int',has_traffic_filtering=True,id=bfe88395-ff2c-4fc3-bf1d-b4e165044b8a,network=Network(9688c665-d4b7-4179-9a76-fdf6c3013b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfe88395-ff')
Oct 16 19:00:07 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jYJEeRfp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 19:00:07 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 19:00:07 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[99eae1bb-65b2-4638-bb7f-ac066e26097c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 19:00:07 user nova-compute[74247]: No targets found.
Oct 16 19:00:07 user nova-compute[74247]: iSNS:
Oct 16 19:00:07 user nova-compute[74247]: No targets found.
Oct 16 19:00:07 user nova-compute[74247]: STATIC:
Oct 16 19:00:07 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d
Oct 16 19:00:07 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 19:00:07 user nova-compute[74247]:                 Iface Name: default
Oct 16 19:00:07 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec
Oct 16 19:00:07 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 19:00:07 user nova-compute[74247]:                 Iface Name: default
Oct 16 19:00:07 user nova-compute[74247]: FIRMWARE:
Oct 16 19:00:07 user nova-compute[74247]: No targets found.
Oct 16 19:00:07 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 19:00:07 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 19:00:07 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f54607-c31e-43b0-86ef-18a4b0e9cc1b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[156b6da6-8d7e-4897-9802-a17f66a38824]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)
Oct 16 19:00:07 user nova-compute[74247]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d (non-flash)
Oct 16 19:00:07 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)
Oct 16 19:00:07 user nova-compute[74247]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d (non-flash)
Oct 16 19:00:07 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe068212050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec'): ({'sdb'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Removing single pathed devices sdb {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b111357f-3a62-48d7-ab8a-0ca0521a0b9e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdcdd026-8d9f-4eef-a0f7-80b6969fa075]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Flushing IO for device /dev/sdb {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef9a9b4-2279-4bde-925c-27484af3b343]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG nova.objects.instance [None req-385bdb22-117f-4877-9cc0-c19dffa54703 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lazy-loading 'flavor' on Instance uuid 21858df7-6fd1-40cc-8a10-9a3da556907a {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.060s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92c3ac2-6d91-4afd-ab80-76d0636dc4b9]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] SCSI volumes sdb have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-385bdb22-117f-4877-9cc0-c19dffa54703 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "21858df7-6fd1-40cc-8a10-9a3da556907a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.853s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8bba06-a5e7-440b-aee6-7bba7a0009a4]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf1ea80-53dd-4661-9ad8-341a19024529]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec, portal: 172.16.0.220,3260]
Oct 16 19:00:07 user nova-compute[74247]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec, portal: 172.16.0.220,3260] successful.
Oct 16 19:00:07 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43b1de3-600e-417b-8794-2b78eb966f91]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] <== disconnect_volume: return (334ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 19:00:07 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Deleting instance files /opt/stack/data/nova/instances/e32e77fe-e842-433a-afa8-7d5a1f2c520c_del
Oct 16 19:00:07 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Deletion of /opt/stack/data/nova/instances/e32e77fe-e842-433a-afa8-7d5a1f2c520c_del complete
Oct 16 19:00:07 user nova-compute[74247]: INFO nova.compute.manager [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Took 1.28 seconds to destroy the instance on the hypervisor.
Oct 16 19:00:07 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 19:00:07 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 19:00:08 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:00:08 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Took 0.70 seconds to deallocate network for instance.
Oct 16 19:00:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-7ec30fa8-681d-4db2-ad40-f937bc545e79 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquiring lock "21858df7-6fd1-40cc-8a10-9a3da556907a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:00:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-7ec30fa8-681d-4db2-ad40-f937bc545e79 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "21858df7-6fd1-40cc-8a10-9a3da556907a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:00:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-7ec30fa8-681d-4db2-ad40-f937bc545e79 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquiring lock "21858df7-6fd1-40cc-8a10-9a3da556907a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:00:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-7ec30fa8-681d-4db2-ad40-f937bc545e79 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "21858df7-6fd1-40cc-8a10-9a3da556907a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:00:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-7ec30fa8-681d-4db2-ad40-f937bc545e79 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "21858df7-6fd1-40cc-8a10-9a3da556907a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:00:08 user nova-compute[74247]: INFO nova.compute.manager [None req-7ec30fa8-681d-4db2-ad40-f937bc545e79 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Terminating instance
Oct 16 19:00:08 user nova-compute[74247]: DEBUG nova.compute.manager [None req-7ec30fa8-681d-4db2-ad40-f937bc545e79 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 19:00:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:08 user nova-compute[74247]: DEBUG nova.compute.manager [req-251fe793-edc7-4af1-988a-8bc0ba9b9aa6 req-6aa49016-eeb3-4362-a722-50d2f4d4616c service nova] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Received event network-vif-plugged-bfe88395-ff2c-4fc3-bf1d-b4e165044b8a {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:00:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-251fe793-edc7-4af1-988a-8bc0ba9b9aa6 req-6aa49016-eeb3-4362-a722-50d2f4d4616c service nova] Acquiring lock "e32e77fe-e842-433a-afa8-7d5a1f2c520c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:00:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-251fe793-edc7-4af1-988a-8bc0ba9b9aa6 req-6aa49016-eeb3-4362-a722-50d2f4d4616c service nova] Lock "e32e77fe-e842-433a-afa8-7d5a1f2c520c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:00:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-251fe793-edc7-4af1-988a-8bc0ba9b9aa6 req-6aa49016-eeb3-4362-a722-50d2f4d4616c service nova] Lock "e32e77fe-e842-433a-afa8-7d5a1f2c520c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:00:08 user nova-compute[74247]: DEBUG nova.compute.manager [req-251fe793-edc7-4af1-988a-8bc0ba9b9aa6 req-6aa49016-eeb3-4362-a722-50d2f4d4616c service nova] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] No waiting events found dispatching network-vif-plugged-bfe88395-ff2c-4fc3-bf1d-b4e165044b8a {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:00:08 user nova-compute[74247]: WARNING nova.compute.manager [req-251fe793-edc7-4af1-988a-8bc0ba9b9aa6 req-6aa49016-eeb3-4362-a722-50d2f4d4616c service nova] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Received unexpected event network-vif-plugged-bfe88395-ff2c-4fc3-bf1d-b4e165044b8a for instance with vm_state active and task_state deleting.
Oct 16 19:00:08 user nova-compute[74247]: DEBUG nova.compute.manager [req-251fe793-edc7-4af1-988a-8bc0ba9b9aa6 req-6aa49016-eeb3-4362-a722-50d2f4d4616c service nova] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Received event network-vif-deleted-bfe88395-ff2c-4fc3-bf1d-b4e165044b8a {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:00:09 user nova-compute[74247]: INFO nova.compute.manager [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e32e77fe-e842-433a-afa8-7d5a1f2c520c] Took 0.85 seconds to detach 1 volumes for instance.
Oct 16 19:00:09 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Instance destroyed successfully.
Oct 16 19:00:09 user nova-compute[74247]: DEBUG nova.objects.instance [None req-7ec30fa8-681d-4db2-ad40-f937bc545e79 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lazy-loading 'resources' on Instance uuid 21858df7-6fd1-40cc-8a10-9a3da556907a {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:00:09 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-7ec30fa8-681d-4db2-ad40-f937bc545e79 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:56:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1531065292',display_name='tempest-AttachVolumeTestJSON-server-1531065292',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1531065292',id=43,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJEqzSgXHBN7C+HieFjFe62sYAqeULyzrja3mgIUnaSldFC5YDlqYJCEUBMKNnoZxaUFdxoK3EtY3ZdMUwv1kY2jRpxTxWveDCmqed2My+CAlBHl/kVg7RhGKoufk0XTYg==',key_name='tempest-keypair-947137152',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:56:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d6d2ba688434391b03a9f3320a360de',ramdisk_id='',reservation_id='r-m0u45cpj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1409761379',owner_user_name='tempest-AttachVolumeTestJSON-1409761379-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:56:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82c71a4cbbf8436dbfdc43bb4db65ef1',uuid=21858df7-6fd1-40cc-8a10-9a3da556907a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39edf3ea-59f0-4c49-a29a-35891ae05d66", "address": "fa:16:3e:f0:f7:81", "network": {"id": "14ee32da-d0e3-499f-bd47-721e882b2a57", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-700103883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6d2ba688434391b03a9f3320a360de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39edf3ea-59", "ovs_interfaceid": "39edf3ea-59f0-4c49-a29a-35891ae05d66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 19:00:09 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-7ec30fa8-681d-4db2-ad40-f937bc545e79 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Converting VIF {"id": "39edf3ea-59f0-4c49-a29a-35891ae05d66", "address": "fa:16:3e:f0:f7:81", "network": {"id": "14ee32da-d0e3-499f-bd47-721e882b2a57", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-700103883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6d2ba688434391b03a9f3320a360de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39edf3ea-59", "ovs_interfaceid": "39edf3ea-59f0-4c49-a29a-35891ae05d66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 19:00:09 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-7ec30fa8-681d-4db2-ad40-f937bc545e79 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:f7:81,bridge_name='br-int',has_traffic_filtering=True,id=39edf3ea-59f0-4c49-a29a-35891ae05d66,network=Network(14ee32da-d0e3-499f-bd47-721e882b2a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39edf3ea-59') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 19:00:09 user nova-compute[74247]: DEBUG os_vif [None req-7ec30fa8-681d-4db2-ad40-f937bc545e79 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:f7:81,bridge_name='br-int',has_traffic_filtering=True,id=39edf3ea-59f0-4c49-a29a-35891ae05d66,network=Network(14ee32da-d0e3-499f-bd47-721e882b2a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39edf3ea-59') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 19:00:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap39edf3ea-59, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:00:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:00:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=76c81754-b79c-439f-a3ec-954d4ce316ca) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:00:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:00:09 user nova-compute[74247]: INFO os_vif [None req-7ec30fa8-681d-4db2-ad40-f937bc545e79 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:f7:81,bridge_name='br-int',has_traffic_filtering=True,id=39edf3ea-59f0-4c49-a29a-35891ae05d66,network=Network(14ee32da-d0e3-499f-bd47-721e882b2a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39edf3ea-59')
Oct 16 19:00:09 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-7ec30fa8-681d-4db2-ad40-f937bc545e79 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Deleting instance files /opt/stack/data/nova/instances/21858df7-6fd1-40cc-8a10-9a3da556907a_del
Oct 16 19:00:09 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-7ec30fa8-681d-4db2-ad40-f937bc545e79 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Deletion of /opt/stack/data/nova/instances/21858df7-6fd1-40cc-8a10-9a3da556907a_del complete
Oct 16 19:00:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:00:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:00:09 user nova-compute[74247]: INFO nova.compute.manager [None req-7ec30fa8-681d-4db2-ad40-f937bc545e79 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Took 1.01 seconds to destroy the instance on the hypervisor.
Oct 16 19:00:09 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-7ec30fa8-681d-4db2-ad40-f937bc545e79 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 19:00:09 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 19:00:09 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 19:00:09 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 19:00:09 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 19:00:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.156s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:00:09 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Deleted allocations for instance e32e77fe-e842-433a-afa8-7d5a1f2c520c
Oct 16 19:00:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-7991edfb-c048-4c6b-8263-abca267a1ba3 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "e32e77fe-e842-433a-afa8-7d5a1f2c520c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.368s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:00:10 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:00:10 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Took 1.11 seconds to deallocate network for instance.
Oct 16 19:00:10 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-7ec30fa8-681d-4db2-ad40-f937bc545e79 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:00:10 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-7ec30fa8-681d-4db2-ad40-f937bc545e79 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:00:10 user nova-compute[74247]: DEBUG nova.compute.manager [req-c042b143-ecd3-46bf-931a-81dd347c96d5 req-4976d224-6a9c-4617-a54d-038ce18003c6 service nova] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Received event network-vif-unplugged-39edf3ea-59f0-4c49-a29a-35891ae05d66 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:00:10 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c042b143-ecd3-46bf-931a-81dd347c96d5 req-4976d224-6a9c-4617-a54d-038ce18003c6 service nova] Acquiring lock "21858df7-6fd1-40cc-8a10-9a3da556907a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:00:10 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c042b143-ecd3-46bf-931a-81dd347c96d5 req-4976d224-6a9c-4617-a54d-038ce18003c6 service nova] Lock "21858df7-6fd1-40cc-8a10-9a3da556907a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:00:10 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c042b143-ecd3-46bf-931a-81dd347c96d5 req-4976d224-6a9c-4617-a54d-038ce18003c6 service nova] Lock "21858df7-6fd1-40cc-8a10-9a3da556907a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:00:10 user nova-compute[74247]: DEBUG nova.compute.manager [req-c042b143-ecd3-46bf-931a-81dd347c96d5 req-4976d224-6a9c-4617-a54d-038ce18003c6 service nova] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] No waiting events found dispatching network-vif-unplugged-39edf3ea-59f0-4c49-a29a-35891ae05d66 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:00:10 user nova-compute[74247]: WARNING nova.compute.manager [req-c042b143-ecd3-46bf-931a-81dd347c96d5 req-4976d224-6a9c-4617-a54d-038ce18003c6 service nova] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Received unexpected event network-vif-unplugged-39edf3ea-59f0-4c49-a29a-35891ae05d66 for instance with vm_state deleted and task_state None.
Oct 16 19:00:10 user nova-compute[74247]: DEBUG nova.compute.manager [req-c042b143-ecd3-46bf-931a-81dd347c96d5 req-4976d224-6a9c-4617-a54d-038ce18003c6 service nova] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Received event network-vif-plugged-39edf3ea-59f0-4c49-a29a-35891ae05d66 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:00:10 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c042b143-ecd3-46bf-931a-81dd347c96d5 req-4976d224-6a9c-4617-a54d-038ce18003c6 service nova] Acquiring lock "21858df7-6fd1-40cc-8a10-9a3da556907a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:00:10 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c042b143-ecd3-46bf-931a-81dd347c96d5 req-4976d224-6a9c-4617-a54d-038ce18003c6 service nova] Lock "21858df7-6fd1-40cc-8a10-9a3da556907a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:00:10 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-c042b143-ecd3-46bf-931a-81dd347c96d5 req-4976d224-6a9c-4617-a54d-038ce18003c6 service nova] Lock "21858df7-6fd1-40cc-8a10-9a3da556907a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:00:10 user nova-compute[74247]: DEBUG nova.compute.manager [req-c042b143-ecd3-46bf-931a-81dd347c96d5 req-4976d224-6a9c-4617-a54d-038ce18003c6 service nova] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] No waiting events found dispatching network-vif-plugged-39edf3ea-59f0-4c49-a29a-35891ae05d66 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:00:10 user nova-compute[74247]: WARNING nova.compute.manager [req-c042b143-ecd3-46bf-931a-81dd347c96d5 req-4976d224-6a9c-4617-a54d-038ce18003c6 service nova] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Received unexpected event network-vif-plugged-39edf3ea-59f0-4c49-a29a-35891ae05d66 for instance with vm_state deleted and task_state None.
Oct 16 19:00:10 user nova-compute[74247]: DEBUG nova.compute.manager [req-c042b143-ecd3-46bf-931a-81dd347c96d5 req-4976d224-6a9c-4617-a54d-038ce18003c6 service nova] [instance: 21858df7-6fd1-40cc-8a10-9a3da556907a] Received event network-vif-deleted-39edf3ea-59f0-4c49-a29a-35891ae05d66 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:00:10 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-7ec30fa8-681d-4db2-ad40-f937bc545e79 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 19:00:11 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-7ec30fa8-681d-4db2-ad40-f937bc545e79 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 19:00:11 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-7ec30fa8-681d-4db2-ad40-f937bc545e79 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.131s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:00:11 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-7ec30fa8-681d-4db2-ad40-f937bc545e79 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Deleted allocations for instance 21858df7-6fd1-40cc-8a10-9a3da556907a
Oct 16 19:00:11 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-7ec30fa8-681d-4db2-ad40-f937bc545e79 tempest-AttachVolumeTestJSON-1409761379 tempest-AttachVolumeTestJSON-1409761379-project-member] Lock "21858df7-6fd1-40cc-8a10-9a3da556907a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.426s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:00:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:17 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:00:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:19 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:00:21 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:00:21 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:00:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:00:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:00:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:00:21 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 19:00:21 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 19:00:22 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:00:22 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:00:22 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=8858MB free_disk=25.01374053955078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 19:00:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:00:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:00:22 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 19:00:22 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 19:00:22 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 19:00:22 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 19:00:22 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 19:00:22 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 19:00:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.219s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:00:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:00:24 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:00:24 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 19:00:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "refresh_cache-7f04ea2b-a029-44d9-ac7a-ea2b870d20eb" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:00:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquired lock "refresh_cache-7f04ea2b-a029-44d9-ac7a-ea2b870d20eb" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:00:24 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Forcefully refreshing network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 19:00:25 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Updating instance_info_cache with network_info: [{"id": "f9d88799-cade-4fd4-a9d3-d2ac928f20c7", "address": "fa:16:3e:75:c0:0d", "network": {"id": "17f634c2-25e8-4655-8439-6a5e5d9c7e77", "bridge": "br-int", "label": "tempest-TestShelveInstance-161802280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863980f09120465ebbfb273efa0f07df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9d88799-ca", "ovs_interfaceid": "f9d88799-cade-4fd4-a9d3-d2ac928f20c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:00:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Releasing lock "refresh_cache-7f04ea2b-a029-44d9-ac7a-ea2b870d20eb" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:00:25 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Updated the network info_cache for instance {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 19:00:25 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:00:25 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Cleaning up deleted instances with incomplete migration  {{(pid=74247) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 16 19:00:26 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:00:27 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:00:27 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._sync_power_states {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:00:27 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Triggering sync for uuid 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb {{(pid=74247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 19:00:27 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:00:27 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:00:27 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:00:29 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:00:29 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:00:29 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:00:29 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 19:00:30 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:00:30 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Cleaning up deleted instances {{(pid=74247) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 16 19:00:30 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] There are 0 instances to clean {{(pid=74247) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 16 19:00:31 user nova-compute[74247]: DEBUG nova.compute.manager [req-0b74596b-595d-41c9-ad15-904436368d85 req-aa1da22f-85b8-4542-b477-4f4d72f22b80 service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Received event network-changed-f9d88799-cade-4fd4-a9d3-d2ac928f20c7 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:00:31 user nova-compute[74247]: DEBUG nova.compute.manager [req-0b74596b-595d-41c9-ad15-904436368d85 req-aa1da22f-85b8-4542-b477-4f4d72f22b80 service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Refreshing instance network info cache due to event network-changed-f9d88799-cade-4fd4-a9d3-d2ac928f20c7. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 19:00:31 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0b74596b-595d-41c9-ad15-904436368d85 req-aa1da22f-85b8-4542-b477-4f4d72f22b80 service nova] Acquiring lock "refresh_cache-7f04ea2b-a029-44d9-ac7a-ea2b870d20eb" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:00:31 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0b74596b-595d-41c9-ad15-904436368d85 req-aa1da22f-85b8-4542-b477-4f4d72f22b80 service nova] Acquired lock "refresh_cache-7f04ea2b-a029-44d9-ac7a-ea2b870d20eb" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:00:31 user nova-compute[74247]: DEBUG nova.network.neutron [req-0b74596b-595d-41c9-ad15-904436368d85 req-aa1da22f-85b8-4542-b477-4f4d72f22b80 service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Refreshing network info cache for port f9d88799-cade-4fd4-a9d3-d2ac928f20c7 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 19:00:31 user nova-compute[74247]: DEBUG nova.network.neutron [req-0b74596b-595d-41c9-ad15-904436368d85 req-aa1da22f-85b8-4542-b477-4f4d72f22b80 service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Updated VIF entry in instance network info cache for port f9d88799-cade-4fd4-a9d3-d2ac928f20c7. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 19:00:31 user nova-compute[74247]: DEBUG nova.network.neutron [req-0b74596b-595d-41c9-ad15-904436368d85 req-aa1da22f-85b8-4542-b477-4f4d72f22b80 service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Updating instance_info_cache with network_info: [{"id": "f9d88799-cade-4fd4-a9d3-d2ac928f20c7", "address": "fa:16:3e:75:c0:0d", "network": {"id": "17f634c2-25e8-4655-8439-6a5e5d9c7e77", "bridge": "br-int", "label": "tempest-TestShelveInstance-161802280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863980f09120465ebbfb273efa0f07df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9d88799-ca", "ovs_interfaceid": "f9d88799-cade-4fd4-a9d3-d2ac928f20c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:00:31 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0b74596b-595d-41c9-ad15-904436368d85 req-aa1da22f-85b8-4542-b477-4f4d72f22b80 service nova] Releasing lock "refresh_cache-7f04ea2b-a029-44d9-ac7a-ea2b870d20eb" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:00:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:31 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Acquiring lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:00:31 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:00:31 user nova-compute[74247]: INFO nova.compute.manager [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Shelve offloading
Oct 16 19:00:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:32 user nova-compute[74247]: DEBUG nova.compute.manager [req-86db9046-caef-47e9-b16a-c1492db9be26 req-393abf3b-76a8-428d-b9a0-e2f7987b3018 service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Received event network-vif-unplugged-f9d88799-cade-4fd4-a9d3-d2ac928f20c7 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:00:32 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-86db9046-caef-47e9-b16a-c1492db9be26 req-393abf3b-76a8-428d-b9a0-e2f7987b3018 service nova] Acquiring lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:00:32 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-86db9046-caef-47e9-b16a-c1492db9be26 req-393abf3b-76a8-428d-b9a0-e2f7987b3018 service nova] Lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:00:32 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-86db9046-caef-47e9-b16a-c1492db9be26 req-393abf3b-76a8-428d-b9a0-e2f7987b3018 service nova] Lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:00:32 user nova-compute[74247]: DEBUG nova.compute.manager [req-86db9046-caef-47e9-b16a-c1492db9be26 req-393abf3b-76a8-428d-b9a0-e2f7987b3018 service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] No waiting events found dispatching network-vif-unplugged-f9d88799-cade-4fd4-a9d3-d2ac928f20c7 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:00:32 user nova-compute[74247]: WARNING nova.compute.manager [req-86db9046-caef-47e9-b16a-c1492db9be26 req-393abf3b-76a8-428d-b9a0-e2f7987b3018 service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Received unexpected event network-vif-unplugged-f9d88799-cade-4fd4-a9d3-d2ac928f20c7 for instance with vm_state active and task_state shelving.
Oct 16 19:00:32 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:00:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:32 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Instance destroyed successfully.
Oct 16 19:00:32 user nova-compute[74247]: DEBUG nova.compute.manager [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 19:00:32 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Acquiring lock "refresh_cache-7f04ea2b-a029-44d9-ac7a-ea2b870d20eb" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:00:32 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Acquired lock "refresh_cache-7f04ea2b-a029-44d9-ac7a-ea2b870d20eb" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:00:32 user nova-compute[74247]: DEBUG nova.network.neutron [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 19:00:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG nova.network.neutron [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Updating instance_info_cache with network_info: [{"id": "f9d88799-cade-4fd4-a9d3-d2ac928f20c7", "address": "fa:16:3e:75:c0:0d", "network": {"id": "17f634c2-25e8-4655-8439-6a5e5d9c7e77", "bridge": "br-int", "label": "tempest-TestShelveInstance-161802280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863980f09120465ebbfb273efa0f07df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9d88799-ca", "ovs_interfaceid": "f9d88799-cade-4fd4-a9d3-d2ac928f20c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Releasing lock "refresh_cache-7f04ea2b-a029-44d9-ac7a-ea2b870d20eb" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:33 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Instance destroyed successfully.
Oct 16 19:00:33 user nova-compute[74247]: DEBUG nova.objects.instance [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Lazy-loading 'resources' on Instance uuid 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T18:58:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-245644659',display_name='tempest-TestShelveInstance-server-245644659',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-245644659',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/wf3BAEOMqughkEq4Tr/5OFR/Et8qfg2eC6E01VThl/SE94s5bUkzrQ94y/QPhbXlS9dcM60h3HYQrp5CekWdEAALbss9fke59qoj5EpsJOSElLn9HSV7oXrxf0+PLHQ==',key_name='tempest-TestShelveInstance-1763650089',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:59:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='863980f09120465ebbfb273efa0f07df',ramdisk_id='',reservation_id='r-sduxnmst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-565913270',owner_user_name='tempest-TestShelveInstance-565913270-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T18:59:03Z,user_data=None,user_id='b18bdb21bba141089a9de12a98b7d976',uuid=7f04ea2b-a029-44d9-ac7a-ea2b870d20eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9d88799-cade-4fd4-a9d3-d2ac928f20c7", "address": "fa:16:3e:75:c0:0d", "network": {"id": "17f634c2-25e8-4655-8439-6a5e5d9c7e77", "bridge": "br-int", "label": "tempest-TestShelveInstance-161802280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863980f09120465ebbfb273efa0f07df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9d88799-ca", "ovs_interfaceid": "f9d88799-cade-4fd4-a9d3-d2ac928f20c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Converting VIF {"id": "f9d88799-cade-4fd4-a9d3-d2ac928f20c7", "address": "fa:16:3e:75:c0:0d", "network": {"id": "17f634c2-25e8-4655-8439-6a5e5d9c7e77", "bridge": "br-int", "label": "tempest-TestShelveInstance-161802280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863980f09120465ebbfb273efa0f07df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9d88799-ca", "ovs_interfaceid": "f9d88799-cade-4fd4-a9d3-d2ac928f20c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:c0:0d,bridge_name='br-int',has_traffic_filtering=True,id=f9d88799-cade-4fd4-a9d3-d2ac928f20c7,network=Network(17f634c2-25e8-4655-8439-6a5e5d9c7e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9d88799-ca') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG os_vif [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:c0:0d,bridge_name='br-int',has_traffic_filtering=True,id=f9d88799-cade-4fd4-a9d3-d2ac928f20c7,network=Network(17f634c2-25e8-4655-8439-6a5e5d9c7e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9d88799-ca') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9d88799-ca, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9cabd7dc-518a-4c5d-9af5-d8cdce7b39a0) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG nova.compute.manager [req-2989750e-cf63-4342-854b-5ab30c4ef4b8 req-d1c7cd11-9762-4884-932e-38e214dac260 service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Received event network-changed-f9d88799-cade-4fd4-a9d3-d2ac928f20c7 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG nova.compute.manager [req-2989750e-cf63-4342-854b-5ab30c4ef4b8 req-d1c7cd11-9762-4884-932e-38e214dac260 service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Refreshing instance network info cache due to event network-changed-f9d88799-cade-4fd4-a9d3-d2ac928f20c7. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-2989750e-cf63-4342-854b-5ab30c4ef4b8 req-d1c7cd11-9762-4884-932e-38e214dac260 service nova] Acquiring lock "refresh_cache-7f04ea2b-a029-44d9-ac7a-ea2b870d20eb" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-2989750e-cf63-4342-854b-5ab30c4ef4b8 req-d1c7cd11-9762-4884-932e-38e214dac260 service nova] Acquired lock "refresh_cache-7f04ea2b-a029-44d9-ac7a-ea2b870d20eb" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG nova.network.neutron [req-2989750e-cf63-4342-854b-5ab30c4ef4b8 req-d1c7cd11-9762-4884-932e-38e214dac260 service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Refreshing network info cache for port f9d88799-cade-4fd4-a9d3-d2ac928f20c7 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:00:33 user nova-compute[74247]: INFO os_vif [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:c0:0d,bridge_name='br-int',has_traffic_filtering=True,id=f9d88799-cade-4fd4-a9d3-d2ac928f20c7,network=Network(17f634c2-25e8-4655-8439-6a5e5d9c7e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9d88799-ca')
Oct 16 19:00:33 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cLCfxgKw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 19:00:33 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 19:00:33 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff25898-791f-4373-9f46-3dc3ef2b3768]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 19:00:33 user nova-compute[74247]: No targets found.
Oct 16 19:00:33 user nova-compute[74247]: iSNS:
Oct 16 19:00:33 user nova-compute[74247]: No targets found.
Oct 16 19:00:33 user nova-compute[74247]: STATIC:
Oct 16 19:00:33 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d
Oct 16 19:00:33 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 19:00:33 user nova-compute[74247]:                 Iface Name: default
Oct 16 19:00:33 user nova-compute[74247]: FIRMWARE:
Oct 16 19:00:33 user nova-compute[74247]: No targets found.
Oct 16 19:00:33 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 19:00:33 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 19:00:33 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[986723c7-1e71-421c-ab94-eaf8f6cfe039]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[85038d23-9516-4c4c-b790-9707b7712033]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d (non-flash)
Oct 16 19:00:33 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d (non-flash)
Oct 16 19:00:33 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe068213400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d'): ({'sdd'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Removing single pathed devices sdd {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a9bccf-4198-4240-a019-2b632144a47b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[906f87e1-5451-4f76-98e3-9903eaa0c6ac]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Flushing IO for device /dev/sdd {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78f8b34-5366-4815-b3b5-c25a069355df]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce1949a-3bc3-4f18-9f44-674514d8c9d8]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] SCSI volumes sdd have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[74370c79-4235-4612-b507-75fdd16a8a13]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:00:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:00:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:00:34 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc127d74-3e96-4f4d-943b-a7b9885bb041]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:00:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d, portal: 172.16.0.220,3260]
Oct 16 19:00:34 user nova-compute[74247]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d, portal: 172.16.0.220,3260] successful.
Oct 16 19:00:34 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:00:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:00:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:00:34 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d88f0b-32c1-421d-b6fe-8940df36e36e]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:00:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:00:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 19:00:34 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] <== disconnect_volume: return (302ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 19:00:34 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 19:00:34 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Deleting instance files /opt/stack/data/nova/instances/7f04ea2b-a029-44d9-ac7a-ea2b870d20eb_del
Oct 16 19:00:34 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Deletion of /opt/stack/data/nova/instances/7f04ea2b-a029-44d9-ac7a-ea2b870d20eb_del complete
Oct 16 19:00:34 user nova-compute[74247]: DEBUG nova.network.neutron [req-2989750e-cf63-4342-854b-5ab30c4ef4b8 req-d1c7cd11-9762-4884-932e-38e214dac260 service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Updated VIF entry in instance network info cache for port f9d88799-cade-4fd4-a9d3-d2ac928f20c7. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 19:00:34 user nova-compute[74247]: DEBUG nova.network.neutron [req-2989750e-cf63-4342-854b-5ab30c4ef4b8 req-d1c7cd11-9762-4884-932e-38e214dac260 service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Updating instance_info_cache with network_info: [{"id": "f9d88799-cade-4fd4-a9d3-d2ac928f20c7", "address": "fa:16:3e:75:c0:0d", "network": {"id": "17f634c2-25e8-4655-8439-6a5e5d9c7e77", "bridge": null, "label": "tempest-TestShelveInstance-161802280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863980f09120465ebbfb273efa0f07df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapf9d88799-ca", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:00:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-2989750e-cf63-4342-854b-5ab30c4ef4b8 req-d1c7cd11-9762-4884-932e-38e214dac260 service nova] Releasing lock "refresh_cache-7f04ea2b-a029-44d9-ac7a-ea2b870d20eb" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:00:34 user nova-compute[74247]: DEBUG nova.compute.manager [req-9d74200e-ab09-469f-9881-fed50c66829c req-bcabd763-2840-43a3-bcf6-0c7c72294ba9 service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Received event network-vif-plugged-f9d88799-cade-4fd4-a9d3-d2ac928f20c7 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:00:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9d74200e-ab09-469f-9881-fed50c66829c req-bcabd763-2840-43a3-bcf6-0c7c72294ba9 service nova] Acquiring lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:00:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9d74200e-ab09-469f-9881-fed50c66829c req-bcabd763-2840-43a3-bcf6-0c7c72294ba9 service nova] Lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:00:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9d74200e-ab09-469f-9881-fed50c66829c req-bcabd763-2840-43a3-bcf6-0c7c72294ba9 service nova] Lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:00:34 user nova-compute[74247]: DEBUG nova.compute.manager [req-9d74200e-ab09-469f-9881-fed50c66829c req-bcabd763-2840-43a3-bcf6-0c7c72294ba9 service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] No waiting events found dispatching network-vif-plugged-f9d88799-cade-4fd4-a9d3-d2ac928f20c7 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:00:34 user nova-compute[74247]: WARNING nova.compute.manager [req-9d74200e-ab09-469f-9881-fed50c66829c req-bcabd763-2840-43a3-bcf6-0c7c72294ba9 service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Received unexpected event network-vif-plugged-f9d88799-cade-4fd4-a9d3-d2ac928f20c7 for instance with vm_state active and task_state shelving.
Oct 16 19:00:34 user nova-compute[74247]: DEBUG nova.compute.manager [req-9d74200e-ab09-469f-9881-fed50c66829c req-bcabd763-2840-43a3-bcf6-0c7c72294ba9 service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Received event network-vif-plugged-f9d88799-cade-4fd4-a9d3-d2ac928f20c7 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:00:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9d74200e-ab09-469f-9881-fed50c66829c req-bcabd763-2840-43a3-bcf6-0c7c72294ba9 service nova] Acquiring lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:00:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9d74200e-ab09-469f-9881-fed50c66829c req-bcabd763-2840-43a3-bcf6-0c7c72294ba9 service nova] Lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:00:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9d74200e-ab09-469f-9881-fed50c66829c req-bcabd763-2840-43a3-bcf6-0c7c72294ba9 service nova] Lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:00:34 user nova-compute[74247]: DEBUG nova.compute.manager [req-9d74200e-ab09-469f-9881-fed50c66829c req-bcabd763-2840-43a3-bcf6-0c7c72294ba9 service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] No waiting events found dispatching network-vif-plugged-f9d88799-cade-4fd4-a9d3-d2ac928f20c7 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:00:34 user nova-compute[74247]: WARNING nova.compute.manager [req-9d74200e-ab09-469f-9881-fed50c66829c req-bcabd763-2840-43a3-bcf6-0c7c72294ba9 service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Received unexpected event network-vif-plugged-f9d88799-cade-4fd4-a9d3-d2ac928f20c7 for instance with vm_state active and task_state shelving.
Oct 16 19:00:34 user nova-compute[74247]: DEBUG nova.compute.manager [req-9d74200e-ab09-469f-9881-fed50c66829c req-bcabd763-2840-43a3-bcf6-0c7c72294ba9 service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Received event network-vif-plugged-f9d88799-cade-4fd4-a9d3-d2ac928f20c7 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:00:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9d74200e-ab09-469f-9881-fed50c66829c req-bcabd763-2840-43a3-bcf6-0c7c72294ba9 service nova] Acquiring lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:00:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9d74200e-ab09-469f-9881-fed50c66829c req-bcabd763-2840-43a3-bcf6-0c7c72294ba9 service nova] Lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:00:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9d74200e-ab09-469f-9881-fed50c66829c req-bcabd763-2840-43a3-bcf6-0c7c72294ba9 service nova] Lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:00:34 user nova-compute[74247]: DEBUG nova.compute.manager [req-9d74200e-ab09-469f-9881-fed50c66829c req-bcabd763-2840-43a3-bcf6-0c7c72294ba9 service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] No waiting events found dispatching network-vif-plugged-f9d88799-cade-4fd4-a9d3-d2ac928f20c7 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:00:34 user nova-compute[74247]: WARNING nova.compute.manager [req-9d74200e-ab09-469f-9881-fed50c66829c req-bcabd763-2840-43a3-bcf6-0c7c72294ba9 service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Received unexpected event network-vif-plugged-f9d88799-cade-4fd4-a9d3-d2ac928f20c7 for instance with vm_state active and task_state shelving.
Oct 16 19:00:34 user nova-compute[74247]: DEBUG nova.compute.manager [req-9d74200e-ab09-469f-9881-fed50c66829c req-bcabd763-2840-43a3-bcf6-0c7c72294ba9 service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Received event network-vif-unplugged-f9d88799-cade-4fd4-a9d3-d2ac928f20c7 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:00:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9d74200e-ab09-469f-9881-fed50c66829c req-bcabd763-2840-43a3-bcf6-0c7c72294ba9 service nova] Acquiring lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:00:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9d74200e-ab09-469f-9881-fed50c66829c req-bcabd763-2840-43a3-bcf6-0c7c72294ba9 service nova] Lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:00:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9d74200e-ab09-469f-9881-fed50c66829c req-bcabd763-2840-43a3-bcf6-0c7c72294ba9 service nova] Lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:00:34 user nova-compute[74247]: DEBUG nova.compute.manager [req-9d74200e-ab09-469f-9881-fed50c66829c req-bcabd763-2840-43a3-bcf6-0c7c72294ba9 service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] No waiting events found dispatching network-vif-unplugged-f9d88799-cade-4fd4-a9d3-d2ac928f20c7 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:00:34 user nova-compute[74247]: WARNING nova.compute.manager [req-9d74200e-ab09-469f-9881-fed50c66829c req-bcabd763-2840-43a3-bcf6-0c7c72294ba9 service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Received unexpected event network-vif-unplugged-f9d88799-cade-4fd4-a9d3-d2ac928f20c7 for instance with vm_state active and task_state shelving.
Oct 16 19:00:34 user nova-compute[74247]: DEBUG nova.compute.manager [req-9d74200e-ab09-469f-9881-fed50c66829c req-bcabd763-2840-43a3-bcf6-0c7c72294ba9 service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Received event network-vif-plugged-f9d88799-cade-4fd4-a9d3-d2ac928f20c7 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:00:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9d74200e-ab09-469f-9881-fed50c66829c req-bcabd763-2840-43a3-bcf6-0c7c72294ba9 service nova] Acquiring lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:00:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9d74200e-ab09-469f-9881-fed50c66829c req-bcabd763-2840-43a3-bcf6-0c7c72294ba9 service nova] Lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:00:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9d74200e-ab09-469f-9881-fed50c66829c req-bcabd763-2840-43a3-bcf6-0c7c72294ba9 service nova] Lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:00:34 user nova-compute[74247]: DEBUG nova.compute.manager [req-9d74200e-ab09-469f-9881-fed50c66829c req-bcabd763-2840-43a3-bcf6-0c7c72294ba9 service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] No waiting events found dispatching network-vif-plugged-f9d88799-cade-4fd4-a9d3-d2ac928f20c7 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:00:34 user nova-compute[74247]: WARNING nova.compute.manager [req-9d74200e-ab09-469f-9881-fed50c66829c req-bcabd763-2840-43a3-bcf6-0c7c72294ba9 service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Received unexpected event network-vif-plugged-f9d88799-cade-4fd4-a9d3-d2ac928f20c7 for instance with vm_state active and task_state shelving.
Oct 16 19:00:34 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:00:35 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Deleted allocations for instance 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb
Oct 16 19:00:35 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:00:35 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:00:35 user nova-compute[74247]: DEBUG nova.objects.instance [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Lazy-loading 'numa_topology' on Instance uuid 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:00:35 user nova-compute[74247]: DEBUG nova.objects.base [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Object Instance<7f04ea2b-a029-44d9-ac7a-ea2b870d20eb> lazy-loaded attributes: resources,numa_topology {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 19:00:35 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Refreshing inventories for resource provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 16 19:00:35 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Updating ProviderTree inventory for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 16 19:00:35 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Updating inventory in ProviderTree for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 16 19:00:35 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Refreshing aggregate associations for resource provider 7b8a7b7b-c686-4162-903b-700fbc4d7273, aggregates: None {{(pid=74247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 16 19:00:35 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Refreshing trait associations for resource provider 7b8a7b7b-c686-4162-903b-700fbc4d7273, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=74247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 16 19:00:35 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 19:00:35 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 19:00:35 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.200s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:00:35 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-993d9c11-03ae-49b9-8fbb-5d1cdf89221b tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.570s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:00:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:43 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:46 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:48 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:00:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "e506e951-e694-40bc-a91a-800ac91e658e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:00:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "e506e951-e694-40bc-a91a-800ac91e658e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:00:58 user nova-compute[74247]: DEBUG nova.compute.manager [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 19:00:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:00:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:00:58 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 19:00:58 user nova-compute[74247]: INFO nova.compute.claims [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Claim successful on node user
Oct 16 19:00:58 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 19:00:58 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 19:00:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.178s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:00:58 user nova-compute[74247]: DEBUG nova.compute.manager [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 19:00:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:00:58 user nova-compute[74247]: DEBUG nova.compute.manager [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 19:00:58 user nova-compute[74247]: DEBUG nova.network.neutron [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e506e951-e694-40bc-a91a-800ac91e658e] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 19:00:58 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 19:00:58 user nova-compute[74247]: DEBUG nova.compute.manager [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 19:00:58 user nova-compute[74247]: DEBUG nova.policy [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9608bf58b70248439dbbcc9db38fba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6144ea4e14c28b085e271175bbf67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 19:00:58 user nova-compute[74247]: INFO nova.virt.block_device [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Booting with volume 16745855-2614-4ce8-a013-451d116c1dec at /dev/vda
Oct 16 19:00:58 user nova-compute[74247]: DEBUG os_brick.utils [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 19:00:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:00:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:00:58 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfe0de1-ceac-4f72-b05f-21641be56994]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:00:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:00:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:00:58 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a88b0e-1887-4b70-83e6-c7ee06170f9c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:00:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:00:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:00:58 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b56d944-7c83-4a60-8d5f-ca413c601f6d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:00:58 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f34dce-e8ad-4554-950a-cfaf9624343f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:00:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:00:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 19:00:59 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 19:00:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:00:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 19:00:59 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 19:00:59 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[430afb3e-f0c3-46da-8bbf-40c0e175d172]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:00:59 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 19:00:59 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 19:00:59 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 19:00:59 user nova-compute[74247]: DEBUG os_brick.utils [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 19:00:59 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Updating existing volume attachment record: 0e3f1954-c783-44ae-ad16-72e3d9453c83 {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 19:00:59 user nova-compute[74247]: DEBUG nova.network.neutron [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Successfully created port: 8a8fd51e-d098-4a89-80cd-eed88d8920a5 {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 19:00:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:01:00 user nova-compute[74247]: DEBUG nova.network.neutron [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Successfully updated port: 8a8fd51e-d098-4a89-80cd-eed88d8920a5 {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 19:01:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "refresh_cache-e506e951-e694-40bc-a91a-800ac91e658e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:01:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquired lock "refresh_cache-e506e951-e694-40bc-a91a-800ac91e658e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:01:00 user nova-compute[74247]: DEBUG nova.network.neutron [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 19:01:00 user nova-compute[74247]: DEBUG nova.compute.manager [req-e16061fc-6856-4daf-90c5-4263ad0e7a21 req-38506298-a32f-465f-b819-4e0c1faefa0c service nova] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Received event network-changed-8a8fd51e-d098-4a89-80cd-eed88d8920a5 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:01:00 user nova-compute[74247]: DEBUG nova.compute.manager [req-e16061fc-6856-4daf-90c5-4263ad0e7a21 req-38506298-a32f-465f-b819-4e0c1faefa0c service nova] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Refreshing instance network info cache due to event network-changed-8a8fd51e-d098-4a89-80cd-eed88d8920a5. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 19:01:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e16061fc-6856-4daf-90c5-4263ad0e7a21 req-38506298-a32f-465f-b819-4e0c1faefa0c service nova] Acquiring lock "refresh_cache-e506e951-e694-40bc-a91a-800ac91e658e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:01:00 user nova-compute[74247]: DEBUG nova.network.neutron [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 19:01:00 user nova-compute[74247]: DEBUG nova.network.neutron [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Updating instance_info_cache with network_info: [{"id": "8a8fd51e-d098-4a89-80cd-eed88d8920a5", "address": "fa:16:3e:74:ff:9b", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a8fd51e-d0", "ovs_interfaceid": "8a8fd51e-d098-4a89-80cd-eed88d8920a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:01:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Releasing lock "refresh_cache-e506e951-e694-40bc-a91a-800ac91e658e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:01:00 user nova-compute[74247]: DEBUG nova.compute.manager [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Instance network_info: |[{"id": "8a8fd51e-d098-4a89-80cd-eed88d8920a5", "address": "fa:16:3e:74:ff:9b", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a8fd51e-d0", "ovs_interfaceid": "8a8fd51e-d098-4a89-80cd-eed88d8920a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 19:01:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e16061fc-6856-4daf-90c5-4263ad0e7a21 req-38506298-a32f-465f-b819-4e0c1faefa0c service nova] Acquired lock "refresh_cache-e506e951-e694-40bc-a91a-800ac91e658e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:01:00 user nova-compute[74247]: DEBUG nova.network.neutron [req-e16061fc-6856-4daf-90c5-4263ad0e7a21 req-38506298-a32f-465f-b819-4e0c1faefa0c service nova] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Refreshing network info cache for port 8a8fd51e-d098-4a89-80cd-eed88d8920a5 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 19:01:00 user nova-compute[74247]: DEBUG nova.network.neutron [req-e16061fc-6856-4daf-90c5-4263ad0e7a21 req-38506298-a32f-465f-b819-4e0c1faefa0c service nova] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Updated VIF entry in instance network info cache for port 8a8fd51e-d098-4a89-80cd-eed88d8920a5. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 19:01:00 user nova-compute[74247]: DEBUG nova.network.neutron [req-e16061fc-6856-4daf-90c5-4263ad0e7a21 req-38506298-a32f-465f-b819-4e0c1faefa0c service nova] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Updating instance_info_cache with network_info: [{"id": "8a8fd51e-d098-4a89-80cd-eed88d8920a5", "address": "fa:16:3e:74:ff:9b", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a8fd51e-d0", "ovs_interfaceid": "8a8fd51e-d098-4a89-80cd-eed88d8920a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:01:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e16061fc-6856-4daf-90c5-4263ad0e7a21 req-38506298-a32f-465f-b819-4e0c1faefa0c service nova] Releasing lock "refresh_cache-e506e951-e694-40bc-a91a-800ac91e658e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:01:02 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:01:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:01:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:01:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:01:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:01:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:01:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:01:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:01:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG nova.compute.manager [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 19:01:15 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Creating image(s)
Oct 16 19:01:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Did not create local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Ensure instance console log exists: /opt/stack/data/nova/instances/e506e951-e694-40bc-a91a-800ac91e658e/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Start _get_guest_xml network_info=[{"id": "8a8fd51e-d098-4a89-80cd-eed88d8920a5", "address": "fa:16:3e:74:ff:9b", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a8fd51e-d0", "ovs_interfaceid": "8a8fd51e-d098-4a89-80cd-eed88d8920a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jYJEeRfp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e506e951-e694-40bc-a91a-800ac91e658e', 'attached_at': '', 'detached_at': '', 'volume_id': '16745855-2614-4ce8-a013-451d116c1dec', 'serial': '16745855-2614-4ce8-a013-451d116c1dec'}, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '0e3f1954-c783-44ae-ad16-72e3d9453c83', 'guest_format': None, 'volume_type': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 19:01:15 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:01:15 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:01:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jYJEeRfp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 19:01:15 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 19:01:15 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 19:01:15 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 19:01:15 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 19:01:15 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 19:01:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7d0e3e-bbaf-4301-87ac-6f9926fe19d2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 19:01:15 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c921a53-a99c-4e0a-b5c2-f9628d148ad5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec] added
Oct 16 19:01:15 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08c0cad-0443-4bca-9c87-3ea76bd25222]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5e17e4-5249-4964-9fb3-5fbe0dccb232]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jYJEeRfp {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jYJEeRfp" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[462521f7-21d7-4844-97bc-33e62583bc81]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jYJEeRfp'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd214ed-0016-40b7-bcad-f5a639fc717b]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[978e25e8-2824-4b5a-a11a-8e745234ab8b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 16 19:01:15 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 16 19:01:15 user nova-compute[74247]:  {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 19:01:15 user nova-compute[74247]: WARNING os_brick.initiator.connectors.iscsi [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 16 19:01:15 user nova-compute[74247]: 
Oct 16 19:01:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[01da7240-af47-4d27-9639-68f6d69b8650]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec, portal: 172.16.0.220,3260]
Oct 16 19:01:15 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec, portal: 172.16.0.220,3260] successful.
Oct 16 19:01:15 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4e0cd2-11e0-4d53-8fb3-fc6e45a24782]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed84989c-8a46-4b3a-b407-ae712d73842b]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)
Oct 16 19:01:15 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)
Oct 16 19:01:15 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[837eb5a6-f384-4707-bc53-fce165300573]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:01:15 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: None {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 19:01:16 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 19:01:16 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jYJEeRfp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 19:01:16 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 19:01:16 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '23261653335633538', 'path': '/dev/sdb'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 19:01:16 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261653335633538', 'path': '/dev/sdb'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 19:01:16 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T19:00:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1342335122',display_name='tempest-TestVolumeBootPattern-server-1342335122',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1342335122',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjgu1PdB/VXTN5rZ7oE5e7ovtw+8pzQ24n8jIU2366r669SEEAxAB/9LNF+VOEmvr2qFXyje/n1vbSVuotOeSuaNNrodAuV6fmL4YsSSNhGH3oIDcKRDUc8ro4Dw/7HjQ==',key_name='tempest-TestVolumeBootPattern-34627609',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dca6144ea4e14c28b085e271175bbf67',ramdisk_id='',reservation_id='r-umw032rd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1733357121',owner_user_name='tempest-TestVolumeBootPattern-1733357121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T19:00:59Z,user_data=None,user_id='9608bf58b70248439dbbcc9db38fba08',uuid=e506e951-e694-40bc-a91a-800ac91e658e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a8fd51e-d098-4a89-80cd-eed88d8920a5", "address": "fa:16:3e:74:ff:9b", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a8fd51e-d0", "ovs_interfaceid": "8a8fd51e-d098-4a89-80cd-eed88d8920a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 19:01:16 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Converting VIF {"id": "8a8fd51e-d098-4a89-80cd-eed88d8920a5", "address": "fa:16:3e:74:ff:9b", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a8fd51e-d0", "ovs_interfaceid": "8a8fd51e-d098-4a89-80cd-eed88d8920a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 19:01:16 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:ff:9b,bridge_name='br-int',has_traffic_filtering=True,id=8a8fd51e-d098-4a89-80cd-eed88d8920a5,network=Network(9688c665-d4b7-4179-9a76-fdf6c3013b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a8fd51e-d0') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 19:01:16 user nova-compute[74247]: DEBUG nova.objects.instance [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lazy-loading 'pci_devices' on Instance uuid e506e951-e694-40bc-a91a-800ac91e658e {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:01:16 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e506e951-e694-40bc-a91a-800ac91e658e] End _get_guest_xml xml=<domain type="kvm">
Oct 16 19:01:16 user nova-compute[74247]:   <uuid>e506e951-e694-40bc-a91a-800ac91e658e</uuid>
Oct 16 19:01:16 user nova-compute[74247]:   <name>instance-0000002e</name>
Oct 16 19:01:16 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 19:01:16 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 19:01:16 user nova-compute[74247]:   <metadata>
Oct 16 19:01:16 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 19:01:16 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 19:01:16 user nova-compute[74247]:       <nova:name>tempest-TestVolumeBootPattern-server-1342335122</nova:name>
Oct 16 19:01:16 user nova-compute[74247]:       <nova:creationTime>2023-10-16 19:01:15</nova:creationTime>
Oct 16 19:01:16 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 19:01:16 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 19:01:16 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 19:01:16 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 19:01:16 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 19:01:16 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 19:01:16 user nova-compute[74247]:       </nova:flavor>
Oct 16 19:01:16 user nova-compute[74247]:       <nova:owner>
Oct 16 19:01:16 user nova-compute[74247]:         <nova:user uuid="9608bf58b70248439dbbcc9db38fba08">tempest-TestVolumeBootPattern-1733357121-project-member</nova:user>
Oct 16 19:01:16 user nova-compute[74247]:         <nova:project uuid="dca6144ea4e14c28b085e271175bbf67">tempest-TestVolumeBootPattern-1733357121</nova:project>
Oct 16 19:01:16 user nova-compute[74247]:       </nova:owner>
Oct 16 19:01:16 user nova-compute[74247]:       <nova:ports>
Oct 16 19:01:16 user nova-compute[74247]:         <nova:port uuid="8a8fd51e-d098-4a89-80cd-eed88d8920a5">
Oct 16 19:01:16 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 16 19:01:16 user nova-compute[74247]:         </nova:port>
Oct 16 19:01:16 user nova-compute[74247]:       </nova:ports>
Oct 16 19:01:16 user nova-compute[74247]:     </nova:instance>
Oct 16 19:01:16 user nova-compute[74247]:   </metadata>
Oct 16 19:01:16 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 19:01:16 user nova-compute[74247]:     <system>
Oct 16 19:01:16 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 19:01:16 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 19:01:16 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 19:01:16 user nova-compute[74247]:       <entry name="serial">e506e951-e694-40bc-a91a-800ac91e658e</entry>
Oct 16 19:01:16 user nova-compute[74247]:       <entry name="uuid">e506e951-e694-40bc-a91a-800ac91e658e</entry>
Oct 16 19:01:16 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 19:01:16 user nova-compute[74247]:     </system>
Oct 16 19:01:16 user nova-compute[74247]:   </sysinfo>
Oct 16 19:01:16 user nova-compute[74247]:   <os>
Oct 16 19:01:16 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 19:01:16 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 19:01:16 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 19:01:16 user nova-compute[74247]:   </os>
Oct 16 19:01:16 user nova-compute[74247]:   <features>
Oct 16 19:01:16 user nova-compute[74247]:     <acpi/>
Oct 16 19:01:16 user nova-compute[74247]:     <apic/>
Oct 16 19:01:16 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 19:01:16 user nova-compute[74247]:   </features>
Oct 16 19:01:16 user nova-compute[74247]:   <clock offset="utc">
Oct 16 19:01:16 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 19:01:16 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 19:01:16 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 19:01:16 user nova-compute[74247]:   </clock>
Oct 16 19:01:16 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 19:01:16 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 19:01:16 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 19:01:16 user nova-compute[74247]:   </cpu>
Oct 16 19:01:16 user nova-compute[74247]:   <devices>
Oct 16 19:01:16 user nova-compute[74247]:     <disk type="block" device="disk">
Oct 16 19:01:16 user nova-compute[74247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 19:01:16 user nova-compute[74247]:       <source dev="/dev/sdb"/>
Oct 16 19:01:16 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 19:01:16 user nova-compute[74247]:       <serial>16745855-2614-4ce8-a013-451d116c1dec</serial>
Oct 16 19:01:16 user nova-compute[74247]:     </disk>
Oct 16 19:01:16 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 19:01:16 user nova-compute[74247]:       <mac address="fa:16:3e:74:ff:9b"/>
Oct 16 19:01:16 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 19:01:16 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 19:01:16 user nova-compute[74247]:       <target dev="tap8a8fd51e-d0"/>
Oct 16 19:01:16 user nova-compute[74247]:     </interface>
Oct 16 19:01:16 user nova-compute[74247]:     <serial type="pty">
Oct 16 19:01:16 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/e506e951-e694-40bc-a91a-800ac91e658e/console.log" append="off"/>
Oct 16 19:01:16 user nova-compute[74247]:     </serial>
Oct 16 19:01:16 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 19:01:16 user nova-compute[74247]:     <video>
Oct 16 19:01:16 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 19:01:16 user nova-compute[74247]:     </video>
Oct 16 19:01:16 user nova-compute[74247]:     <rng model="virtio">
Oct 16 19:01:16 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 19:01:16 user nova-compute[74247]:     </rng>
Oct 16 19:01:16 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 19:01:16 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 19:01:16 user nova-compute[74247]:       <stats period="10"/>
Oct 16 19:01:16 user nova-compute[74247]:     </memballoon>
Oct 16 19:01:16 user nova-compute[74247]:   </devices>
Oct 16 19:01:16 user nova-compute[74247]: </domain>
Oct 16 19:01:16 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 19:01:16 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T19:00:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1342335122',display_name='tempest-TestVolumeBootPattern-server-1342335122',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1342335122',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjgu1PdB/VXTN5rZ7oE5e7ovtw+8pzQ24n8jIU2366r669SEEAxAB/9LNF+VOEmvr2qFXyje/n1vbSVuotOeSuaNNrodAuV6fmL4YsSSNhGH3oIDcKRDUc8ro4Dw/7HjQ==',key_name='tempest-TestVolumeBootPattern-34627609',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dca6144ea4e14c28b085e271175bbf67',ramdisk_id='',reservation_id='r-umw032rd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1733357121',owner_user_name='tempest-TestVolumeBootPattern-1733357121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T19:00:59Z,user_data=None,user_id='9608bf58b70248439dbbcc9db38fba08',uuid=e506e951-e694-40bc-a91a-800ac91e658e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a8fd51e-d098-4a89-80cd-eed88d8920a5", "address": "fa:16:3e:74:ff:9b", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a8fd51e-d0", "ovs_interfaceid": "8a8fd51e-d098-4a89-80cd-eed88d8920a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 19:01:16 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Converting VIF {"id": "8a8fd51e-d098-4a89-80cd-eed88d8920a5", "address": "fa:16:3e:74:ff:9b", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a8fd51e-d0", "ovs_interfaceid": "8a8fd51e-d098-4a89-80cd-eed88d8920a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 19:01:16 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:ff:9b,bridge_name='br-int',has_traffic_filtering=True,id=8a8fd51e-d098-4a89-80cd-eed88d8920a5,network=Network(9688c665-d4b7-4179-9a76-fdf6c3013b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a8fd51e-d0') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 19:01:16 user nova-compute[74247]: DEBUG os_vif [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:ff:9b,bridge_name='br-int',has_traffic_filtering=True,id=8a8fd51e-d098-4a89-80cd-eed88d8920a5,network=Network(9688c665-d4b7-4179-9a76-fdf6c3013b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a8fd51e-d0') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 19:01:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:01:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:01:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 19:01:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:01:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6290ff92-94c4-585b-a1c5-50a597f0d394', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:01:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:01:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:01:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:01:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a8fd51e-d0, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:01:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8a8fd51e-d0, col_values=(('qos', UUID('20e9ccd2-672f-484a-8282-4e69c33627f6')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:01:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8a8fd51e-d0, col_values=(('external_ids', {'iface-id': '8a8fd51e-d098-4a89-80cd-eed88d8920a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:ff:9b', 'vm-uuid': 'e506e951-e694-40bc-a91a-800ac91e658e'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:01:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:01:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:01:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:01:16 user nova-compute[74247]: INFO os_vif [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:ff:9b,bridge_name='br-int',has_traffic_filtering=True,id=8a8fd51e-d098-4a89-80cd-eed88d8920a5,network=Network(9688c665-d4b7-4179-9a76-fdf6c3013b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a8fd51e-d0')
Oct 16 19:01:16 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 19:01:16 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] No VIF found with MAC fa:16:3e:74:ff:9b, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 19:01:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:01:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:01:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:01:18 user nova-compute[74247]: DEBUG nova.compute.manager [req-2312da77-1810-44eb-b30b-e1d8ed7ccd90 req-60a1fc1c-7c72-4e54-bf87-c9b6671d70e4 service nova] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Received event network-vif-plugged-8a8fd51e-d098-4a89-80cd-eed88d8920a5 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:01:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-2312da77-1810-44eb-b30b-e1d8ed7ccd90 req-60a1fc1c-7c72-4e54-bf87-c9b6671d70e4 service nova] Acquiring lock "e506e951-e694-40bc-a91a-800ac91e658e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:01:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-2312da77-1810-44eb-b30b-e1d8ed7ccd90 req-60a1fc1c-7c72-4e54-bf87-c9b6671d70e4 service nova] Lock "e506e951-e694-40bc-a91a-800ac91e658e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:01:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-2312da77-1810-44eb-b30b-e1d8ed7ccd90 req-60a1fc1c-7c72-4e54-bf87-c9b6671d70e4 service nova] Lock "e506e951-e694-40bc-a91a-800ac91e658e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:01:18 user nova-compute[74247]: DEBUG nova.compute.manager [req-2312da77-1810-44eb-b30b-e1d8ed7ccd90 req-60a1fc1c-7c72-4e54-bf87-c9b6671d70e4 service nova] [instance: e506e951-e694-40bc-a91a-800ac91e658e] No waiting events found dispatching network-vif-plugged-8a8fd51e-d098-4a89-80cd-eed88d8920a5 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:01:18 user nova-compute[74247]: WARNING nova.compute.manager [req-2312da77-1810-44eb-b30b-e1d8ed7ccd90 req-60a1fc1c-7c72-4e54-bf87-c9b6671d70e4 service nova] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Received unexpected event network-vif-plugged-8a8fd51e-d098-4a89-80cd-eed88d8920a5 for instance with vm_state building and task_state spawning.
Oct 16 19:01:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:01:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:01:18 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:01:20 user nova-compute[74247]: DEBUG nova.compute.manager [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 19:01:20 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 19:01:20 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Instance spawned successfully.
Oct 16 19:01:20 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 19:01:20 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 19:01:20 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 19:01:20 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 19:01:20 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 19:01:20 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 19:01:20 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 19:01:20 user nova-compute[74247]: INFO nova.compute.manager [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Took 4.99 seconds to spawn the instance on the hypervisor.
Oct 16 19:01:20 user nova-compute[74247]: DEBUG nova.compute.manager [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 19:01:20 user nova-compute[74247]: INFO nova.compute.manager [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Took 21.77 seconds to build instance.
Oct 16 19:01:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a177d526-72bb-409f-b357-3352cad81726 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "e506e951-e694-40bc-a91a-800ac91e658e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.910s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:01:20 user nova-compute[74247]: DEBUG nova.compute.manager [req-5dce1a1a-726e-43eb-8a01-0a3016a4179d req-62bfaf14-a98f-4bc8-b115-a441922df61f service nova] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Received event network-vif-plugged-8a8fd51e-d098-4a89-80cd-eed88d8920a5 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:01:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-5dce1a1a-726e-43eb-8a01-0a3016a4179d req-62bfaf14-a98f-4bc8-b115-a441922df61f service nova] Acquiring lock "e506e951-e694-40bc-a91a-800ac91e658e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:01:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-5dce1a1a-726e-43eb-8a01-0a3016a4179d req-62bfaf14-a98f-4bc8-b115-a441922df61f service nova] Lock "e506e951-e694-40bc-a91a-800ac91e658e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:01:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-5dce1a1a-726e-43eb-8a01-0a3016a4179d req-62bfaf14-a98f-4bc8-b115-a441922df61f service nova] Lock "e506e951-e694-40bc-a91a-800ac91e658e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:01:20 user nova-compute[74247]: DEBUG nova.compute.manager [req-5dce1a1a-726e-43eb-8a01-0a3016a4179d req-62bfaf14-a98f-4bc8-b115-a441922df61f service nova] [instance: e506e951-e694-40bc-a91a-800ac91e658e] No waiting events found dispatching network-vif-plugged-8a8fd51e-d098-4a89-80cd-eed88d8920a5 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:01:20 user nova-compute[74247]: WARNING nova.compute.manager [req-5dce1a1a-726e-43eb-8a01-0a3016a4179d req-62bfaf14-a98f-4bc8-b115-a441922df61f service nova] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Received unexpected event network-vif-plugged-8a8fd51e-d098-4a89-80cd-eed88d8920a5 for instance with vm_state active and task_state None.
Oct 16 19:01:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:01:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:01:22 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:01:22 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:01:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:01:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:01:22 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:01:22 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 19:01:22 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 19:01:23 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:01:23 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:01:23 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=8947MB free_disk=25.00339126586914GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 19:01:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:01:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:01:23 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance e506e951-e694-40bc-a91a-800ac91e658e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 19:01:23 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 19:01:23 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 19:01:23 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 19:01:23 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 19:01:23 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 19:01:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.205s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:01:25 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:01:25 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 19:01:25 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Rebuilding the list of instances to heal {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 19:01:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "refresh_cache-e506e951-e694-40bc-a91a-800ac91e658e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:01:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquired lock "refresh_cache-e506e951-e694-40bc-a91a-800ac91e658e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:01:25 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Forcefully refreshing network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 19:01:25 user nova-compute[74247]: DEBUG nova.objects.instance [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lazy-loading 'info_cache' on Instance uuid e506e951-e694-40bc-a91a-800ac91e658e {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:01:25 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Updating instance_info_cache with network_info: [{"id": "8a8fd51e-d098-4a89-80cd-eed88d8920a5", "address": "fa:16:3e:74:ff:9b", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a8fd51e-d0", "ovs_interfaceid": "8a8fd51e-d098-4a89-80cd-eed88d8920a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:01:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Releasing lock "refresh_cache-e506e951-e694-40bc-a91a-800ac91e658e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:01:25 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Updated the network info_cache for instance {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 19:01:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:01:27 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:01:28 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:01:29 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:01:29 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:01:31 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:01:31 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 19:01:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:01:34 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:01:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:01:37 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:01:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:01:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:01:46 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:01:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:01:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:01:52 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:01:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:02:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:02:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:02:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:02:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:02:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:12 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Acquiring lock "68edbfa7-0752-42fb-bad8-eb7121796e9f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:02:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "68edbfa7-0752-42fb-bad8-eb7121796e9f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:02:19 user nova-compute[74247]: DEBUG nova.compute.manager [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 19:02:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:02:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:02:19 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 19:02:19 user nova-compute[74247]: INFO nova.compute.claims [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Claim successful on node user
Oct 16 19:02:19 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 19:02:19 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 19:02:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.222s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:02:19 user nova-compute[74247]: DEBUG nova.compute.manager [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 19:02:19 user nova-compute[74247]: DEBUG nova.compute.manager [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 19:02:19 user nova-compute[74247]: DEBUG nova.network.neutron [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 19:02:19 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 19:02:19 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:02:19 user nova-compute[74247]: DEBUG nova.compute.manager [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 19:02:19 user nova-compute[74247]: DEBUG nova.policy [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7414f773f7a94a13938c406bf02b3bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42cb6a3c6bdd484d9a8d0c27bf1ac2fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 19:02:19 user nova-compute[74247]: DEBUG nova.compute.manager [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 19:02:19 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 19:02:19 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Creating image(s)
Oct 16 19:02:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Acquiring lock "/opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:02:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "/opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:02:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "/opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:02:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Acquiring lock "19cfabef25d7a3b36f6641053ac16011ef6876af" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:02:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "19cfabef25d7a3b36f6641053ac16011ef6876af" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:02:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19cfabef25d7a3b36f6641053ac16011ef6876af.part --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:02:20 user nova-compute[74247]: DEBUG nova.network.neutron [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Successfully created port: 1e4186ff-26a0-43b8-8b0a-2f62eb718451 {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 19:02:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19cfabef25d7a3b36f6641053ac16011ef6876af.part --force-share --output=json" returned: 0 in 0.186s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:02:20 user nova-compute[74247]: DEBUG nova.virt.images [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] 46d6f108-3b2e-41c3-8694-65606e2769ee was qcow2, converting to raw {{(pid=74247) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 16 19:02:20 user nova-compute[74247]: DEBUG nova.privsep.utils [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74247) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 19:02:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/19cfabef25d7a3b36f6641053ac16011ef6876af.part /opt/stack/data/nova/instances/_base/19cfabef25d7a3b36f6641053ac16011ef6876af.converted {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:02:20 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:02:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/19cfabef25d7a3b36f6641053ac16011ef6876af.part /opt/stack/data/nova/instances/_base/19cfabef25d7a3b36f6641053ac16011ef6876af.converted" returned: 0 in 0.352s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:02:20 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19cfabef25d7a3b36f6641053ac16011ef6876af.converted --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG nova.network.neutron [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Successfully updated port: 1e4186ff-26a0-43b8-8b0a-2f62eb718451 {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Acquiring lock "refresh_cache-68edbfa7-0752-42fb-bad8-eb7121796e9f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Acquired lock "refresh_cache-68edbfa7-0752-42fb-bad8-eb7121796e9f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG nova.network.neutron [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19cfabef25d7a3b36f6641053ac16011ef6876af.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "19cfabef25d7a3b36f6641053ac16011ef6876af" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.386s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG nova.network.neutron [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19cfabef25d7a3b36f6641053ac16011ef6876af --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG nova.compute.manager [req-ecf08aae-c80a-41bd-afd3-9d34b7ec27dd req-23791143-d1bb-4fa8-b503-acbf71d636b8 service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Received event network-changed-1e4186ff-26a0-43b8-8b0a-2f62eb718451 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG nova.compute.manager [req-ecf08aae-c80a-41bd-afd3-9d34b7ec27dd req-23791143-d1bb-4fa8-b503-acbf71d636b8 service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Refreshing instance network info cache due to event network-changed-1e4186ff-26a0-43b8-8b0a-2f62eb718451. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-ecf08aae-c80a-41bd-afd3-9d34b7ec27dd req-23791143-d1bb-4fa8-b503-acbf71d636b8 service nova] Acquiring lock "refresh_cache-68edbfa7-0752-42fb-bad8-eb7121796e9f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19cfabef25d7a3b36f6641053ac16011ef6876af --force-share --output=json" returned: 0 in 0.172s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Acquiring lock "19cfabef25d7a3b36f6641053ac16011ef6876af" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "19cfabef25d7a3b36f6641053ac16011ef6876af" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19cfabef25d7a3b36f6641053ac16011ef6876af --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG nova.network.neutron [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Updating instance_info_cache with network_info: [{"id": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "address": "fa:16:3e:ae:24:ed", "network": {"id": "5801391d-4968-4504-9f23-8683eeb63a54", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2082110052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cb6a3c6bdd484d9a8d0c27bf1ac2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e4186ff-26", "ovs_interfaceid": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Releasing lock "refresh_cache-68edbfa7-0752-42fb-bad8-eb7121796e9f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG nova.compute.manager [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Instance network_info: |[{"id": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "address": "fa:16:3e:ae:24:ed", "network": {"id": "5801391d-4968-4504-9f23-8683eeb63a54", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2082110052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cb6a3c6bdd484d9a8d0c27bf1ac2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e4186ff-26", "ovs_interfaceid": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-ecf08aae-c80a-41bd-afd3-9d34b7ec27dd req-23791143-d1bb-4fa8-b503-acbf71d636b8 service nova] Acquired lock "refresh_cache-68edbfa7-0752-42fb-bad8-eb7121796e9f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG nova.network.neutron [req-ecf08aae-c80a-41bd-afd3-9d34b7ec27dd req-23791143-d1bb-4fa8-b503-acbf71d636b8 service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Refreshing network info cache for port 1e4186ff-26a0-43b8-8b0a-2f62eb718451 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19cfabef25d7a3b36f6641053ac16011ef6876af --force-share --output=json" returned: 0 in 0.177s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19cfabef25d7a3b36f6641053ac16011ef6876af,backing_fmt=raw /opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f/disk 1073741824 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19cfabef25d7a3b36f6641053ac16011ef6876af,backing_fmt=raw /opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f/disk 1073741824" returned: 0 in 0.048s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "19cfabef25d7a3b36f6641053ac16011ef6876af" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19cfabef25d7a3b36f6641053ac16011ef6876af --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19cfabef25d7a3b36f6641053ac16011ef6876af --force-share --output=json" returned: 0 in 0.170s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Checking if we can resize image /opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f/disk. size=1073741824 {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG nova.network.neutron [req-ecf08aae-c80a-41bd-afd3-9d34b7ec27dd req-23791143-d1bb-4fa8-b503-acbf71d636b8 service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Updated VIF entry in instance network info cache for port 1e4186ff-26a0-43b8-8b0a-2f62eb718451. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG nova.network.neutron [req-ecf08aae-c80a-41bd-afd3-9d34b7ec27dd req-23791143-d1bb-4fa8-b503-acbf71d636b8 service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Updating instance_info_cache with network_info: [{"id": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "address": "fa:16:3e:ae:24:ed", "network": {"id": "5801391d-4968-4504-9f23-8683eeb63a54", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2082110052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cb6a3c6bdd484d9a8d0c27bf1ac2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e4186ff-26", "ovs_interfaceid": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-ecf08aae-c80a-41bd-afd3-9d34b7ec27dd req-23791143-d1bb-4fa8-b503-acbf71d636b8 service nova] Releasing lock "refresh_cache-68edbfa7-0752-42fb-bad8-eb7121796e9f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Cannot resize image /opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f/disk to a smaller size. {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Ensure instance console log exists: /opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Start _get_guest_xml network_info=[{"id": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "address": "fa:16:3e:ae:24:ed", "network": {"id": "5801391d-4968-4504-9f23-8683eeb63a54", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2082110052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cb6a3c6bdd484d9a8d0c27bf1ac2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e4186ff-26", "ovs_interfaceid": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T19:02:16Z,direct_url=<?>,disk_format='qcow2',id=46d6f108-3b2e-41c3-8694-65606e2769ee,min_disk=0,min_ram=0,name='tempest-scenario-img--1375977198',owner='42cb6a3c6bdd484d9a8d0c27bf1ac2fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T19:02:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': '46d6f108-3b2e-41c3-8694-65606e2769ee'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 19:02:21 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:02:21 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:02:21 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T19:02:16Z,direct_url=<?>,disk_format='qcow2',id=46d6f108-3b2e-41c3-8694-65606e2769ee,min_disk=0,min_ram=0,name='tempest-scenario-img--1375977198',owner='42cb6a3c6bdd484d9a8d0c27bf1ac2fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T19:02:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T19:02:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1906922734',display_name='tempest-TestMinimumBasicScenario-server-1906922734',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1906922734',id=47,image_ref='46d6f108-3b2e-41c3-8694-65606e2769ee',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1caxevCdksN3AlmBdVwZfiOOScHN4VaKza+143cbh60V4VUdpuh75jnICCBVrEWNOsZzHUyPA9sdF/wl46FD7/FpfokUQQw4OLB6uN6SSD+v6cZrKs558k5Gsx5iCxEQ==',key_name='tempest-TestMinimumBasicScenario-344900198',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42cb6a3c6bdd484d9a8d0c27bf1ac2fb',ramdisk_id='',reservation_id='r-47ytcjou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='46d6f108-3b2e-41c3-8694-65606e2769ee',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-218992455',owner_user_name='tempest-TestMinimumBasicScenario-218992455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T19:02:20Z,user_data=None,user_id='7414f773f7a94a13938c406bf02b3bac',uuid=68edbfa7-0752-42fb-bad8-eb7121796e9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "address": "fa:16:3e:ae:24:ed", "network": {"id": "5801391d-4968-4504-9f23-8683eeb63a54", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2082110052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cb6a3c6bdd484d9a8d0c27bf1ac2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e4186ff-26", "ovs_interfaceid": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Converting VIF {"id": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "address": "fa:16:3e:ae:24:ed", "network": {"id": "5801391d-4968-4504-9f23-8683eeb63a54", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2082110052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cb6a3c6bdd484d9a8d0c27bf1ac2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e4186ff-26", "ovs_interfaceid": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:24:ed,bridge_name='br-int',has_traffic_filtering=True,id=1e4186ff-26a0-43b8-8b0a-2f62eb718451,network=Network(5801391d-4968-4504-9f23-8683eeb63a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e4186ff-26') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG nova.objects.instance [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lazy-loading 'pci_devices' on Instance uuid 68edbfa7-0752-42fb-bad8-eb7121796e9f {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:02:21 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] End _get_guest_xml xml=<domain type="kvm">
Oct 16 19:02:21 user nova-compute[74247]:   <uuid>68edbfa7-0752-42fb-bad8-eb7121796e9f</uuid>
Oct 16 19:02:21 user nova-compute[74247]:   <name>instance-0000002f</name>
Oct 16 19:02:21 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 19:02:21 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 19:02:21 user nova-compute[74247]:   <metadata>
Oct 16 19:02:21 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 19:02:21 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 19:02:21 user nova-compute[74247]:       <nova:name>tempest-TestMinimumBasicScenario-server-1906922734</nova:name>
Oct 16 19:02:21 user nova-compute[74247]:       <nova:creationTime>2023-10-16 19:02:21</nova:creationTime>
Oct 16 19:02:21 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 19:02:21 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 19:02:21 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 19:02:21 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 19:02:21 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 19:02:21 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 19:02:21 user nova-compute[74247]:       </nova:flavor>
Oct 16 19:02:21 user nova-compute[74247]:       <nova:owner>
Oct 16 19:02:21 user nova-compute[74247]:         <nova:user uuid="7414f773f7a94a13938c406bf02b3bac">tempest-TestMinimumBasicScenario-218992455-project-member</nova:user>
Oct 16 19:02:21 user nova-compute[74247]:         <nova:project uuid="42cb6a3c6bdd484d9a8d0c27bf1ac2fb">tempest-TestMinimumBasicScenario-218992455</nova:project>
Oct 16 19:02:21 user nova-compute[74247]:       </nova:owner>
Oct 16 19:02:21 user nova-compute[74247]:       <nova:root type="image" uuid="46d6f108-3b2e-41c3-8694-65606e2769ee"/>
Oct 16 19:02:21 user nova-compute[74247]:       <nova:ports>
Oct 16 19:02:21 user nova-compute[74247]:         <nova:port uuid="1e4186ff-26a0-43b8-8b0a-2f62eb718451">
Oct 16 19:02:21 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 16 19:02:21 user nova-compute[74247]:         </nova:port>
Oct 16 19:02:21 user nova-compute[74247]:       </nova:ports>
Oct 16 19:02:21 user nova-compute[74247]:     </nova:instance>
Oct 16 19:02:21 user nova-compute[74247]:   </metadata>
Oct 16 19:02:21 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 19:02:21 user nova-compute[74247]:     <system>
Oct 16 19:02:21 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 19:02:21 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 19:02:21 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 19:02:21 user nova-compute[74247]:       <entry name="serial">68edbfa7-0752-42fb-bad8-eb7121796e9f</entry>
Oct 16 19:02:21 user nova-compute[74247]:       <entry name="uuid">68edbfa7-0752-42fb-bad8-eb7121796e9f</entry>
Oct 16 19:02:21 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 19:02:21 user nova-compute[74247]:     </system>
Oct 16 19:02:21 user nova-compute[74247]:   </sysinfo>
Oct 16 19:02:21 user nova-compute[74247]:   <os>
Oct 16 19:02:21 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 19:02:21 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 19:02:21 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 19:02:21 user nova-compute[74247]:   </os>
Oct 16 19:02:21 user nova-compute[74247]:   <features>
Oct 16 19:02:21 user nova-compute[74247]:     <acpi/>
Oct 16 19:02:21 user nova-compute[74247]:     <apic/>
Oct 16 19:02:21 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 19:02:21 user nova-compute[74247]:   </features>
Oct 16 19:02:21 user nova-compute[74247]:   <clock offset="utc">
Oct 16 19:02:21 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 19:02:21 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 19:02:21 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 19:02:21 user nova-compute[74247]:   </clock>
Oct 16 19:02:21 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 19:02:21 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 19:02:21 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 19:02:21 user nova-compute[74247]:   </cpu>
Oct 16 19:02:21 user nova-compute[74247]:   <devices>
Oct 16 19:02:21 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 19:02:21 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 19:02:21 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f/disk"/>
Oct 16 19:02:21 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 19:02:21 user nova-compute[74247]:     </disk>
Oct 16 19:02:21 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 19:02:21 user nova-compute[74247]:       <mac address="fa:16:3e:ae:24:ed"/>
Oct 16 19:02:21 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 19:02:21 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 19:02:21 user nova-compute[74247]:       <target dev="tap1e4186ff-26"/>
Oct 16 19:02:21 user nova-compute[74247]:     </interface>
Oct 16 19:02:21 user nova-compute[74247]:     <serial type="pty">
Oct 16 19:02:21 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f/console.log" append="off"/>
Oct 16 19:02:21 user nova-compute[74247]:     </serial>
Oct 16 19:02:21 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 19:02:21 user nova-compute[74247]:     <video>
Oct 16 19:02:21 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 19:02:21 user nova-compute[74247]:     </video>
Oct 16 19:02:21 user nova-compute[74247]:     <rng model="virtio">
Oct 16 19:02:21 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 19:02:21 user nova-compute[74247]:     </rng>
Oct 16 19:02:21 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 19:02:21 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 19:02:21 user nova-compute[74247]:       <stats period="10"/>
Oct 16 19:02:21 user nova-compute[74247]:     </memballoon>
Oct 16 19:02:21 user nova-compute[74247]:   </devices>
Oct 16 19:02:21 user nova-compute[74247]: </domain>
Oct 16 19:02:21 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 19:02:22 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T19:02:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1906922734',display_name='tempest-TestMinimumBasicScenario-server-1906922734',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1906922734',id=47,image_ref='46d6f108-3b2e-41c3-8694-65606e2769ee',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1caxevCdksN3AlmBdVwZfiOOScHN4VaKza+143cbh60V4VUdpuh75jnICCBVrEWNOsZzHUyPA9sdF/wl46FD7/FpfokUQQw4OLB6uN6SSD+v6cZrKs558k5Gsx5iCxEQ==',key_name='tempest-TestMinimumBasicScenario-344900198',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42cb6a3c6bdd484d9a8d0c27bf1ac2fb',ramdisk_id='',reservation_id='r-47ytcjou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='46d6f108-3b2e-41c3-8694-65606e2769ee',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-218992455',owner_user_name='tempest-TestMinimumBasicScenario-218992455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T19:02:20Z,user_data=None,user_id='7414f773f7a94a13938c406bf02b3bac',uuid=68edbfa7-0752-42fb-bad8-eb7121796e9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "address": "fa:16:3e:ae:24:ed", "network": {"id": "5801391d-4968-4504-9f23-8683eeb63a54", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2082110052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cb6a3c6bdd484d9a8d0c27bf1ac2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e4186ff-26", "ovs_interfaceid": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 19:02:22 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Converting VIF {"id": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "address": "fa:16:3e:ae:24:ed", "network": {"id": "5801391d-4968-4504-9f23-8683eeb63a54", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2082110052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cb6a3c6bdd484d9a8d0c27bf1ac2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e4186ff-26", "ovs_interfaceid": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 19:02:22 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:24:ed,bridge_name='br-int',has_traffic_filtering=True,id=1e4186ff-26a0-43b8-8b0a-2f62eb718451,network=Network(5801391d-4968-4504-9f23-8683eeb63a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e4186ff-26') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 19:02:22 user nova-compute[74247]: DEBUG os_vif [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:24:ed,bridge_name='br-int',has_traffic_filtering=True,id=1e4186ff-26a0-43b8-8b0a-2f62eb718451,network=Network(5801391d-4968-4504-9f23-8683eeb63a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e4186ff-26') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 19:02:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:02:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 19:02:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9d1a74a7-765d-5e51-8d1c-631c2822494c', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:02:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:02:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e4186ff-26, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:02:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1e4186ff-26, col_values=(('qos', UUID('430c7678-f16a-4600-9733-95695982fc00')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:02:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1e4186ff-26, col_values=(('external_ids', {'iface-id': '1e4186ff-26a0-43b8-8b0a-2f62eb718451', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:24:ed', 'vm-uuid': '68edbfa7-0752-42fb-bad8-eb7121796e9f'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:02:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:02:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:22 user nova-compute[74247]: INFO os_vif [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:24:ed,bridge_name='br-int',has_traffic_filtering=True,id=1e4186ff-26a0-43b8-8b0a-2f62eb718451,network=Network(5801391d-4968-4504-9f23-8683eeb63a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e4186ff-26')
Oct 16 19:02:22 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 19:02:22 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] No VIF found with MAC fa:16:3e:ae:24:ed, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 19:02:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:22 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:02:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:23 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:02:23 user nova-compute[74247]: DEBUG nova.compute.manager [req-462c4098-4bac-4bcd-8172-2aeb1ef51a4c req-efa78d62-5f2b-419a-97f0-c89dacdbdb1d service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Received event network-vif-plugged-1e4186ff-26a0-43b8-8b0a-2f62eb718451 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:02:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-462c4098-4bac-4bcd-8172-2aeb1ef51a4c req-efa78d62-5f2b-419a-97f0-c89dacdbdb1d service nova] Acquiring lock "68edbfa7-0752-42fb-bad8-eb7121796e9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:02:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-462c4098-4bac-4bcd-8172-2aeb1ef51a4c req-efa78d62-5f2b-419a-97f0-c89dacdbdb1d service nova] Lock "68edbfa7-0752-42fb-bad8-eb7121796e9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:02:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-462c4098-4bac-4bcd-8172-2aeb1ef51a4c req-efa78d62-5f2b-419a-97f0-c89dacdbdb1d service nova] Lock "68edbfa7-0752-42fb-bad8-eb7121796e9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:02:23 user nova-compute[74247]: DEBUG nova.compute.manager [req-462c4098-4bac-4bcd-8172-2aeb1ef51a4c req-efa78d62-5f2b-419a-97f0-c89dacdbdb1d service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] No waiting events found dispatching network-vif-plugged-1e4186ff-26a0-43b8-8b0a-2f62eb718451 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:02:23 user nova-compute[74247]: WARNING nova.compute.manager [req-462c4098-4bac-4bcd-8172-2aeb1ef51a4c req-efa78d62-5f2b-419a-97f0-c89dacdbdb1d service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Received unexpected event network-vif-plugged-1e4186ff-26a0-43b8-8b0a-2f62eb718451 for instance with vm_state building and task_state spawning.
Oct 16 19:02:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:02:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:02:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:02:23 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 19:02:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Acquiring lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:02:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:02:23 user nova-compute[74247]: INFO nova.compute.manager [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Unshelving
Oct 16 19:02:23 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 19:02:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:02:23 user nova-compute[74247]: INFO nova.virt.block_device [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Booting with volume 35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d at /dev/vda
Oct 16 19:02:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:02:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:02:24 user nova-compute[74247]: DEBUG os_brick.utils [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 19:02:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:02:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:02:24 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[71370da5-75b8-45e4-82f0-1fe7c0205f29]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:02:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:02:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:02:24 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff1d482-4423-4ff0-82b9-a00ab9264435]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:02:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:02:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:02:24 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[012ba937-c7f3-412d-ae49-f3bbfe539ff9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:02:24 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f003f5-fc4e-4d60-94d4-bdba716e8dbc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:02:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:02:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 19:02:24 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 19:02:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:02:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 19:02:24 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 19:02:24 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b882c3-98ee-4853-81db-2b3f1b15d954]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:02:24 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 19:02:24 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 19:02:24 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 19:02:24 user nova-compute[74247]: DEBUG os_brick.utils [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 19:02:24 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Updating existing volume attachment record: dd6ede3f-52d6-4d3d-a168-35766fdecc68 {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 19:02:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:02:25 user nova-compute[74247]: DEBUG nova.compute.manager [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 19:02:25 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 19:02:25 user nova-compute[74247]: DEBUG nova.compute.manager [req-5cfe502e-0fe1-4364-8945-67fb3f3ad24e req-b5a8b19a-b68c-4f9a-812a-48d7616e6ce6 service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Received event network-vif-plugged-1e4186ff-26a0-43b8-8b0a-2f62eb718451 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:02:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-5cfe502e-0fe1-4364-8945-67fb3f3ad24e req-b5a8b19a-b68c-4f9a-812a-48d7616e6ce6 service nova] Acquiring lock "68edbfa7-0752-42fb-bad8-eb7121796e9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:02:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-5cfe502e-0fe1-4364-8945-67fb3f3ad24e req-b5a8b19a-b68c-4f9a-812a-48d7616e6ce6 service nova] Lock "68edbfa7-0752-42fb-bad8-eb7121796e9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:02:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-5cfe502e-0fe1-4364-8945-67fb3f3ad24e req-b5a8b19a-b68c-4f9a-812a-48d7616e6ce6 service nova] Lock "68edbfa7-0752-42fb-bad8-eb7121796e9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:02:25 user nova-compute[74247]: DEBUG nova.compute.manager [req-5cfe502e-0fe1-4364-8945-67fb3f3ad24e req-b5a8b19a-b68c-4f9a-812a-48d7616e6ce6 service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] No waiting events found dispatching network-vif-plugged-1e4186ff-26a0-43b8-8b0a-2f62eb718451 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:02:25 user nova-compute[74247]: WARNING nova.compute.manager [req-5cfe502e-0fe1-4364-8945-67fb3f3ad24e req-b5a8b19a-b68c-4f9a-812a-48d7616e6ce6 service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Received unexpected event network-vif-plugged-1e4186ff-26a0-43b8-8b0a-2f62eb718451 for instance with vm_state building and task_state spawning.
Oct 16 19:02:25 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:02:25 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:02:25 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=8843MB free_disk=24.93966293334961GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 19:02:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:02:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:02:25 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Instance spawned successfully.
Oct 16 19:02:25 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 19:02:25 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 19:02:25 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 19:02:25 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 19:02:25 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 19:02:25 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 19:02:25 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 19:02:25 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance e506e951-e694-40bc-a91a-800ac91e658e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 19:02:25 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 68edbfa7-0752-42fb-bad8-eb7121796e9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 19:02:25 user nova-compute[74247]: INFO nova.compute.manager [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Took 6.22 seconds to spawn the instance on the hypervisor.
Oct 16 19:02:25 user nova-compute[74247]: DEBUG nova.compute.manager [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 19:02:25 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 16 19:02:25 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 19:02:25 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 19:02:26 user nova-compute[74247]: INFO nova.compute.manager [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Took 6.90 seconds to build instance.
Oct 16 19:02:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-09847d17-3c54-4b8a-99cb-321deb55f249 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "68edbfa7-0752-42fb-bad8-eb7121796e9f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.009s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:02:26 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 19:02:26 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 19:02:26 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 19:02:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.286s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:02:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:29 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:02:29 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 19:02:29 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Rebuilding the list of instances to heal {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 19:02:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "refresh_cache-e506e951-e694-40bc-a91a-800ac91e658e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:02:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquired lock "refresh_cache-e506e951-e694-40bc-a91a-800ac91e658e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:02:29 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Forcefully refreshing network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 19:02:29 user nova-compute[74247]: DEBUG nova.objects.instance [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lazy-loading 'info_cache' on Instance uuid e506e951-e694-40bc-a91a-800ac91e658e {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:02:29 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Updating instance_info_cache with network_info: [{"id": "8a8fd51e-d098-4a89-80cd-eed88d8920a5", "address": "fa:16:3e:74:ff:9b", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a8fd51e-d0", "ovs_interfaceid": "8a8fd51e-d098-4a89-80cd-eed88d8920a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:02:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Releasing lock "refresh_cache-e506e951-e694-40bc-a91a-800ac91e658e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:02:29 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Updated the network info_cache for instance {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 19:02:29 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:02:29 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:02:31 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:02:31 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:02:31 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 19:02:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:36 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:02:37 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:02:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:02:40 user nova-compute[74247]: DEBUG nova.objects.instance [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Lazy-loading 'pci_requests' on Instance uuid 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:02:40 user nova-compute[74247]: DEBUG nova.objects.instance [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Lazy-loading 'numa_topology' on Instance uuid 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:02:40 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 19:02:40 user nova-compute[74247]: INFO nova.compute.claims [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Claim successful on node user
Oct 16 19:02:40 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 19:02:41 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 19:02:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.250s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:02:41 user nova-compute[74247]: INFO nova.network.neutron [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Updating port f9d88799-cade-4fd4-a9d3-d2ac928f20c7 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 16 19:02:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Acquiring lock "refresh_cache-7f04ea2b-a029-44d9-ac7a-ea2b870d20eb" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:02:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Acquired lock "refresh_cache-7f04ea2b-a029-44d9-ac7a-ea2b870d20eb" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:02:41 user nova-compute[74247]: DEBUG nova.network.neutron [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 19:02:41 user nova-compute[74247]: DEBUG nova.compute.manager [req-f7a2e61f-19e8-44eb-9e90-40588d060979 req-15a6e2e1-b7ae-4a6a-b71c-0140b81d7f35 service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Received event network-changed-f9d88799-cade-4fd4-a9d3-d2ac928f20c7 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:02:41 user nova-compute[74247]: DEBUG nova.compute.manager [req-f7a2e61f-19e8-44eb-9e90-40588d060979 req-15a6e2e1-b7ae-4a6a-b71c-0140b81d7f35 service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Refreshing instance network info cache due to event network-changed-f9d88799-cade-4fd4-a9d3-d2ac928f20c7. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 19:02:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f7a2e61f-19e8-44eb-9e90-40588d060979 req-15a6e2e1-b7ae-4a6a-b71c-0140b81d7f35 service nova] Acquiring lock "refresh_cache-7f04ea2b-a029-44d9-ac7a-ea2b870d20eb" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG nova.network.neutron [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Updating instance_info_cache with network_info: [{"id": "f9d88799-cade-4fd4-a9d3-d2ac928f20c7", "address": "fa:16:3e:75:c0:0d", "network": {"id": "17f634c2-25e8-4655-8439-6a5e5d9c7e77", "bridge": "br-int", "label": "tempest-TestShelveInstance-161802280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863980f09120465ebbfb273efa0f07df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9d88799-ca", "ovs_interfaceid": "f9d88799-cade-4fd4-a9d3-d2ac928f20c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Releasing lock "refresh_cache-7f04ea2b-a029-44d9-ac7a-ea2b870d20eb" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 19:02:42 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Creating image(s)
Oct 16 19:02:42 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Did not create local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Ensure instance console log exists: /opt/stack/data/nova/instances/7f04ea2b-a029-44d9-ac7a-ea2b870d20eb/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Start _get_guest_xml network_info=[{"id": "f9d88799-cade-4fd4-a9d3-d2ac928f20c7", "address": "fa:16:3e:75:c0:0d", "network": {"id": "17f634c2-25e8-4655-8439-6a5e5d9c7e77", "bridge": "br-int", "label": "tempest-TestShelveInstance-161802280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863980f09120465ebbfb273efa0f07df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9d88799-ca", "ovs_interfaceid": "f9d88799-cade-4fd4-a9d3-d2ac928f20c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cLCfxgKw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7f04ea2b-a029-44d9-ac7a-ea2b870d20eb', 'attached_at': '', 'detached_at': '', 'volume_id': '35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d', 'serial': '35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d'}, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'dd6ede3f-52d6-4d3d-a168-35766fdecc68', 'guest_format': None, 'volume_type': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f7a2e61f-19e8-44eb-9e90-40588d060979 req-15a6e2e1-b7ae-4a6a-b71c-0140b81d7f35 service nova] Acquired lock "refresh_cache-7f04ea2b-a029-44d9-ac7a-ea2b870d20eb" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG nova.network.neutron [req-f7a2e61f-19e8-44eb-9e90-40588d060979 req-15a6e2e1-b7ae-4a6a-b71c-0140b81d7f35 service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Refreshing network info cache for port f9d88799-cade-4fd4-a9d3-d2ac928f20c7 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 19:02:42 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:02:42 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:02:42 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG nova.objects.instance [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG nova.objects.base [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Object Instance<7f04ea2b-a029-44d9-ac7a-ea2b870d20eb> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cLCfxgKw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 19:02:42 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 19:02:42 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 19:02:42 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 19:02:42 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 19:02:42 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 19:02:42 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[deeaf683-566f-4fbf-9da9-5c4d2e89eaf8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 19:02:42 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8df9988-4567-4de9-9e5a-d299b27b7e13]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d] added
Oct 16 19:02:42 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb13ad3-fbd6-4972-8e85-51ad9f47fd9c]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0b9635-106a-4f2c-b6ff-ed696ba4f0ca]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cLCfxgKw {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cLCfxgKw" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd342f3f-a01e-4304-87b9-ab794a8b6d81]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cLCfxgKw'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[25efe52b-004c-49e7-b2bb-f2986461085b]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fa5fdf-a7d8-404a-947f-352e5e5a918c]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)
Oct 16 19:02:42 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)
Oct 16 19:02:42 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5fa418-b891-4a0c-95ca-31ee774c78b0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d, portal: 172.16.0.220,3260]
Oct 16 19:02:42 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d, portal: 172.16.0.220,3260] successful.
Oct 16 19:02:42 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ac97e6-d34a-4d54-80c9-8cf74a6e42ee]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfc864d-9604-4033-a0fe-7de47a553271]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)
Oct 16 19:02:42 user nova-compute[74247]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d (non-flash)
Oct 16 19:02:42 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)
Oct 16 19:02:42 user nova-compute[74247]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d (non-flash)
Oct 16 19:02:42 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[410febc4-4872-4262-b156-333cfada77b8]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cLCfxgKw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG nova.network.neutron [req-f7a2e61f-19e8-44eb-9e90-40588d060979 req-15a6e2e1-b7ae-4a6a-b71c-0140b81d7f35 service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Updated VIF entry in instance network info cache for port f9d88799-cade-4fd4-a9d3-d2ac928f20c7. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG nova.network.neutron [req-f7a2e61f-19e8-44eb-9e90-40588d060979 req-15a6e2e1-b7ae-4a6a-b71c-0140b81d7f35 service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Updating instance_info_cache with network_info: [{"id": "f9d88799-cade-4fd4-a9d3-d2ac928f20c7", "address": "fa:16:3e:75:c0:0d", "network": {"id": "17f634c2-25e8-4655-8439-6a5e5d9c7e77", "bridge": "br-int", "label": "tempest-TestShelveInstance-161802280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863980f09120465ebbfb273efa0f07df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9d88799-ca", "ovs_interfaceid": "f9d88799-cade-4fd4-a9d3-d2ac928f20c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:02:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f7a2e61f-19e8-44eb-9e90-40588d060979 req-15a6e2e1-b7ae-4a6a-b71c-0140b81d7f35 service nova] Releasing lock "refresh_cache-7f04ea2b-a029-44d9-ac7a-ea2b870d20eb" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:02:43 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 19:02:43 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23264336230653133', 'path': '/dev/sdc'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 19:02:43 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264336230653133', 'path': '/dev/sdc'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 19:02:43 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T18:58:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-245644659',display_name='tempest-TestShelveInstance-server-245644659',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-245644659',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1763650089',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:59:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='863980f09120465ebbfb273efa0f07df',ramdisk_id='',reservation_id='r-sduxnmst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-565913270',owner_user_name='tempest-TestShelveInstance-565913270-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T19:02:24Z,user_data=None,user_id='b18bdb21bba141089a9de12a98b7d976',uuid=7f04ea2b-a029-44d9-ac7a-ea2b870d20eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f9d88799-cade-4fd4-a9d3-d2ac928f20c7", "address": "fa:16:3e:75:c0:0d", "network": {"id": "17f634c2-25e8-4655-8439-6a5e5d9c7e77", "bridge": "br-int", "label": "tempest-TestShelveInstance-161802280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863980f09120465ebbfb273efa0f07df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9d88799-ca", "ovs_interfaceid": "f9d88799-cade-4fd4-a9d3-d2ac928f20c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 19:02:43 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Converting VIF {"id": "f9d88799-cade-4fd4-a9d3-d2ac928f20c7", "address": "fa:16:3e:75:c0:0d", "network": {"id": "17f634c2-25e8-4655-8439-6a5e5d9c7e77", "bridge": "br-int", "label": "tempest-TestShelveInstance-161802280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863980f09120465ebbfb273efa0f07df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9d88799-ca", "ovs_interfaceid": "f9d88799-cade-4fd4-a9d3-d2ac928f20c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 19:02:43 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:c0:0d,bridge_name='br-int',has_traffic_filtering=True,id=f9d88799-cade-4fd4-a9d3-d2ac928f20c7,network=Network(17f634c2-25e8-4655-8439-6a5e5d9c7e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9d88799-ca') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 19:02:43 user nova-compute[74247]: DEBUG nova.objects.instance [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Lazy-loading 'pci_devices' on Instance uuid 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:02:43 user nova-compute[74247]: DEBUG nova.objects.base [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Object Instance<7f04ea2b-a029-44d9-ac7a-ea2b870d20eb> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 19:02:43 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] End _get_guest_xml xml=<domain type="kvm">
Oct 16 19:02:43 user nova-compute[74247]:   <uuid>7f04ea2b-a029-44d9-ac7a-ea2b870d20eb</uuid>
Oct 16 19:02:43 user nova-compute[74247]:   <name>instance-0000002d</name>
Oct 16 19:02:43 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 19:02:43 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 19:02:43 user nova-compute[74247]:   <metadata>
Oct 16 19:02:43 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 19:02:43 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 19:02:43 user nova-compute[74247]:       <nova:name>tempest-TestShelveInstance-server-245644659</nova:name>
Oct 16 19:02:43 user nova-compute[74247]:       <nova:creationTime>2023-10-16 19:02:42</nova:creationTime>
Oct 16 19:02:43 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 19:02:43 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 19:02:43 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 19:02:43 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 19:02:43 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 19:02:43 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 19:02:43 user nova-compute[74247]:       </nova:flavor>
Oct 16 19:02:43 user nova-compute[74247]:       <nova:owner>
Oct 16 19:02:43 user nova-compute[74247]:         <nova:user uuid="b18bdb21bba141089a9de12a98b7d976">tempest-TestShelveInstance-565913270-project-member</nova:user>
Oct 16 19:02:43 user nova-compute[74247]:         <nova:project uuid="863980f09120465ebbfb273efa0f07df">tempest-TestShelveInstance-565913270</nova:project>
Oct 16 19:02:43 user nova-compute[74247]:       </nova:owner>
Oct 16 19:02:43 user nova-compute[74247]:       <nova:ports>
Oct 16 19:02:43 user nova-compute[74247]:         <nova:port uuid="f9d88799-cade-4fd4-a9d3-d2ac928f20c7">
Oct 16 19:02:43 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 16 19:02:43 user nova-compute[74247]:         </nova:port>
Oct 16 19:02:43 user nova-compute[74247]:       </nova:ports>
Oct 16 19:02:43 user nova-compute[74247]:     </nova:instance>
Oct 16 19:02:43 user nova-compute[74247]:   </metadata>
Oct 16 19:02:43 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 19:02:43 user nova-compute[74247]:     <system>
Oct 16 19:02:43 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 19:02:43 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 19:02:43 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 19:02:43 user nova-compute[74247]:       <entry name="serial">7f04ea2b-a029-44d9-ac7a-ea2b870d20eb</entry>
Oct 16 19:02:43 user nova-compute[74247]:       <entry name="uuid">7f04ea2b-a029-44d9-ac7a-ea2b870d20eb</entry>
Oct 16 19:02:43 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 19:02:43 user nova-compute[74247]:     </system>
Oct 16 19:02:43 user nova-compute[74247]:   </sysinfo>
Oct 16 19:02:43 user nova-compute[74247]:   <os>
Oct 16 19:02:43 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 19:02:43 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 19:02:43 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 19:02:43 user nova-compute[74247]:   </os>
Oct 16 19:02:43 user nova-compute[74247]:   <features>
Oct 16 19:02:43 user nova-compute[74247]:     <acpi/>
Oct 16 19:02:43 user nova-compute[74247]:     <apic/>
Oct 16 19:02:43 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 19:02:43 user nova-compute[74247]:   </features>
Oct 16 19:02:43 user nova-compute[74247]:   <clock offset="utc">
Oct 16 19:02:43 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 19:02:43 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 19:02:43 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 19:02:43 user nova-compute[74247]:   </clock>
Oct 16 19:02:43 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 19:02:43 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 19:02:43 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 19:02:43 user nova-compute[74247]:   </cpu>
Oct 16 19:02:43 user nova-compute[74247]:   <devices>
Oct 16 19:02:43 user nova-compute[74247]:     <disk type="block" device="disk">
Oct 16 19:02:43 user nova-compute[74247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 19:02:43 user nova-compute[74247]:       <source dev="/dev/sdc"/>
Oct 16 19:02:43 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 19:02:43 user nova-compute[74247]:       <serial>35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d</serial>
Oct 16 19:02:43 user nova-compute[74247]:     </disk>
Oct 16 19:02:43 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 19:02:43 user nova-compute[74247]:       <mac address="fa:16:3e:75:c0:0d"/>
Oct 16 19:02:43 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 19:02:43 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 19:02:43 user nova-compute[74247]:       <target dev="tapf9d88799-ca"/>
Oct 16 19:02:43 user nova-compute[74247]:     </interface>
Oct 16 19:02:43 user nova-compute[74247]:     <serial type="pty">
Oct 16 19:02:43 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/7f04ea2b-a029-44d9-ac7a-ea2b870d20eb/console.log" append="off"/>
Oct 16 19:02:43 user nova-compute[74247]:     </serial>
Oct 16 19:02:43 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 19:02:43 user nova-compute[74247]:     <video>
Oct 16 19:02:43 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 19:02:43 user nova-compute[74247]:     </video>
Oct 16 19:02:43 user nova-compute[74247]:     <rng model="virtio">
Oct 16 19:02:43 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 19:02:43 user nova-compute[74247]:     </rng>
Oct 16 19:02:43 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 19:02:43 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 19:02:43 user nova-compute[74247]:       <stats period="10"/>
Oct 16 19:02:43 user nova-compute[74247]:     </memballoon>
Oct 16 19:02:43 user nova-compute[74247]:   </devices>
Oct 16 19:02:43 user nova-compute[74247]: </domain>
Oct 16 19:02:43 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 19:02:43 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T18:58:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-245644659',display_name='tempest-TestShelveInstance-server-245644659',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-245644659',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1763650089',keypairs=<?>,launch_index=0,launched_at=2023-10-16T18:59:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='863980f09120465ebbfb273efa0f07df',ramdisk_id='',reservation_id='r-sduxnmst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-565913270',owner_user_name='tempest-TestShelveInstance-565913270-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T19:02:24Z,user_data=None,user_id='b18bdb21bba141089a9de12a98b7d976',uuid=7f04ea2b-a029-44d9-ac7a-ea2b870d20eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f9d88799-cade-4fd4-a9d3-d2ac928f20c7", "address": "fa:16:3e:75:c0:0d", "network": {"id": "17f634c2-25e8-4655-8439-6a5e5d9c7e77", "bridge": "br-int", "label": "tempest-TestShelveInstance-161802280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863980f09120465ebbfb273efa0f07df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9d88799-ca", "ovs_interfaceid": "f9d88799-cade-4fd4-a9d3-d2ac928f20c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 19:02:43 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Converting VIF {"id": "f9d88799-cade-4fd4-a9d3-d2ac928f20c7", "address": "fa:16:3e:75:c0:0d", "network": {"id": "17f634c2-25e8-4655-8439-6a5e5d9c7e77", "bridge": "br-int", "label": "tempest-TestShelveInstance-161802280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863980f09120465ebbfb273efa0f07df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9d88799-ca", "ovs_interfaceid": "f9d88799-cade-4fd4-a9d3-d2ac928f20c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 19:02:43 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:c0:0d,bridge_name='br-int',has_traffic_filtering=True,id=f9d88799-cade-4fd4-a9d3-d2ac928f20c7,network=Network(17f634c2-25e8-4655-8439-6a5e5d9c7e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9d88799-ca') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 19:02:43 user nova-compute[74247]: DEBUG os_vif [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:c0:0d,bridge_name='br-int',has_traffic_filtering=True,id=f9d88799-cade-4fd4-a9d3-d2ac928f20c7,network=Network(17f634c2-25e8-4655-8439-6a5e5d9c7e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9d88799-ca') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 19:02:43 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:43 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:02:43 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 19:02:43 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:43 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6988aae1-2a73-5f77-809d-8ece8661a9b5', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:02:43 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:43 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:02:43 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:43 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9d88799-ca, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:02:43 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf9d88799-ca, col_values=(('qos', UUID('6d4a9ab3-07bd-4d9f-85b7-a758b0b50151')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:02:43 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf9d88799-ca, col_values=(('external_ids', {'iface-id': 'f9d88799-cade-4fd4-a9d3-d2ac928f20c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:c0:0d', 'vm-uuid': '7f04ea2b-a029-44d9-ac7a-ea2b870d20eb'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:02:43 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:43 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:02:43 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:43 user nova-compute[74247]: INFO os_vif [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:c0:0d,bridge_name='br-int',has_traffic_filtering=True,id=f9d88799-cade-4fd4-a9d3-d2ac928f20c7,network=Network(17f634c2-25e8-4655-8439-6a5e5d9c7e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9d88799-ca')
Oct 16 19:02:43 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 19:02:43 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] No VIF found with MAC fa:16:3e:75:c0:0d, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 19:02:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:45 user nova-compute[74247]: DEBUG nova.compute.manager [req-7475bf84-e82b-4907-9212-019882325f5a req-1617b830-83b0-4a39-9a9c-db1e4f94d6d2 service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Received event network-vif-plugged-f9d88799-cade-4fd4-a9d3-d2ac928f20c7 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:02:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7475bf84-e82b-4907-9212-019882325f5a req-1617b830-83b0-4a39-9a9c-db1e4f94d6d2 service nova] Acquiring lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:02:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7475bf84-e82b-4907-9212-019882325f5a req-1617b830-83b0-4a39-9a9c-db1e4f94d6d2 service nova] Lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:02:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7475bf84-e82b-4907-9212-019882325f5a req-1617b830-83b0-4a39-9a9c-db1e4f94d6d2 service nova] Lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:02:45 user nova-compute[74247]: DEBUG nova.compute.manager [req-7475bf84-e82b-4907-9212-019882325f5a req-1617b830-83b0-4a39-9a9c-db1e4f94d6d2 service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] No waiting events found dispatching network-vif-plugged-f9d88799-cade-4fd4-a9d3-d2ac928f20c7 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:02:45 user nova-compute[74247]: WARNING nova.compute.manager [req-7475bf84-e82b-4907-9212-019882325f5a req-1617b830-83b0-4a39-9a9c-db1e4f94d6d2 service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Received unexpected event network-vif-plugged-f9d88799-cade-4fd4-a9d3-d2ac928f20c7 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 16 19:02:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:47 user nova-compute[74247]: DEBUG nova.compute.manager [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 19:02:47 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 19:02:47 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Instance spawned successfully.
Oct 16 19:02:47 user nova-compute[74247]: DEBUG nova.compute.manager [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 19:02:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-8fcdcabf-90cb-4375-bd31-1989dd47ea28 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 23.539s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:02:47 user nova-compute[74247]: DEBUG nova.compute.manager [req-4b8b0b1f-b98a-44e4-abd9-f910137ca63a req-c3ab2c0e-dd4f-447f-9949-25cce86e6cba service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Received event network-vif-plugged-f9d88799-cade-4fd4-a9d3-d2ac928f20c7 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:02:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4b8b0b1f-b98a-44e4-abd9-f910137ca63a req-c3ab2c0e-dd4f-447f-9949-25cce86e6cba service nova] Acquiring lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:02:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4b8b0b1f-b98a-44e4-abd9-f910137ca63a req-c3ab2c0e-dd4f-447f-9949-25cce86e6cba service nova] Lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:02:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4b8b0b1f-b98a-44e4-abd9-f910137ca63a req-c3ab2c0e-dd4f-447f-9949-25cce86e6cba service nova] Lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:02:47 user nova-compute[74247]: DEBUG nova.compute.manager [req-4b8b0b1f-b98a-44e4-abd9-f910137ca63a req-c3ab2c0e-dd4f-447f-9949-25cce86e6cba service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] No waiting events found dispatching network-vif-plugged-f9d88799-cade-4fd4-a9d3-d2ac928f20c7 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:02:47 user nova-compute[74247]: WARNING nova.compute.manager [req-4b8b0b1f-b98a-44e4-abd9-f910137ca63a req-c3ab2c0e-dd4f-447f-9949-25cce86e6cba service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Received unexpected event network-vif-plugged-f9d88799-cade-4fd4-a9d3-d2ac928f20c7 for instance with vm_state active and task_state None.
Oct 16 19:02:48 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:50 user nova-compute[74247]: DEBUG nova.compute.manager [req-96047162-2624-4041-bfd0-c4e9320c1df6 req-e3f0dbc9-611c-46c7-986c-8b3edefe146c service nova] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Received event network-changed-8a8fd51e-d098-4a89-80cd-eed88d8920a5 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:02:50 user nova-compute[74247]: DEBUG nova.compute.manager [req-96047162-2624-4041-bfd0-c4e9320c1df6 req-e3f0dbc9-611c-46c7-986c-8b3edefe146c service nova] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Refreshing instance network info cache due to event network-changed-8a8fd51e-d098-4a89-80cd-eed88d8920a5. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 19:02:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-96047162-2624-4041-bfd0-c4e9320c1df6 req-e3f0dbc9-611c-46c7-986c-8b3edefe146c service nova] Acquiring lock "refresh_cache-e506e951-e694-40bc-a91a-800ac91e658e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:02:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-96047162-2624-4041-bfd0-c4e9320c1df6 req-e3f0dbc9-611c-46c7-986c-8b3edefe146c service nova] Acquired lock "refresh_cache-e506e951-e694-40bc-a91a-800ac91e658e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:02:50 user nova-compute[74247]: DEBUG nova.network.neutron [req-96047162-2624-4041-bfd0-c4e9320c1df6 req-e3f0dbc9-611c-46c7-986c-8b3edefe146c service nova] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Refreshing network info cache for port 8a8fd51e-d098-4a89-80cd-eed88d8920a5 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 19:02:50 user nova-compute[74247]: DEBUG nova.network.neutron [req-96047162-2624-4041-bfd0-c4e9320c1df6 req-e3f0dbc9-611c-46c7-986c-8b3edefe146c service nova] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Updated VIF entry in instance network info cache for port 8a8fd51e-d098-4a89-80cd-eed88d8920a5. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 19:02:50 user nova-compute[74247]: DEBUG nova.network.neutron [req-96047162-2624-4041-bfd0-c4e9320c1df6 req-e3f0dbc9-611c-46c7-986c-8b3edefe146c service nova] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Updating instance_info_cache with network_info: [{"id": "8a8fd51e-d098-4a89-80cd-eed88d8920a5", "address": "fa:16:3e:74:ff:9b", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a8fd51e-d0", "ovs_interfaceid": "8a8fd51e-d098-4a89-80cd-eed88d8920a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:02:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-96047162-2624-4041-bfd0-c4e9320c1df6 req-e3f0dbc9-611c-46c7-986c-8b3edefe146c service nova] Releasing lock "refresh_cache-e506e951-e694-40bc-a91a-800ac91e658e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:02:52 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:02:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:03:02 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:03:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:03:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "c81b3e99-e02a-43ae-94fa-165bac55700a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:03:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "c81b3e99-e02a-43ae-94fa-165bac55700a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:03:06 user nova-compute[74247]: DEBUG nova.compute.manager [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 19:03:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:03:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:03:06 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 19:03:06 user nova-compute[74247]: INFO nova.compute.claims [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Claim successful on node user
Oct 16 19:03:06 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 19:03:06 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 19:03:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.313s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:03:06 user nova-compute[74247]: DEBUG nova.compute.manager [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 19:03:06 user nova-compute[74247]: DEBUG nova.compute.manager [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 19:03:06 user nova-compute[74247]: DEBUG nova.network.neutron [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 19:03:06 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 19:03:06 user nova-compute[74247]: DEBUG nova.compute.manager [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 19:03:06 user nova-compute[74247]: INFO nova.virt.block_device [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Booting with volume 1573ec1f-a300-4641-90ab-0f4858380b2c at /dev/vda
Oct 16 19:03:06 user nova-compute[74247]: DEBUG nova.policy [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9608bf58b70248439dbbcc9db38fba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6144ea4e14c28b085e271175bbf67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 19:03:06 user nova-compute[74247]: DEBUG os_brick.utils [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 19:03:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:03:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:03:06 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f190bc67-4627-47f7-befc-62bb242d5366]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:03:06 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:03:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:03:07 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c227bb4-1e2d-4850-8e92-c17d3d9d2450]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:03:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:03:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:03:07 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ce60e3-19e7-4617-9a61-e7a0d0138c94]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:03:07 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b91f8b-2673-4195-b2e4-9309351a8ef3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:03:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:03:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 19:03:07 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 19:03:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:03:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 19:03:07 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 19:03:07 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a397141-fd83-45cb-9a13-1b50e7159821]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:03:07 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 19:03:07 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 19:03:07 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 19:03:07 user nova-compute[74247]: DEBUG os_brick.utils [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 19:03:07 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Updating existing volume attachment record: 7ed48202-bbd9-4696-952a-53e23211ae0c {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 19:03:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:03:07 user nova-compute[74247]: DEBUG nova.network.neutron [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Successfully created port: 8f93697e-d06a-44eb-b63a-b7433c52adb9 {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 19:03:08 user nova-compute[74247]: DEBUG nova.network.neutron [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Successfully updated port: 8f93697e-d06a-44eb-b63a-b7433c52adb9 {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 19:03:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "refresh_cache-c81b3e99-e02a-43ae-94fa-165bac55700a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:03:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquired lock "refresh_cache-c81b3e99-e02a-43ae-94fa-165bac55700a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:03:08 user nova-compute[74247]: DEBUG nova.network.neutron [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 19:03:08 user nova-compute[74247]: DEBUG nova.compute.manager [req-f3eb1182-4fe7-4394-aae5-c9243ccef5ea req-5ffacbff-5b91-4186-b87e-ef960a09d750 service nova] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Received event network-changed-8f93697e-d06a-44eb-b63a-b7433c52adb9 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:03:08 user nova-compute[74247]: DEBUG nova.compute.manager [req-f3eb1182-4fe7-4394-aae5-c9243ccef5ea req-5ffacbff-5b91-4186-b87e-ef960a09d750 service nova] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Refreshing instance network info cache due to event network-changed-8f93697e-d06a-44eb-b63a-b7433c52adb9. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 19:03:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f3eb1182-4fe7-4394-aae5-c9243ccef5ea req-5ffacbff-5b91-4186-b87e-ef960a09d750 service nova] Acquiring lock "refresh_cache-c81b3e99-e02a-43ae-94fa-165bac55700a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:03:08 user nova-compute[74247]: DEBUG nova.network.neutron [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 19:03:08 user nova-compute[74247]: DEBUG nova.network.neutron [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Updating instance_info_cache with network_info: [{"id": "8f93697e-d06a-44eb-b63a-b7433c52adb9", "address": "fa:16:3e:67:33:5c", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f93697e-d0", "ovs_interfaceid": "8f93697e-d06a-44eb-b63a-b7433c52adb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:03:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Releasing lock "refresh_cache-c81b3e99-e02a-43ae-94fa-165bac55700a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:03:08 user nova-compute[74247]: DEBUG nova.compute.manager [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Instance network_info: |[{"id": "8f93697e-d06a-44eb-b63a-b7433c52adb9", "address": "fa:16:3e:67:33:5c", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f93697e-d0", "ovs_interfaceid": "8f93697e-d06a-44eb-b63a-b7433c52adb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 19:03:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f3eb1182-4fe7-4394-aae5-c9243ccef5ea req-5ffacbff-5b91-4186-b87e-ef960a09d750 service nova] Acquired lock "refresh_cache-c81b3e99-e02a-43ae-94fa-165bac55700a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:03:08 user nova-compute[74247]: DEBUG nova.network.neutron [req-f3eb1182-4fe7-4394-aae5-c9243ccef5ea req-5ffacbff-5b91-4186-b87e-ef960a09d750 service nova] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Refreshing network info cache for port 8f93697e-d06a-44eb-b63a-b7433c52adb9 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 19:03:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:03:09 user nova-compute[74247]: DEBUG nova.network.neutron [req-f3eb1182-4fe7-4394-aae5-c9243ccef5ea req-5ffacbff-5b91-4186-b87e-ef960a09d750 service nova] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Updated VIF entry in instance network info cache for port 8f93697e-d06a-44eb-b63a-b7433c52adb9. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 19:03:09 user nova-compute[74247]: DEBUG nova.network.neutron [req-f3eb1182-4fe7-4394-aae5-c9243ccef5ea req-5ffacbff-5b91-4186-b87e-ef960a09d750 service nova] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Updating instance_info_cache with network_info: [{"id": "8f93697e-d06a-44eb-b63a-b7433c52adb9", "address": "fa:16:3e:67:33:5c", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f93697e-d0", "ovs_interfaceid": "8f93697e-d06a-44eb-b63a-b7433c52adb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:03:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f3eb1182-4fe7-4394-aae5-c9243ccef5ea req-5ffacbff-5b91-4186-b87e-ef960a09d750 service nova] Releasing lock "refresh_cache-c81b3e99-e02a-43ae-94fa-165bac55700a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:03:12 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:03:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:03:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:03:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:03:20 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:03:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG nova.compute.manager [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 19:03:23 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Creating image(s)
Oct 16 19:03:23 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Did not create local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Ensure instance console log exists: /opt/stack/data/nova/instances/c81b3e99-e02a-43ae-94fa-165bac55700a/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Start _get_guest_xml network_info=[{"id": "8f93697e-d06a-44eb-b63a-b7433c52adb9", "address": "fa:16:3e:67:33:5c", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f93697e-d0", "ovs_interfaceid": "8f93697e-d06a-44eb-b63a-b7433c52adb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pTMwdgtS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c81b3e99-e02a-43ae-94fa-165bac55700a', 'attached_at': '', 'detached_at': '', 'volume_id': '1573ec1f-a300-4641-90ab-0f4858380b2c', 'serial': '1573ec1f-a300-4641-90ab-0f4858380b2c'}, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '7ed48202-bbd9-4696-952a-53e23211ae0c', 'guest_format': None, 'volume_type': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 19:03:23 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:03:23 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:03:23 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pTMwdgtS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 19:03:23 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 19:03:23 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 19:03:23 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 19:03:23 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 19:03:23 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 19:03:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e971a13d-e30f-408f-b90c-04e14dd2c961]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 19:03:23 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42c946f-8e10-435a-9d46-403828759f6b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c] added
Oct 16 19:03:23 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[40371ed3-ed26-4cea-9b2f-c5f176128595]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[926ed5fb-d43a-4c6b-b901-24f37317610a]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pTMwdgtS {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pTMwdgtS" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea04c19a-5f39-4a62-9fa0-965051d6c60c]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pTMwdgtS'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[35543bb8-4a18-46d0-bcfa-fd8fc97263ce]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e48ac8-5b29-4b2f-bc04-dfe67c9e30ea]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)
Oct 16 19:03:23 user nova-compute[74247]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d (non-flash)
Oct 16 19:03:23 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)
Oct 16 19:03:23 user nova-compute[74247]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d (non-flash)
Oct 16 19:03:23 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[345718a6-8d1d-44a1-9429-fa917d14c807]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c, portal: 172.16.0.220,3260]
Oct 16 19:03:23 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c, portal: 172.16.0.220,3260] successful.
Oct 16 19:03:23 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9764de29-d847-47d3-a331-2b109384308c]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[397d0f5b-29c4-4afa-a3ff-cae85fa34a74]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)
Oct 16 19:03:23 user nova-compute[74247]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d (non-flash)
Oct 16 19:03:23 user nova-compute[74247]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c (non-flash)
Oct 16 19:03:23 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)
Oct 16 19:03:23 user nova-compute[74247]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d (non-flash)
Oct 16 19:03:23 user nova-compute[74247]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c (non-flash)
Oct 16 19:03:23 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] HCTL ('35', '-', '-', 0) found on session 53 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[557f809d-afe6-4c8f-aef2-df664ee47e04]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Searching for a device in session 53 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pTMwdgtS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:03:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:03:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:03:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 19:03:24 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:03:24 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:03:24 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=8587MB free_disk=24.909160614013672GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 19:03:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:03:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:03:24 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 19:03:24 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '26135373034626633', 'path': '/dev/sdd'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 19:03:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135373034626633', 'path': '/dev/sdd'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 19:03:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T19:03:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1271233429',display_name='tempest-TestVolumeBootPattern-server-1271233429',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1271233429',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjgu1PdB/VXTN5rZ7oE5e7ovtw+8pzQ24n8jIU2366r669SEEAxAB/9LNF+VOEmvr2qFXyje/n1vbSVuotOeSuaNNrodAuV6fmL4YsSSNhGH3oIDcKRDUc8ro4Dw/7HjQ==',key_name='tempest-TestVolumeBootPattern-34627609',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dca6144ea4e14c28b085e271175bbf67',ramdisk_id='',reservation_id='r-jtfhmh5i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1733357121',owner_user_name='tempest-TestVolumeBootPattern-1733357121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T19:03:07Z,user_data=None,user_id='9608bf58b70248439dbbcc9db38fba08',uuid=c81b3e99-e02a-43ae-94fa-165bac55700a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f93697e-d06a-44eb-b63a-b7433c52adb9", "address": "fa:16:3e:67:33:5c", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f93697e-d0", "ovs_interfaceid": "8f93697e-d06a-44eb-b63a-b7433c52adb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 19:03:24 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Converting VIF {"id": "8f93697e-d06a-44eb-b63a-b7433c52adb9", "address": "fa:16:3e:67:33:5c", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f93697e-d0", "ovs_interfaceid": "8f93697e-d06a-44eb-b63a-b7433c52adb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 19:03:24 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:33:5c,bridge_name='br-int',has_traffic_filtering=True,id=8f93697e-d06a-44eb-b63a-b7433c52adb9,network=Network(9688c665-d4b7-4179-9a76-fdf6c3013b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f93697e-d0') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 19:03:24 user nova-compute[74247]: DEBUG nova.objects.instance [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lazy-loading 'pci_devices' on Instance uuid c81b3e99-e02a-43ae-94fa-165bac55700a {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:03:24 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance e506e951-e694-40bc-a91a-800ac91e658e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 19:03:24 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 68edbfa7-0752-42fb-bad8-eb7121796e9f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 19:03:24 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 19:03:24 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance c81b3e99-e02a-43ae-94fa-165bac55700a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 19:03:24 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 19:03:24 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 19:03:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] End _get_guest_xml xml=<domain type="kvm">
Oct 16 19:03:24 user nova-compute[74247]:   <uuid>c81b3e99-e02a-43ae-94fa-165bac55700a</uuid>
Oct 16 19:03:24 user nova-compute[74247]:   <name>instance-00000030</name>
Oct 16 19:03:24 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 19:03:24 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 19:03:24 user nova-compute[74247]:   <metadata>
Oct 16 19:03:24 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 19:03:24 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 19:03:24 user nova-compute[74247]:       <nova:name>tempest-TestVolumeBootPattern-server-1271233429</nova:name>
Oct 16 19:03:24 user nova-compute[74247]:       <nova:creationTime>2023-10-16 19:03:23</nova:creationTime>
Oct 16 19:03:24 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 19:03:24 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 19:03:24 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 19:03:24 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 19:03:24 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 19:03:24 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 19:03:24 user nova-compute[74247]:       </nova:flavor>
Oct 16 19:03:24 user nova-compute[74247]:       <nova:owner>
Oct 16 19:03:24 user nova-compute[74247]:         <nova:user uuid="9608bf58b70248439dbbcc9db38fba08">tempest-TestVolumeBootPattern-1733357121-project-member</nova:user>
Oct 16 19:03:24 user nova-compute[74247]:         <nova:project uuid="dca6144ea4e14c28b085e271175bbf67">tempest-TestVolumeBootPattern-1733357121</nova:project>
Oct 16 19:03:24 user nova-compute[74247]:       </nova:owner>
Oct 16 19:03:24 user nova-compute[74247]:       <nova:ports>
Oct 16 19:03:24 user nova-compute[74247]:         <nova:port uuid="8f93697e-d06a-44eb-b63a-b7433c52adb9">
Oct 16 19:03:24 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 16 19:03:24 user nova-compute[74247]:         </nova:port>
Oct 16 19:03:24 user nova-compute[74247]:       </nova:ports>
Oct 16 19:03:24 user nova-compute[74247]:     </nova:instance>
Oct 16 19:03:24 user nova-compute[74247]:   </metadata>
Oct 16 19:03:24 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 19:03:24 user nova-compute[74247]:     <system>
Oct 16 19:03:24 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 19:03:24 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 19:03:24 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 19:03:24 user nova-compute[74247]:       <entry name="serial">c81b3e99-e02a-43ae-94fa-165bac55700a</entry>
Oct 16 19:03:24 user nova-compute[74247]:       <entry name="uuid">c81b3e99-e02a-43ae-94fa-165bac55700a</entry>
Oct 16 19:03:24 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 19:03:24 user nova-compute[74247]:     </system>
Oct 16 19:03:24 user nova-compute[74247]:   </sysinfo>
Oct 16 19:03:24 user nova-compute[74247]:   <os>
Oct 16 19:03:24 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 19:03:24 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 19:03:24 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 19:03:24 user nova-compute[74247]:   </os>
Oct 16 19:03:24 user nova-compute[74247]:   <features>
Oct 16 19:03:24 user nova-compute[74247]:     <acpi/>
Oct 16 19:03:24 user nova-compute[74247]:     <apic/>
Oct 16 19:03:24 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 19:03:24 user nova-compute[74247]:   </features>
Oct 16 19:03:24 user nova-compute[74247]:   <clock offset="utc">
Oct 16 19:03:24 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 19:03:24 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 19:03:24 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 19:03:24 user nova-compute[74247]:   </clock>
Oct 16 19:03:24 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 19:03:24 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 19:03:24 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 19:03:24 user nova-compute[74247]:   </cpu>
Oct 16 19:03:24 user nova-compute[74247]:   <devices>
Oct 16 19:03:24 user nova-compute[74247]:     <disk type="block" device="disk">
Oct 16 19:03:24 user nova-compute[74247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 19:03:24 user nova-compute[74247]:       <source dev="/dev/sdd"/>
Oct 16 19:03:24 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 19:03:24 user nova-compute[74247]:       <serial>1573ec1f-a300-4641-90ab-0f4858380b2c</serial>
Oct 16 19:03:24 user nova-compute[74247]:     </disk>
Oct 16 19:03:24 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 19:03:24 user nova-compute[74247]:       <mac address="fa:16:3e:67:33:5c"/>
Oct 16 19:03:24 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 19:03:24 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 19:03:24 user nova-compute[74247]:       <target dev="tap8f93697e-d0"/>
Oct 16 19:03:24 user nova-compute[74247]:     </interface>
Oct 16 19:03:24 user nova-compute[74247]:     <serial type="pty">
Oct 16 19:03:24 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/c81b3e99-e02a-43ae-94fa-165bac55700a/console.log" append="off"/>
Oct 16 19:03:24 user nova-compute[74247]:     </serial>
Oct 16 19:03:24 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 19:03:24 user nova-compute[74247]:     <video>
Oct 16 19:03:24 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 19:03:24 user nova-compute[74247]:     </video>
Oct 16 19:03:24 user nova-compute[74247]:     <rng model="virtio">
Oct 16 19:03:24 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 19:03:24 user nova-compute[74247]:     </rng>
Oct 16 19:03:24 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 19:03:24 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 19:03:24 user nova-compute[74247]:       <stats period="10"/>
Oct 16 19:03:24 user nova-compute[74247]:     </memballoon>
Oct 16 19:03:24 user nova-compute[74247]:   </devices>
Oct 16 19:03:24 user nova-compute[74247]: </domain>
Oct 16 19:03:24 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 19:03:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T19:03:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1271233429',display_name='tempest-TestVolumeBootPattern-server-1271233429',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1271233429',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjgu1PdB/VXTN5rZ7oE5e7ovtw+8pzQ24n8jIU2366r669SEEAxAB/9LNF+VOEmvr2qFXyje/n1vbSVuotOeSuaNNrodAuV6fmL4YsSSNhGH3oIDcKRDUc8ro4Dw/7HjQ==',key_name='tempest-TestVolumeBootPattern-34627609',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dca6144ea4e14c28b085e271175bbf67',ramdisk_id='',reservation_id='r-jtfhmh5i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1733357121',owner_user_name='tempest-TestVolumeBootPattern-1733357121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T19:03:07Z,user_data=None,user_id='9608bf58b70248439dbbcc9db38fba08',uuid=c81b3e99-e02a-43ae-94fa-165bac55700a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f93697e-d06a-44eb-b63a-b7433c52adb9", "address": "fa:16:3e:67:33:5c", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f93697e-d0", "ovs_interfaceid": "8f93697e-d06a-44eb-b63a-b7433c52adb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 19:03:24 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Converting VIF {"id": "8f93697e-d06a-44eb-b63a-b7433c52adb9", "address": "fa:16:3e:67:33:5c", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f93697e-d0", "ovs_interfaceid": "8f93697e-d06a-44eb-b63a-b7433c52adb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 19:03:24 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:33:5c,bridge_name='br-int',has_traffic_filtering=True,id=8f93697e-d06a-44eb-b63a-b7433c52adb9,network=Network(9688c665-d4b7-4179-9a76-fdf6c3013b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f93697e-d0') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 19:03:24 user nova-compute[74247]: DEBUG os_vif [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:33:5c,bridge_name='br-int',has_traffic_filtering=True,id=8f93697e-d06a-44eb-b63a-b7433c52adb9,network=Network(9688c665-d4b7-4179-9a76-fdf6c3013b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f93697e-d0') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 19:03:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:03:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:03:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 19:03:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:03:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0d51fb13-c041-55fe-8c14-e07eb285fd1b', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:03:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:03:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:03:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:03:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f93697e-d0, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:03:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8f93697e-d0, col_values=(('qos', UUID('c833cd2d-f72c-4065-b497-113ce32993ae')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:03:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8f93697e-d0, col_values=(('external_ids', {'iface-id': '8f93697e-d06a-44eb-b63a-b7433c52adb9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:33:5c', 'vm-uuid': 'c81b3e99-e02a-43ae-94fa-165bac55700a'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:03:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:03:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:03:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:03:24 user nova-compute[74247]: INFO os_vif [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:33:5c,bridge_name='br-int',has_traffic_filtering=True,id=8f93697e-d06a-44eb-b63a-b7433c52adb9,network=Network(9688c665-d4b7-4179-9a76-fdf6c3013b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f93697e-d0')
Oct 16 19:03:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 19:03:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] No VIF found with MAC fa:16:3e:67:33:5c, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 19:03:24 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 19:03:24 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 19:03:24 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 19:03:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.307s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:03:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:03:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:03:26 user nova-compute[74247]: DEBUG nova.compute.manager [req-1cb0dc96-4ab0-4809-8ee1-ea86408026a6 req-b1f49103-3088-4d09-a353-a9a26a2e59e9 service nova] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Received event network-vif-plugged-8f93697e-d06a-44eb-b63a-b7433c52adb9 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:03:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1cb0dc96-4ab0-4809-8ee1-ea86408026a6 req-b1f49103-3088-4d09-a353-a9a26a2e59e9 service nova] Acquiring lock "c81b3e99-e02a-43ae-94fa-165bac55700a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:03:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1cb0dc96-4ab0-4809-8ee1-ea86408026a6 req-b1f49103-3088-4d09-a353-a9a26a2e59e9 service nova] Lock "c81b3e99-e02a-43ae-94fa-165bac55700a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:03:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1cb0dc96-4ab0-4809-8ee1-ea86408026a6 req-b1f49103-3088-4d09-a353-a9a26a2e59e9 service nova] Lock "c81b3e99-e02a-43ae-94fa-165bac55700a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:03:26 user nova-compute[74247]: DEBUG nova.compute.manager [req-1cb0dc96-4ab0-4809-8ee1-ea86408026a6 req-b1f49103-3088-4d09-a353-a9a26a2e59e9 service nova] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] No waiting events found dispatching network-vif-plugged-8f93697e-d06a-44eb-b63a-b7433c52adb9 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:03:26 user nova-compute[74247]: WARNING nova.compute.manager [req-1cb0dc96-4ab0-4809-8ee1-ea86408026a6 req-b1f49103-3088-4d09-a353-a9a26a2e59e9 service nova] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Received unexpected event network-vif-plugged-8f93697e-d06a-44eb-b63a-b7433c52adb9 for instance with vm_state building and task_state spawning.
Oct 16 19:03:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:03:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:03:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:03:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:03:28 user nova-compute[74247]: DEBUG nova.compute.manager [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 19:03:28 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 19:03:28 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Instance spawned successfully.
Oct 16 19:03:28 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 19:03:28 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 19:03:28 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 19:03:28 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 19:03:28 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 19:03:28 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 19:03:28 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 19:03:28 user nova-compute[74247]: INFO nova.compute.manager [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Took 4.96 seconds to spawn the instance on the hypervisor.
Oct 16 19:03:28 user nova-compute[74247]: DEBUG nova.compute.manager [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 19:03:28 user nova-compute[74247]: DEBUG nova.compute.manager [req-9b31310c-5bab-4520-bda8-4da1d5e810f6 req-ac8c833a-6827-4035-8d11-997886c35534 service nova] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Received event network-vif-plugged-8f93697e-d06a-44eb-b63a-b7433c52adb9 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:03:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9b31310c-5bab-4520-bda8-4da1d5e810f6 req-ac8c833a-6827-4035-8d11-997886c35534 service nova] Acquiring lock "c81b3e99-e02a-43ae-94fa-165bac55700a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:03:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9b31310c-5bab-4520-bda8-4da1d5e810f6 req-ac8c833a-6827-4035-8d11-997886c35534 service nova] Lock "c81b3e99-e02a-43ae-94fa-165bac55700a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:03:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9b31310c-5bab-4520-bda8-4da1d5e810f6 req-ac8c833a-6827-4035-8d11-997886c35534 service nova] Lock "c81b3e99-e02a-43ae-94fa-165bac55700a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:03:28 user nova-compute[74247]: DEBUG nova.compute.manager [req-9b31310c-5bab-4520-bda8-4da1d5e810f6 req-ac8c833a-6827-4035-8d11-997886c35534 service nova] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] No waiting events found dispatching network-vif-plugged-8f93697e-d06a-44eb-b63a-b7433c52adb9 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:03:28 user nova-compute[74247]: WARNING nova.compute.manager [req-9b31310c-5bab-4520-bda8-4da1d5e810f6 req-ac8c833a-6827-4035-8d11-997886c35534 service nova] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Received unexpected event network-vif-plugged-8f93697e-d06a-44eb-b63a-b7433c52adb9 for instance with vm_state building and task_state spawning.
Oct 16 19:03:28 user nova-compute[74247]: INFO nova.compute.manager [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Took 21.95 seconds to build instance.
Oct 16 19:03:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-85fbe285-2ef0-4139-9765-dff4d5fb92fc tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "c81b3e99-e02a-43ae-94fa-165bac55700a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.050s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:03:28 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:03:28 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 19:03:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "refresh_cache-68edbfa7-0752-42fb-bad8-eb7121796e9f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:03:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquired lock "refresh_cache-68edbfa7-0752-42fb-bad8-eb7121796e9f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:03:28 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Forcefully refreshing network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 19:03:29 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Updating instance_info_cache with network_info: [{"id": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "address": "fa:16:3e:ae:24:ed", "network": {"id": "5801391d-4968-4504-9f23-8683eeb63a54", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2082110052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cb6a3c6bdd484d9a8d0c27bf1ac2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e4186ff-26", "ovs_interfaceid": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:03:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Releasing lock "refresh_cache-68edbfa7-0752-42fb-bad8-eb7121796e9f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:03:29 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Updated the network info_cache for instance {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 19:03:29 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:03:29 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:03:30 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:03:33 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:03:33 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:03:33 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 19:03:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:03:38 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:03:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:03:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:03:44 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:03:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:03:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:03:52 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:03:54 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:03:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:03:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:04:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:04:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:04:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:04:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:04:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:04:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:04:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:04:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:04:14 user nova-compute[74247]: DEBUG nova.compute.manager [req-2dc5841e-df67-4d35-ac7c-9db49da3bf6d req-6c447d2c-9d4b-47cd-903a-0097f4ce231c service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Received event network-changed-f9d88799-cade-4fd4-a9d3-d2ac928f20c7 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:04:14 user nova-compute[74247]: DEBUG nova.compute.manager [req-2dc5841e-df67-4d35-ac7c-9db49da3bf6d req-6c447d2c-9d4b-47cd-903a-0097f4ce231c service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Refreshing instance network info cache due to event network-changed-f9d88799-cade-4fd4-a9d3-d2ac928f20c7. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 19:04:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-2dc5841e-df67-4d35-ac7c-9db49da3bf6d req-6c447d2c-9d4b-47cd-903a-0097f4ce231c service nova] Acquiring lock "refresh_cache-7f04ea2b-a029-44d9-ac7a-ea2b870d20eb" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:04:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-2dc5841e-df67-4d35-ac7c-9db49da3bf6d req-6c447d2c-9d4b-47cd-903a-0097f4ce231c service nova] Acquired lock "refresh_cache-7f04ea2b-a029-44d9-ac7a-ea2b870d20eb" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:04:14 user nova-compute[74247]: DEBUG nova.network.neutron [req-2dc5841e-df67-4d35-ac7c-9db49da3bf6d req-6c447d2c-9d4b-47cd-903a-0097f4ce231c service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Refreshing network info cache for port f9d88799-cade-4fd4-a9d3-d2ac928f20c7 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 19:04:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Acquiring lock "68edbfa7-0752-42fb-bad8-eb7121796e9f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:04:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "68edbfa7-0752-42fb-bad8-eb7121796e9f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:04:14 user nova-compute[74247]: DEBUG nova.objects.instance [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lazy-loading 'flavor' on Instance uuid 68edbfa7-0752-42fb-bad8-eb7121796e9f {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:04:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Acquiring lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:04:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:04:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Acquiring lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:04:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:04:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:04:14 user nova-compute[74247]: INFO nova.compute.manager [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Terminating instance
Oct 16 19:04:14 user nova-compute[74247]: DEBUG nova.compute.manager [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 19:04:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "68edbfa7-0752-42fb-bad8-eb7121796e9f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:04:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:04:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:04:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:04:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:04:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:04:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Acquiring lock "68edbfa7-0752-42fb-bad8-eb7121796e9f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:04:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "68edbfa7-0752-42fb-bad8-eb7121796e9f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:04:14 user nova-compute[74247]: INFO nova.compute.manager [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Attaching volume cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 to /dev/vdb
Oct 16 19:04:14 user nova-compute[74247]: DEBUG os_brick.utils [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 19:04:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:14 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6dac454-4692-4f8b-872a-6e54c19d2eb2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:14 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG nova.compute.manager [req-96ad0055-8068-44a7-9d36-bc6fc356c1af req-2bb67eed-8cd7-424d-90b7-3672579caf14 service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Received event network-vif-unplugged-f9d88799-cade-4fd4-a9d3-d2ac928f20c7 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-96ad0055-8068-44a7-9d36-bc6fc356c1af req-2bb67eed-8cd7-424d-90b7-3672579caf14 service nova] Acquiring lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-96ad0055-8068-44a7-9d36-bc6fc356c1af req-2bb67eed-8cd7-424d-90b7-3672579caf14 service nova] Lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-96ad0055-8068-44a7-9d36-bc6fc356c1af req-2bb67eed-8cd7-424d-90b7-3672579caf14 service nova] Lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG nova.compute.manager [req-96ad0055-8068-44a7-9d36-bc6fc356c1af req-2bb67eed-8cd7-424d-90b7-3672579caf14 service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] No waiting events found dispatching network-vif-unplugged-f9d88799-cade-4fd4-a9d3-d2ac928f20c7 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG nova.compute.manager [req-96ad0055-8068-44a7-9d36-bc6fc356c1af req-2bb67eed-8cd7-424d-90b7-3672579caf14 service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Received event network-vif-unplugged-f9d88799-cade-4fd4-a9d3-d2ac928f20c7 for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37a1821-2e23-4f64-8ace-c332a58c78af]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26fcc72-2334-4947-a92a-fd7ff99432c3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[debe7eaf-1153-4e37-b002-6e319a708011]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG nova.network.neutron [req-2dc5841e-df67-4d35-ac7c-9db49da3bf6d req-6c447d2c-9d4b-47cd-903a-0097f4ce231c service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Updated VIF entry in instance network info cache for port f9d88799-cade-4fd4-a9d3-d2ac928f20c7. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG nova.network.neutron [req-2dc5841e-df67-4d35-ac7c-9db49da3bf6d req-6c447d2c-9d4b-47cd-903a-0097f4ce231c service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Updating instance_info_cache with network_info: [{"id": "f9d88799-cade-4fd4-a9d3-d2ac928f20c7", "address": "fa:16:3e:75:c0:0d", "network": {"id": "17f634c2-25e8-4655-8439-6a5e5d9c7e77", "bridge": "br-int", "label": "tempest-TestShelveInstance-161802280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863980f09120465ebbfb273efa0f07df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9d88799-ca", "ovs_interfaceid": "f9d88799-cade-4fd4-a9d3-d2ac928f20c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-2dc5841e-df67-4d35-ac7c-9db49da3bf6d req-6c447d2c-9d4b-47cd-903a-0097f4ce231c service nova] Releasing lock "refresh_cache-7f04ea2b-a029-44d9-ac7a-ea2b870d20eb" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 19:04:15 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e175353f-65ac-45c9-9982-c600b346bfeb]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG os_brick.utils [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Updating existing volume attachment record: 9156d33d-07e0-4e98-ba93-e406b71b3865 {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 19:04:15 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Instance destroyed successfully.
Oct 16 19:04:15 user nova-compute[74247]: DEBUG nova.objects.instance [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Lazy-loading 'resources' on Instance uuid 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T18:58:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-245644659',display_name='tempest-TestShelveInstance-server-245644659',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-245644659',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/wf3BAEOMqughkEq4Tr/5OFR/Et8qfg2eC6E01VThl/SE94s5bUkzrQ94y/QPhbXlS9dcM60h3HYQrp5CekWdEAALbss9fke59qoj5EpsJOSElLn9HSV7oXrxf0+PLHQ==',key_name='tempest-TestShelveInstance-1763650089',keypairs=<?>,launch_index=0,launched_at=2023-10-16T19:02:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='863980f09120465ebbfb273efa0f07df',ramdisk_id='',reservation_id='r-sduxnmst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-565913270',owner_user_name='tempest-TestShelveInstance-565913270-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T19:02:47Z,user_data=None,user_id='b18bdb21bba141089a9de12a98b7d976',uuid=7f04ea2b-a029-44d9-ac7a-ea2b870d20eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9d88799-cade-4fd4-a9d3-d2ac928f20c7", "address": "fa:16:3e:75:c0:0d", "network": {"id": "17f634c2-25e8-4655-8439-6a5e5d9c7e77", "bridge": "br-int", "label": "tempest-TestShelveInstance-161802280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863980f09120465ebbfb273efa0f07df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9d88799-ca", "ovs_interfaceid": "f9d88799-cade-4fd4-a9d3-d2ac928f20c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Converting VIF {"id": "f9d88799-cade-4fd4-a9d3-d2ac928f20c7", "address": "fa:16:3e:75:c0:0d", "network": {"id": "17f634c2-25e8-4655-8439-6a5e5d9c7e77", "bridge": "br-int", "label": "tempest-TestShelveInstance-161802280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863980f09120465ebbfb273efa0f07df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9d88799-ca", "ovs_interfaceid": "f9d88799-cade-4fd4-a9d3-d2ac928f20c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:c0:0d,bridge_name='br-int',has_traffic_filtering=True,id=f9d88799-cade-4fd4-a9d3-d2ac928f20c7,network=Network(17f634c2-25e8-4655-8439-6a5e5d9c7e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9d88799-ca') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG os_vif [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:c0:0d,bridge_name='br-int',has_traffic_filtering=True,id=f9d88799-cade-4fd4-a9d3-d2ac928f20c7,network=Network(17f634c2-25e8-4655-8439-6a5e5d9c7e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9d88799-ca') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9d88799-ca, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6d4a9ab3-07bd-4d9f-85b7-a758b0b50151) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:04:15 user nova-compute[74247]: INFO os_vif [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:c0:0d,bridge_name='br-int',has_traffic_filtering=True,id=f9d88799-cade-4fd4-a9d3-d2ac928f20c7,network=Network(17f634c2-25e8-4655-8439-6a5e5d9c7e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9d88799-ca')
Oct 16 19:04:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cLCfxgKw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 19:04:15 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 19:04:15 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff45054f-ebd1-4108-9693-c3fe02a7476f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 19:04:15 user nova-compute[74247]: No targets found.
Oct 16 19:04:15 user nova-compute[74247]: iSNS:
Oct 16 19:04:15 user nova-compute[74247]: No targets found.
Oct 16 19:04:15 user nova-compute[74247]: STATIC:
Oct 16 19:04:15 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d
Oct 16 19:04:15 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 19:04:15 user nova-compute[74247]:                 Iface Name: default
Oct 16 19:04:15 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec
Oct 16 19:04:15 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 19:04:15 user nova-compute[74247]:                 Iface Name: default
Oct 16 19:04:15 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c
Oct 16 19:04:15 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 19:04:15 user nova-compute[74247]:                 Iface Name: default
Oct 16 19:04:15 user nova-compute[74247]: FIRMWARE:
Oct 16 19:04:15 user nova-compute[74247]: No targets found.
Oct 16 19:04:15 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 19:04:15 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 19:04:15 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6ed2ac-5b6a-4704-98da-0bdcc54a0ef1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7246b5d7-ef55-4357-bfce-e694a9696cbe]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)
Oct 16 19:04:15 user nova-compute[74247]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d (non-flash)
Oct 16 19:04:15 user nova-compute[74247]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c (non-flash)
Oct 16 19:04:15 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)
Oct 16 19:04:15 user nova-compute[74247]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d (non-flash)
Oct 16 19:04:15 user nova-compute[74247]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c (non-flash)
Oct 16 19:04:15 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe0683d2c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d'): ({'sdc'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Removing single pathed devices sdc {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[729fb4aa-fdc0-44d4-9a64-45575cc23f93]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3d6b80-babb-4ea5-b1c5-8bac326f2be5]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Flushing IO for device /dev/sdc {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5a930e-fb82-4174-bfa6-815bcfb2b1a9]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a22b9d-3b6e-4f68-b2c1-e225dda1687f]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] SCSI volumes sdc have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23264336230653133', '/dev/disk/by-id/scsi-1SCST_BIOc1926a1b-2d3b0e136d79f234', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_c1926a1b') {{(pid=85128) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 16 19:04:15 user nova-compute[74247]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23264336230653133
Oct 16 19:04:15 user nova-compute[74247]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOc1926a1b-2d3b0e136d79f234
Oct 16 19:04:15 user nova-compute[74247]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_c1926a1b
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[44bfe343-dc13-49c9-a20e-66bb1baea6d7]: (4, None) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9265c5-c424-4d68-a23d-204ee8f160c8]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5178408b-eccb-4bd5-96cb-c3915bad154b]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d, portal: 172.16.0.220,3260]
Oct 16 19:04:15 user nova-compute[74247]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d, portal: 172.16.0.220,3260] successful.
Oct 16 19:04:15 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b868c3-025d-42f9-93ff-08ed5f726a0c]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] <== disconnect_volume: return (322ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 19:04:15 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Deleting instance files /opt/stack/data/nova/instances/7f04ea2b-a029-44d9-ac7a-ea2b870d20eb_del
Oct 16 19:04:15 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Deletion of /opt/stack/data/nova/instances/7f04ea2b-a029-44d9-ac7a-ea2b870d20eb_del complete
Oct 16 19:04:15 user nova-compute[74247]: INFO nova.compute.manager [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Took 1.19 seconds to destroy the instance on the hypervisor.
Oct 16 19:04:15 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 19:04:15 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 19:04:16 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:04:16 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Took 0.49 seconds to deallocate network for instance.
Oct 16 19:04:16 user nova-compute[74247]: DEBUG nova.compute.manager [req-6de42a9d-9718-4172-a8d6-8f2f3091830c req-6f155319-d549-44b8-bc82-300631c0a781 service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Received event network-vif-deleted-f9d88799-cade-4fd4-a9d3-d2ac928f20c7 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:04:17 user nova-compute[74247]: DEBUG nova.compute.manager [req-d655d0c6-443c-4e88-ac1f-79226eec484e req-6bd6a877-05cd-43ec-b41b-4afef12b342b service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Received event network-vif-plugged-f9d88799-cade-4fd4-a9d3-d2ac928f20c7 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:04:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d655d0c6-443c-4e88-ac1f-79226eec484e req-6bd6a877-05cd-43ec-b41b-4afef12b342b service nova] Acquiring lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:04:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d655d0c6-443c-4e88-ac1f-79226eec484e req-6bd6a877-05cd-43ec-b41b-4afef12b342b service nova] Lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:04:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d655d0c6-443c-4e88-ac1f-79226eec484e req-6bd6a877-05cd-43ec-b41b-4afef12b342b service nova] Lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:04:17 user nova-compute[74247]: DEBUG nova.compute.manager [req-d655d0c6-443c-4e88-ac1f-79226eec484e req-6bd6a877-05cd-43ec-b41b-4afef12b342b service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] No waiting events found dispatching network-vif-plugged-f9d88799-cade-4fd4-a9d3-d2ac928f20c7 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:04:17 user nova-compute[74247]: WARNING nova.compute.manager [req-d655d0c6-443c-4e88-ac1f-79226eec484e req-6bd6a877-05cd-43ec-b41b-4afef12b342b service nova] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Received unexpected event network-vif-plugged-f9d88799-cade-4fd4-a9d3-d2ac928f20c7 for instance with vm_state active and task_state deleting.
Oct 16 19:04:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:04:17 user nova-compute[74247]: INFO nova.compute.manager [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Took 0.79 seconds to detach 1 volumes for instance.
Oct 16 19:04:17 user nova-compute[74247]: DEBUG nova.compute.manager [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] [instance: 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb] Deleting volume: 35c2a4e7-eed8-4c2b-a71b-d3a68f5e006d {{(pid=74247) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 16 19:04:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:04:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:04:17 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 19:04:17 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 19:04:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:04:17 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Deleted allocations for instance 7f04ea2b-a029-44d9-ac7a-ea2b870d20eb
Oct 16 19:04:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-167c7776-3e99-4d46-a3b4-a72b61b1cb11 tempest-TestShelveInstance-565913270 tempest-TestShelveInstance-565913270-project-member] Lock "7f04ea2b-a029-44d9-ac7a-ea2b870d20eb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.916s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:04:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:04:20 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:04:22 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:04:23 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:04:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:04:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:04:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:04:23 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 19:04:23 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 19:04:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:23 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 19:04:24 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:04:24 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:04:24 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=8645MB free_disk=24.907360076904297GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 19:04:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:04:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:04:24 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance e506e951-e694-40bc-a91a-800ac91e658e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 19:04:24 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 68edbfa7-0752-42fb-bad8-eb7121796e9f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 19:04:24 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance c81b3e99-e02a-43ae-94fa-165bac55700a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 19:04:24 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 19:04:24 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 19:04:24 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 19:04:24 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 19:04:24 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 19:04:24 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.291s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:04:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:04:26 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:04:28 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:04:28 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 19:04:28 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Rebuilding the list of instances to heal {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 19:04:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "refresh_cache-e506e951-e694-40bc-a91a-800ac91e658e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:04:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquired lock "refresh_cache-e506e951-e694-40bc-a91a-800ac91e658e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:04:28 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Forcefully refreshing network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 19:04:28 user nova-compute[74247]: DEBUG nova.objects.instance [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lazy-loading 'info_cache' on Instance uuid e506e951-e694-40bc-a91a-800ac91e658e {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:04:29 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Updating instance_info_cache with network_info: [{"id": "8a8fd51e-d098-4a89-80cd-eed88d8920a5", "address": "fa:16:3e:74:ff:9b", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a8fd51e-d0", "ovs_interfaceid": "8a8fd51e-d098-4a89-80cd-eed88d8920a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:04:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Releasing lock "refresh_cache-e506e951-e694-40bc-a91a-800ac91e658e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:04:29 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Updated the network info_cache for instance {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 19:04:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:04:30 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:04:30 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FBWoyVtI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 19:04:31 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 19:04:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 19:04:31 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 19:04:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 19:04:31 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 19:04:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[61994adf-554a-4dac-8cd4-d7037477f56e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 19:04:31 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbcc5b7-99a5-4163-945a-ebe36473d78c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317] added
Oct 16 19:04:31 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8275d78d-3b0f-4bb5-aa25-58b7f6dd085d]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c49885-32a8-4a5b-a746-bf4dcccc0c93]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FBWoyVtI {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FBWoyVtI" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e110ad-9b4f-442d-b62b-6aea84006fbc]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FBWoyVtI'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d38c86a-11ad-43bd-a18c-0b529f12d629]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b636ce2-c6c0-4bde-b5bd-27ed79484040]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)
Oct 16 19:04:31 user nova-compute[74247]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c (non-flash)
Oct 16 19:04:31 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)
Oct 16 19:04:31 user nova-compute[74247]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c (non-flash)
Oct 16 19:04:31 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c519925e-c695-4cca-b0d6-c7425f832d79]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317, portal: 172.16.0.220,3260]
Oct 16 19:04:31 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317, portal: 172.16.0.220,3260] successful.
Oct 16 19:04:31 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7c72c8-3ac3-4bc5-a868-7b86dfc3ad69]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[57144884-8915-4f10-b213-b91b33198591]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)
Oct 16 19:04:31 user nova-compute[74247]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c (non-flash)
Oct 16 19:04:31 user nova-compute[74247]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 (non-flash)
Oct 16 19:04:31 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)
Oct 16 19:04:31 user nova-compute[74247]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c (non-flash)
Oct 16 19:04:31 user nova-compute[74247]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 (non-flash)
Oct 16 19:04:31 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6b1ed6-6dac-4cac-a6de-a4c8c3045e24]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 19:04:31 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FBWoyVtI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 19:04:32 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 19:04:32 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23730666434303261', 'path': '/dev/sdc'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 19:04:32 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730666434303261', 'path': '/dev/sdc'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 19:04:32 user nova-compute[74247]: DEBUG nova.objects.instance [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lazy-loading 'flavor' on Instance uuid 68edbfa7-0752-42fb-bad8-eb7121796e9f {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:04:32 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 19:04:32 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 19:04:32 user nova-compute[74247]:   <source dev="/dev/sdc"/>
Oct 16 19:04:32 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 19:04:32 user nova-compute[74247]:   <serial>cfc1e0e6-3cb8-4c38-a36c-7636f3e35317</serial>
Oct 16 19:04:32 user nova-compute[74247]: </disk>
Oct 16 19:04:32 user nova-compute[74247]:  {{(pid=74247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 19:04:33 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 19:04:33 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 19:04:33 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] No VIF found with MAC fa:16:3e:ae:24:ed, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 19:04:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-ccc1f1cf-7b56-420a-b074-53ff3f373018 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "68edbfa7-0752-42fb-bad8-eb7121796e9f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.578s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:04:33 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:04:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:04:35 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:04:35 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 19:04:40 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:04:40 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:04:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:04:46 user nova-compute[74247]: DEBUG nova.compute.manager [req-26009130-2c5a-49cc-a668-a1de024398ff req-237c75d3-5108-4ead-a505-b1757a39e493 service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Received event network-changed-1e4186ff-26a0-43b8-8b0a-2f62eb718451 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:04:46 user nova-compute[74247]: DEBUG nova.compute.manager [req-26009130-2c5a-49cc-a668-a1de024398ff req-237c75d3-5108-4ead-a505-b1757a39e493 service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Refreshing instance network info cache due to event network-changed-1e4186ff-26a0-43b8-8b0a-2f62eb718451. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 19:04:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-26009130-2c5a-49cc-a668-a1de024398ff req-237c75d3-5108-4ead-a505-b1757a39e493 service nova] Acquiring lock "refresh_cache-68edbfa7-0752-42fb-bad8-eb7121796e9f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:04:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-26009130-2c5a-49cc-a668-a1de024398ff req-237c75d3-5108-4ead-a505-b1757a39e493 service nova] Acquired lock "refresh_cache-68edbfa7-0752-42fb-bad8-eb7121796e9f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:04:46 user nova-compute[74247]: DEBUG nova.network.neutron [req-26009130-2c5a-49cc-a668-a1de024398ff req-237c75d3-5108-4ead-a505-b1757a39e493 service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Refreshing network info cache for port 1e4186ff-26a0-43b8-8b0a-2f62eb718451 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 19:04:46 user nova-compute[74247]: DEBUG nova.network.neutron [req-26009130-2c5a-49cc-a668-a1de024398ff req-237c75d3-5108-4ead-a505-b1757a39e493 service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Updated VIF entry in instance network info cache for port 1e4186ff-26a0-43b8-8b0a-2f62eb718451. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 19:04:46 user nova-compute[74247]: DEBUG nova.network.neutron [req-26009130-2c5a-49cc-a668-a1de024398ff req-237c75d3-5108-4ead-a505-b1757a39e493 service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Updating instance_info_cache with network_info: [{"id": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "address": "fa:16:3e:ae:24:ed", "network": {"id": "5801391d-4968-4504-9f23-8683eeb63a54", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2082110052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cb6a3c6bdd484d9a8d0c27bf1ac2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e4186ff-26", "ovs_interfaceid": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:04:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-26009130-2c5a-49cc-a668-a1de024398ff req-237c75d3-5108-4ead-a505-b1757a39e493 service nova] Releasing lock "refresh_cache-68edbfa7-0752-42fb-bad8-eb7121796e9f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:04:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:04:48 user nova-compute[74247]: DEBUG nova.compute.manager [req-4acc3e9f-34ab-419e-859a-5d42ba162df0 req-f108ae21-9d43-45f1-9f01-9b464ae318b0 service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Received event network-changed-1e4186ff-26a0-43b8-8b0a-2f62eb718451 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:04:48 user nova-compute[74247]: DEBUG nova.compute.manager [req-4acc3e9f-34ab-419e-859a-5d42ba162df0 req-f108ae21-9d43-45f1-9f01-9b464ae318b0 service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Refreshing instance network info cache due to event network-changed-1e4186ff-26a0-43b8-8b0a-2f62eb718451. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 19:04:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4acc3e9f-34ab-419e-859a-5d42ba162df0 req-f108ae21-9d43-45f1-9f01-9b464ae318b0 service nova] Acquiring lock "refresh_cache-68edbfa7-0752-42fb-bad8-eb7121796e9f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:04:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4acc3e9f-34ab-419e-859a-5d42ba162df0 req-f108ae21-9d43-45f1-9f01-9b464ae318b0 service nova] Acquired lock "refresh_cache-68edbfa7-0752-42fb-bad8-eb7121796e9f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:04:48 user nova-compute[74247]: DEBUG nova.network.neutron [req-4acc3e9f-34ab-419e-859a-5d42ba162df0 req-f108ae21-9d43-45f1-9f01-9b464ae318b0 service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Refreshing network info cache for port 1e4186ff-26a0-43b8-8b0a-2f62eb718451 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 19:04:48 user nova-compute[74247]: DEBUG nova.network.neutron [req-4acc3e9f-34ab-419e-859a-5d42ba162df0 req-f108ae21-9d43-45f1-9f01-9b464ae318b0 service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Updated VIF entry in instance network info cache for port 1e4186ff-26a0-43b8-8b0a-2f62eb718451. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 19:04:48 user nova-compute[74247]: DEBUG nova.network.neutron [req-4acc3e9f-34ab-419e-859a-5d42ba162df0 req-f108ae21-9d43-45f1-9f01-9b464ae318b0 service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Updating instance_info_cache with network_info: [{"id": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "address": "fa:16:3e:ae:24:ed", "network": {"id": "5801391d-4968-4504-9f23-8683eeb63a54", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2082110052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cb6a3c6bdd484d9a8d0c27bf1ac2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e4186ff-26", "ovs_interfaceid": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:04:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-4acc3e9f-34ab-419e-859a-5d42ba162df0 req-f108ae21-9d43-45f1-9f01-9b464ae318b0 service nova] Releasing lock "refresh_cache-68edbfa7-0752-42fb-bad8-eb7121796e9f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:04:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:04:52 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:04:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:04:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:04:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Acquiring lock "68edbfa7-0752-42fb-bad8-eb7121796e9f" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:04:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "68edbfa7-0752-42fb-bad8-eb7121796e9f" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:04:57 user nova-compute[74247]: INFO nova.compute.manager [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Rebooting instance
Oct 16 19:04:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Acquiring lock "refresh_cache-68edbfa7-0752-42fb-bad8-eb7121796e9f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:04:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Acquired lock "refresh_cache-68edbfa7-0752-42fb-bad8-eb7121796e9f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:04:57 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 19:04:57 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Updating instance_info_cache with network_info: [{"id": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "address": "fa:16:3e:ae:24:ed", "network": {"id": "5801391d-4968-4504-9f23-8683eeb63a54", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2082110052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cb6a3c6bdd484d9a8d0c27bf1ac2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e4186ff-26", "ovs_interfaceid": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:04:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Releasing lock "refresh_cache-68edbfa7-0752-42fb-bad8-eb7121796e9f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:04:57 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG nova.compute.manager [req-f5fd481d-dab9-43b2-8983-69eb6fc4ef3e req-72c9b606-cc91-4a02-9614-34a41ab425e2 service nova] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Received event network-changed-8f93697e-d06a-44eb-b63a-b7433c52adb9 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG nova.compute.manager [req-f5fd481d-dab9-43b2-8983-69eb6fc4ef3e req-72c9b606-cc91-4a02-9614-34a41ab425e2 service nova] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Refreshing instance network info cache due to event network-changed-8f93697e-d06a-44eb-b63a-b7433c52adb9. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f5fd481d-dab9-43b2-8983-69eb6fc4ef3e req-72c9b606-cc91-4a02-9614-34a41ab425e2 service nova] Acquiring lock "refresh_cache-c81b3e99-e02a-43ae-94fa-165bac55700a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f5fd481d-dab9-43b2-8983-69eb6fc4ef3e req-72c9b606-cc91-4a02-9614-34a41ab425e2 service nova] Acquired lock "refresh_cache-c81b3e99-e02a-43ae-94fa-165bac55700a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG nova.network.neutron [req-f5fd481d-dab9-43b2-8983-69eb6fc4ef3e req-72c9b606-cc91-4a02-9614-34a41ab425e2 service nova] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Refreshing network info cache for port 8f93697e-d06a-44eb-b63a-b7433c52adb9 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG nova.network.neutron [req-f5fd481d-dab9-43b2-8983-69eb6fc4ef3e req-72c9b606-cc91-4a02-9614-34a41ab425e2 service nova] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Updated VIF entry in instance network info cache for port 8f93697e-d06a-44eb-b63a-b7433c52adb9. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG nova.network.neutron [req-f5fd481d-dab9-43b2-8983-69eb6fc4ef3e req-72c9b606-cc91-4a02-9614-34a41ab425e2 service nova] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Updating instance_info_cache with network_info: [{"id": "8f93697e-d06a-44eb-b63a-b7433c52adb9", "address": "fa:16:3e:67:33:5c", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f93697e-d0", "ovs_interfaceid": "8f93697e-d06a-44eb-b63a-b7433c52adb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f5fd481d-dab9-43b2-8983-69eb6fc4ef3e req-72c9b606-cc91-4a02-9614-34a41ab425e2 service nova] Releasing lock "refresh_cache-c81b3e99-e02a-43ae-94fa-165bac55700a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:04:58 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Instance destroyed successfully.
Oct 16 19:04:58 user nova-compute[74247]: DEBUG nova.objects.instance [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lazy-loading 'resources' on Instance uuid 68edbfa7-0752-42fb-bad8-eb7121796e9f {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T19:02:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1906922734',display_name='tempest-TestMinimumBasicScenario-server-1906922734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1906922734',id=47,image_ref='46d6f108-3b2e-41c3-8694-65606e2769ee',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1caxevCdksN3AlmBdVwZfiOOScHN4VaKza+143cbh60V4VUdpuh75jnICCBVrEWNOsZzHUyPA9sdF/wl46FD7/FpfokUQQw4OLB6uN6SSD+v6cZrKs558k5Gsx5iCxEQ==',key_name='tempest-TestMinimumBasicScenario-344900198',keypairs=<?>,launch_index=0,launched_at=2023-10-16T19:02:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42cb6a3c6bdd484d9a8d0c27bf1ac2fb',ramdisk_id='',reservation_id='r-47ytcjou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='46d6f108-3b2e-41c3-8694-65606e2769ee',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-218992455',owner_user_name='tempest-TestMinimumBasicScenario-218992455-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T19:04:58Z,user_data=None,user_id='7414f773f7a94a13938c406bf02b3bac',uuid=68edbfa7-0752-42fb-bad8-eb7121796e9f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "address": "fa:16:3e:ae:24:ed", "network": {"id": "5801391d-4968-4504-9f23-8683eeb63a54", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2082110052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cb6a3c6bdd484d9a8d0c27bf1ac2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e4186ff-26", "ovs_interfaceid": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Converting VIF {"id": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "address": "fa:16:3e:ae:24:ed", "network": {"id": "5801391d-4968-4504-9f23-8683eeb63a54", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2082110052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cb6a3c6bdd484d9a8d0c27bf1ac2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e4186ff-26", "ovs_interfaceid": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:24:ed,bridge_name='br-int',has_traffic_filtering=True,id=1e4186ff-26a0-43b8-8b0a-2f62eb718451,network=Network(5801391d-4968-4504-9f23-8683eeb63a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e4186ff-26') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG os_vif [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:24:ed,bridge_name='br-int',has_traffic_filtering=True,id=1e4186ff-26a0-43b8-8b0a-2f62eb718451,network=Network(5801391d-4968-4504-9f23-8683eeb63a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e4186ff-26') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e4186ff-26, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=430c7678-f16a-4600-9733-95695982fc00) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:04:58 user nova-compute[74247]: INFO os_vif [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:24:ed,bridge_name='br-int',has_traffic_filtering=True,id=1e4186ff-26a0-43b8-8b0a-2f62eb718451,network=Network(5801391d-4968-4504-9f23-8683eeb63a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e4186ff-26')
Oct 16 19:04:58 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FBWoyVtI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 19:04:58 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 19:04:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4b63df-b01d-47a7-8878-88493c8475ab]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 19:04:58 user nova-compute[74247]: No targets found.
Oct 16 19:04:58 user nova-compute[74247]: iSNS:
Oct 16 19:04:58 user nova-compute[74247]: No targets found.
Oct 16 19:04:58 user nova-compute[74247]: STATIC:
Oct 16 19:04:58 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec
Oct 16 19:04:58 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 19:04:58 user nova-compute[74247]:                 Iface Name: default
Oct 16 19:04:58 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c
Oct 16 19:04:58 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 19:04:58 user nova-compute[74247]:                 Iface Name: default
Oct 16 19:04:58 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317
Oct 16 19:04:58 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 19:04:58 user nova-compute[74247]:                 Iface Name: default
Oct 16 19:04:58 user nova-compute[74247]: FIRMWARE:
Oct 16 19:04:58 user nova-compute[74247]: No targets found.
Oct 16 19:04:58 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 19:04:58 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 19:04:58 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[46023dcc-1ee2-4f6e-ae3c-4ff487ff14b1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b688b236-102d-436f-bae2-272b04db8faf]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)
Oct 16 19:04:58 user nova-compute[74247]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c (non-flash)
Oct 16 19:04:58 user nova-compute[74247]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 (non-flash)
Oct 16 19:04:58 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)
Oct 16 19:04:58 user nova-compute[74247]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c (non-flash)
Oct 16 19:04:58 user nova-compute[74247]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 (non-flash)
Oct 16 19:04:58 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe0684e9ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317'): ({'sdc'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Removing single pathed devices sdc {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9465ac9-c5bf-4b3d-8e9d-b044acf80c46]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c88d34-c8a6-4c16-8f12-aaf7408b1c6b]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Flushing IO for device /dev/sdc {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 19:04:58 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf4fd6b-fad4-41c3-8cee-8dac87129bba]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fedd0e-6b0b-41e6-ae2f-a54e54e5d6ba]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] SCSI volumes sdc have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[168bc58c-92ee-48e0-bafa-0aaa72f19dc7]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG nova.compute.manager [req-9a5d135e-48c4-43ee-bfa4-fcf3308fb48e req-46a5f082-1249-498c-a50c-b59f76d63e91 service nova] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Received event network-changed-8f93697e-d06a-44eb-b63a-b7433c52adb9 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG nova.compute.manager [req-9a5d135e-48c4-43ee-bfa4-fcf3308fb48e req-46a5f082-1249-498c-a50c-b59f76d63e91 service nova] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Refreshing instance network info cache due to event network-changed-8f93697e-d06a-44eb-b63a-b7433c52adb9. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9a5d135e-48c4-43ee-bfa4-fcf3308fb48e req-46a5f082-1249-498c-a50c-b59f76d63e91 service nova] Acquiring lock "refresh_cache-c81b3e99-e02a-43ae-94fa-165bac55700a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9a5d135e-48c4-43ee-bfa4-fcf3308fb48e req-46a5f082-1249-498c-a50c-b59f76d63e91 service nova] Acquired lock "refresh_cache-c81b3e99-e02a-43ae-94fa-165bac55700a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG nova.network.neutron [req-9a5d135e-48c4-43ee-bfa4-fcf3308fb48e req-46a5f082-1249-498c-a50c-b59f76d63e91 service nova] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Refreshing network info cache for port 8f93697e-d06a-44eb-b63a-b7433c52adb9 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bc27b3-aa15-4911-8b3c-74d084d05433]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317, portal: 172.16.0.220,3260]
Oct 16 19:04:59 user nova-compute[74247]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317, portal: 172.16.0.220,3260] successful.
Oct 16 19:04:59 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94e502b-f97b-4883-8f75-b2bbbc3b4f17]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] <== disconnect_volume: return (312ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Start _get_guest_xml network_info=[{"id": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "address": "fa:16:3e:ae:24:ed", "network": {"id": "5801391d-4968-4504-9f23-8683eeb63a54", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2082110052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cb6a3c6bdd484d9a8d0c27bf1ac2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e4186ff-26", "ovs_interfaceid": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=46d6f108-3b2e-41c3-8694-65606e2769ee,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': '46d6f108-3b2e-41c3-8694-65606e2769ee'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FBWoyVtI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '68edbfa7-0752-42fb-bad8-eb7121796e9f', 'attached_at': '', 'detached_at': '', 'volume_id': 'cfc1e0e6-3cb8-4c38-a36c-7636f3e35317', 'serial': 'cfc1e0e6-3cb8-4c38-a36c-7636f3e35317'}, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '9156d33d-07e0-4e98-ba93-e406b71b3865', 'guest_format': None, 'volume_type': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "c81b3e99-e02a-43ae-94fa-165bac55700a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "c81b3e99-e02a-43ae-94fa-165bac55700a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "c81b3e99-e02a-43ae-94fa-165bac55700a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "c81b3e99-e02a-43ae-94fa-165bac55700a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "c81b3e99-e02a-43ae-94fa-165bac55700a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:04:59 user nova-compute[74247]: INFO nova.compute.manager [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Terminating instance
Oct 16 19:04:59 user nova-compute[74247]: DEBUG nova.compute.manager [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 19:04:59 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:04:59 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:04:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=46d6f108-3b2e-41c3-8694-65606e2769ee,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG nova.objects.instance [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lazy-loading 'vcpu_model' on Instance uuid 68edbfa7-0752-42fb-bad8-eb7121796e9f {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG nova.objects.base [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Object Instance<68edbfa7-0752-42fb-bad8-eb7121796e9f> lazy-loaded attributes: resources,vcpu_model {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FBWoyVtI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 19:04:59 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 19:04:59 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 19:04:59 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 19:04:59 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 19:04:59 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 19:04:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c23e51d-45db-475a-b48b-c92370a7748f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 19:04:59 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d3531f-ca1b-42e5-b8a2-cf6c5a273d0c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317] added
Oct 16 19:04:59 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9698ad84-fe48-45c0-bcd6-5a4fd943ee6f]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[15206dd8-a4ad-4b2e-aeb5-0814430a3553]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FBWoyVtI {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FBWoyVtI" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6cb29a8-179a-4b3b-9042-0ec58301bc62]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FBWoyVtI'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a461c6ef-c75d-4a1a-9082-776ed830eb53]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[26055b8d-b283-4201-8fdb-31d8c0805b5a]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)
Oct 16 19:04:59 user nova-compute[74247]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c (non-flash)
Oct 16 19:04:59 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)
Oct 16 19:04:59 user nova-compute[74247]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c (non-flash)
Oct 16 19:04:59 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG nova.network.neutron [req-9a5d135e-48c4-43ee-bfa4-fcf3308fb48e req-46a5f082-1249-498c-a50c-b59f76d63e91 service nova] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Updated VIF entry in instance network info cache for port 8f93697e-d06a-44eb-b63a-b7433c52adb9. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG nova.network.neutron [req-9a5d135e-48c4-43ee-bfa4-fcf3308fb48e req-46a5f082-1249-498c-a50c-b59f76d63e91 service nova] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Updating instance_info_cache with network_info: [{"id": "8f93697e-d06a-44eb-b63a-b7433c52adb9", "address": "fa:16:3e:67:33:5c", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f93697e-d0", "ovs_interfaceid": "8f93697e-d06a-44eb-b63a-b7433c52adb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d96068-f47a-4fe7-8409-daf11413c500]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317, portal: 172.16.0.220,3260]
Oct 16 19:04:59 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317, portal: 172.16.0.220,3260] successful.
Oct 16 19:04:59 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9a5d135e-48c4-43ee-bfa4-fcf3308fb48e req-46a5f082-1249-498c-a50c-b59f76d63e91 service nova] Releasing lock "refresh_cache-c81b3e99-e02a-43ae-94fa-165bac55700a" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3b6289-347e-439c-9e48-0ac9e1002742]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[962a6125-3cb6-4224-890b-9bfbc5674147]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)
Oct 16 19:04:59 user nova-compute[74247]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c (non-flash)
Oct 16 19:04:59 user nova-compute[74247]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 (non-flash)
Oct 16 19:04:59 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)
Oct 16 19:04:59 user nova-compute[74247]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c (non-flash)
Oct 16 19:04:59 user nova-compute[74247]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 (non-flash)
Oct 16 19:04:59 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ec94d4-c256-49e8-986f-f9b288098871]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FBWoyVtI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 19:04:59 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Instance destroyed successfully.
Oct 16 19:04:59 user nova-compute[74247]: DEBUG nova.objects.instance [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lazy-loading 'resources' on Instance uuid c81b3e99-e02a-43ae-94fa-165bac55700a {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T19:03:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1271233429',display_name='tempest-TestVolumeBootPattern-server-1271233429',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1271233429',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjgu1PdB/VXTN5rZ7oE5e7ovtw+8pzQ24n8jIU2366r669SEEAxAB/9LNF+VOEmvr2qFXyje/n1vbSVuotOeSuaNNrodAuV6fmL4YsSSNhGH3oIDcKRDUc8ro4Dw/7HjQ==',key_name='tempest-TestVolumeBootPattern-34627609',keypairs=<?>,launch_index=0,launched_at=2023-10-16T19:03:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dca6144ea4e14c28b085e271175bbf67',ramdisk_id='',reservation_id='r-jtfhmh5i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1733357121',owner_user_name='tempest-TestVolumeBootPattern-1733357121-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T19:03:28Z,user_data=None,user_id='9608bf58b70248439dbbcc9db38fba08',uuid=c81b3e99-e02a-43ae-94fa-165bac55700a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f93697e-d06a-44eb-b63a-b7433c52adb9", "address": "fa:16:3e:67:33:5c", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f93697e-d0", "ovs_interfaceid": "8f93697e-d06a-44eb-b63a-b7433c52adb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Converting VIF {"id": "8f93697e-d06a-44eb-b63a-b7433c52adb9", "address": "fa:16:3e:67:33:5c", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f93697e-d0", "ovs_interfaceid": "8f93697e-d06a-44eb-b63a-b7433c52adb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:33:5c,bridge_name='br-int',has_traffic_filtering=True,id=8f93697e-d06a-44eb-b63a-b7433c52adb9,network=Network(9688c665-d4b7-4179-9a76-fdf6c3013b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f93697e-d0') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG os_vif [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:33:5c,bridge_name='br-int',has_traffic_filtering=True,id=8f93697e-d06a-44eb-b63a-b7433c52adb9,network=Network(9688c665-d4b7-4179-9a76-fdf6c3013b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f93697e-d0') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f93697e-d0, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c833cd2d-f72c-4065-b497-113ce32993ae) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:04:59 user nova-compute[74247]: INFO os_vif [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:33:5c,bridge_name='br-int',has_traffic_filtering=True,id=8f93697e-d06a-44eb-b63a-b7433c52adb9,network=Network(9688c665-d4b7-4179-9a76-fdf6c3013b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f93697e-d0')
Oct 16 19:04:59 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 19:04:59 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pTMwdgtS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 19:04:59 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 19:05:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG nova.compute.manager [req-b10eea27-49c2-446d-bc11-4513bcbae5a3 req-a997111e-9198-4356-9fc0-2fa9b0e75a85 service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Received event network-vif-unplugged-1e4186ff-26a0-43b8-8b0a-2f62eb718451 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-b10eea27-49c2-446d-bc11-4513bcbae5a3 req-a997111e-9198-4356-9fc0-2fa9b0e75a85 service nova] Acquiring lock "68edbfa7-0752-42fb-bad8-eb7121796e9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-b10eea27-49c2-446d-bc11-4513bcbae5a3 req-a997111e-9198-4356-9fc0-2fa9b0e75a85 service nova] Lock "68edbfa7-0752-42fb-bad8-eb7121796e9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-b10eea27-49c2-446d-bc11-4513bcbae5a3 req-a997111e-9198-4356-9fc0-2fa9b0e75a85 service nova] Lock "68edbfa7-0752-42fb-bad8-eb7121796e9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG nova.compute.manager [req-b10eea27-49c2-446d-bc11-4513bcbae5a3 req-a997111e-9198-4356-9fc0-2fa9b0e75a85 service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] No waiting events found dispatching network-vif-unplugged-1e4186ff-26a0-43b8-8b0a-2f62eb718451 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:05:00 user nova-compute[74247]: WARNING nova.compute.manager [req-b10eea27-49c2-446d-bc11-4513bcbae5a3 req-a997111e-9198-4356-9fc0-2fa9b0e75a85 service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Received unexpected event network-vif-unplugged-1e4186ff-26a0-43b8-8b0a-2f62eb718451 for instance with vm_state active and task_state reboot_started_hard.
Oct 16 19:05:00 user nova-compute[74247]: DEBUG nova.compute.manager [req-b10eea27-49c2-446d-bc11-4513bcbae5a3 req-a997111e-9198-4356-9fc0-2fa9b0e75a85 service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Received event network-vif-plugged-1e4186ff-26a0-43b8-8b0a-2f62eb718451 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-b10eea27-49c2-446d-bc11-4513bcbae5a3 req-a997111e-9198-4356-9fc0-2fa9b0e75a85 service nova] Acquiring lock "68edbfa7-0752-42fb-bad8-eb7121796e9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-b10eea27-49c2-446d-bc11-4513bcbae5a3 req-a997111e-9198-4356-9fc0-2fa9b0e75a85 service nova] Lock "68edbfa7-0752-42fb-bad8-eb7121796e9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-b10eea27-49c2-446d-bc11-4513bcbae5a3 req-a997111e-9198-4356-9fc0-2fa9b0e75a85 service nova] Lock "68edbfa7-0752-42fb-bad8-eb7121796e9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG nova.compute.manager [req-b10eea27-49c2-446d-bc11-4513bcbae5a3 req-a997111e-9198-4356-9fc0-2fa9b0e75a85 service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] No waiting events found dispatching network-vif-plugged-1e4186ff-26a0-43b8-8b0a-2f62eb718451 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:05:00 user nova-compute[74247]: WARNING nova.compute.manager [req-b10eea27-49c2-446d-bc11-4513bcbae5a3 req-a997111e-9198-4356-9fc0-2fa9b0e75a85 service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Received unexpected event network-vif-plugged-1e4186ff-26a0-43b8-8b0a-2f62eb718451 for instance with vm_state active and task_state reboot_started_hard.
Oct 16 19:05:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23730666434303261', 'path': '/dev/sdc'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730666434303261', 'path': '/dev/sdc'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.631s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T19:02:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1906922734',display_name='tempest-TestMinimumBasicScenario-server-1906922734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1906922734',id=47,image_ref='46d6f108-3b2e-41c3-8694-65606e2769ee',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1caxevCdksN3AlmBdVwZfiOOScHN4VaKza+143cbh60V4VUdpuh75jnICCBVrEWNOsZzHUyPA9sdF/wl46FD7/FpfokUQQw4OLB6uN6SSD+v6cZrKs558k5Gsx5iCxEQ==',key_name='tempest-TestMinimumBasicScenario-344900198',keypairs=<?>,launch_index=0,launched_at=2023-10-16T19:02:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42cb6a3c6bdd484d9a8d0c27bf1ac2fb',ramdisk_id='',reservation_id='r-47ytcjou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='46d6f108-3b2e-41c3-8694-65606e2769ee',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-218992455',owner_user_name='tempest-TestMinimumBasicScenario-218992455-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T19:04:58Z,user_data=None,user_id='7414f773f7a94a13938c406bf02b3bac',uuid=68edbfa7-0752-42fb-bad8-eb7121796e9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "address": "fa:16:3e:ae:24:ed", "network": {"id": "5801391d-4968-4504-9f23-8683eeb63a54", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2082110052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cb6a3c6bdd484d9a8d0c27bf1ac2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e4186ff-26", "ovs_interfaceid": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Converting VIF {"id": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "address": "fa:16:3e:ae:24:ed", "network": {"id": "5801391d-4968-4504-9f23-8683eeb63a54", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2082110052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cb6a3c6bdd484d9a8d0c27bf1ac2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e4186ff-26", "ovs_interfaceid": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:24:ed,bridge_name='br-int',has_traffic_filtering=True,id=1e4186ff-26a0-43b8-8b0a-2f62eb718451,network=Network(5801391d-4968-4504-9f23-8683eeb63a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e4186ff-26') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG nova.objects.instance [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lazy-loading 'pci_devices' on Instance uuid 68edbfa7-0752-42fb-bad8-eb7121796e9f {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d1c470-1fff-4299-a070-052dd18aa0b4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 19:05:00 user nova-compute[74247]: No targets found.
Oct 16 19:05:00 user nova-compute[74247]: iSNS:
Oct 16 19:05:00 user nova-compute[74247]: No targets found.
Oct 16 19:05:00 user nova-compute[74247]: STATIC:
Oct 16 19:05:00 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec
Oct 16 19:05:00 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 19:05:00 user nova-compute[74247]:                 Iface Name: default
Oct 16 19:05:00 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c
Oct 16 19:05:00 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 19:05:00 user nova-compute[74247]:                 Iface Name: default
Oct 16 19:05:00 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317
Oct 16 19:05:00 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 19:05:00 user nova-compute[74247]:                 Iface Name: default
Oct 16 19:05:00 user nova-compute[74247]: FIRMWARE:
Oct 16 19:05:00 user nova-compute[74247]: No targets found.
Oct 16 19:05:00 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 19:05:00 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 19:05:00 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG nova.objects.base [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Object Instance<68edbfa7-0752-42fb-bad8-eb7121796e9f> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] End _get_guest_xml xml=<domain type="kvm">
Oct 16 19:05:00 user nova-compute[74247]:   <uuid>68edbfa7-0752-42fb-bad8-eb7121796e9f</uuid>
Oct 16 19:05:00 user nova-compute[74247]:   <name>instance-0000002f</name>
Oct 16 19:05:00 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 19:05:00 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 19:05:00 user nova-compute[74247]:   <metadata>
Oct 16 19:05:00 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 19:05:00 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 19:05:00 user nova-compute[74247]:       <nova:name>tempest-TestMinimumBasicScenario-server-1906922734</nova:name>
Oct 16 19:05:00 user nova-compute[74247]:       <nova:creationTime>2023-10-16 19:04:59</nova:creationTime>
Oct 16 19:05:00 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 19:05:00 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 19:05:00 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 19:05:00 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 19:05:00 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 19:05:00 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 19:05:00 user nova-compute[74247]:       </nova:flavor>
Oct 16 19:05:00 user nova-compute[74247]:       <nova:owner>
Oct 16 19:05:00 user nova-compute[74247]:         <nova:user uuid="7414f773f7a94a13938c406bf02b3bac">tempest-TestMinimumBasicScenario-218992455-project-member</nova:user>
Oct 16 19:05:00 user nova-compute[74247]:         <nova:project uuid="42cb6a3c6bdd484d9a8d0c27bf1ac2fb">tempest-TestMinimumBasicScenario-218992455</nova:project>
Oct 16 19:05:00 user nova-compute[74247]:       </nova:owner>
Oct 16 19:05:00 user nova-compute[74247]:       <nova:root type="image" uuid="46d6f108-3b2e-41c3-8694-65606e2769ee"/>
Oct 16 19:05:00 user nova-compute[74247]:       <nova:ports>
Oct 16 19:05:00 user nova-compute[74247]:         <nova:port uuid="1e4186ff-26a0-43b8-8b0a-2f62eb718451">
Oct 16 19:05:00 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 16 19:05:00 user nova-compute[74247]:         </nova:port>
Oct 16 19:05:00 user nova-compute[74247]:       </nova:ports>
Oct 16 19:05:00 user nova-compute[74247]:     </nova:instance>
Oct 16 19:05:00 user nova-compute[74247]:   </metadata>
Oct 16 19:05:00 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 19:05:00 user nova-compute[74247]:     <system>
Oct 16 19:05:00 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 19:05:00 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 19:05:00 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 19:05:00 user nova-compute[74247]:       <entry name="serial">68edbfa7-0752-42fb-bad8-eb7121796e9f</entry>
Oct 16 19:05:00 user nova-compute[74247]:       <entry name="uuid">68edbfa7-0752-42fb-bad8-eb7121796e9f</entry>
Oct 16 19:05:00 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 19:05:00 user nova-compute[74247]:     </system>
Oct 16 19:05:00 user nova-compute[74247]:   </sysinfo>
Oct 16 19:05:00 user nova-compute[74247]:   <os>
Oct 16 19:05:00 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 19:05:00 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 19:05:00 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 19:05:00 user nova-compute[74247]:   </os>
Oct 16 19:05:00 user nova-compute[74247]:   <features>
Oct 16 19:05:00 user nova-compute[74247]:     <acpi/>
Oct 16 19:05:00 user nova-compute[74247]:     <apic/>
Oct 16 19:05:00 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 19:05:00 user nova-compute[74247]:   </features>
Oct 16 19:05:00 user nova-compute[74247]:   <clock offset="utc">
Oct 16 19:05:00 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 19:05:00 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 19:05:00 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 19:05:00 user nova-compute[74247]:   </clock>
Oct 16 19:05:00 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 19:05:00 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 19:05:00 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 19:05:00 user nova-compute[74247]:   </cpu>
Oct 16 19:05:00 user nova-compute[74247]:   <devices>
Oct 16 19:05:00 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 19:05:00 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 19:05:00 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f/disk"/>
Oct 16 19:05:00 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 19:05:00 user nova-compute[74247]:     </disk>
Oct 16 19:05:00 user nova-compute[74247]:     <disk type="block" device="disk">
Oct 16 19:05:00 user nova-compute[74247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 19:05:00 user nova-compute[74247]:       <source dev="/dev/sdc"/>
Oct 16 19:05:00 user nova-compute[74247]:       <target dev="vdb" bus="virtio"/>
Oct 16 19:05:00 user nova-compute[74247]:       <serial>cfc1e0e6-3cb8-4c38-a36c-7636f3e35317</serial>
Oct 16 19:05:00 user nova-compute[74247]:     </disk>
Oct 16 19:05:00 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 19:05:00 user nova-compute[74247]:       <mac address="fa:16:3e:ae:24:ed"/>
Oct 16 19:05:00 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 19:05:00 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 19:05:00 user nova-compute[74247]:       <target dev="tap1e4186ff-26"/>
Oct 16 19:05:00 user nova-compute[74247]:     </interface>
Oct 16 19:05:00 user nova-compute[74247]:     <serial type="pty">
Oct 16 19:05:00 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f/console.log" append="off"/>
Oct 16 19:05:00 user nova-compute[74247]:     </serial>
Oct 16 19:05:00 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 19:05:00 user nova-compute[74247]:     <video>
Oct 16 19:05:00 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 19:05:00 user nova-compute[74247]:     </video>
Oct 16 19:05:00 user nova-compute[74247]:     <rng model="virtio">
Oct 16 19:05:00 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 19:05:00 user nova-compute[74247]:     </rng>
Oct 16 19:05:00 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 19:05:00 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 19:05:00 user nova-compute[74247]:       <stats period="10"/>
Oct 16 19:05:00 user nova-compute[74247]:     </memballoon>
Oct 16 19:05:00 user nova-compute[74247]:   </devices>
Oct 16 19:05:00 user nova-compute[74247]: </domain>
Oct 16 19:05:00 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c67f9b-b756-49f5-afe8-2f69c7008f22]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f44a14-1b9d-49fd-be9b-7980158a80db]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)
Oct 16 19:05:00 user nova-compute[74247]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c (non-flash)
Oct 16 19:05:00 user nova-compute[74247]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 (non-flash)
Oct 16 19:05:00 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)
Oct 16 19:05:00 user nova-compute[74247]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c (non-flash)
Oct 16 19:05:00 user nova-compute[74247]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 (non-flash)
Oct 16 19:05:00 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe0484113f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c'): ({'sdd'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Removing single pathed devices sdd {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[060c744b-3f10-4772-9f82-01c1dbee8089]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6113f83a-67b0-4d6d-bd61-406f2e4130c9]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Flushing IO for device /dev/sdd {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[23458993-7eb1-4a8d-b91e-2672a46a1e90]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9b437b-416e-458c-9ac5-03d864240b47]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] SCSI volumes sdd have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1ab787-2446-49e0-b7c8-6977c9bd3ae0]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[218e6251-d111-4be7-98a0-92de0e4bf68a]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c, portal: 172.16.0.220,3260]
Oct 16 19:05:00 user nova-compute[74247]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c, portal: 172.16.0.220,3260] successful.
Oct 16 19:05:00 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1573ec1f-a300-4641-90ab-0f4858380b2c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1efca627-81d5-4b32-a08e-ec977eb0e737]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] <== disconnect_volume: return (998ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 19:05:00 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 19:05:01 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Deleting instance files /opt/stack/data/nova/instances/c81b3e99-e02a-43ae-94fa-165bac55700a_del
Oct 16 19:05:01 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Deletion of /opt/stack/data/nova/instances/c81b3e99-e02a-43ae-94fa-165bac55700a_del complete
Oct 16 19:05:01 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:05:01 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 19:05:01 user nova-compute[74247]: DEBUG nova.objects.instance [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lazy-loading 'trusted_certs' on Instance uuid 68edbfa7-0752-42fb-bad8-eb7121796e9f {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:05:01 user nova-compute[74247]: DEBUG nova.objects.base [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Object Instance<68edbfa7-0752-42fb-bad8-eb7121796e9f> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 19:05:01 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19cfabef25d7a3b36f6641053ac16011ef6876af --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:05:01 user nova-compute[74247]: INFO nova.compute.manager [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Took 1.89 seconds to destroy the instance on the hypervisor.
Oct 16 19:05:01 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 19:05:01 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 19:05:01 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 19:05:01 user nova-compute[74247]: DEBUG nova.compute.manager [req-fc6298a2-a673-444a-9834-1081daec693f req-4a213cb5-38a8-4b49-9f03-7b64d3155074 service nova] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Received event network-vif-unplugged-8f93697e-d06a-44eb-b63a-b7433c52adb9 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:05:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-fc6298a2-a673-444a-9834-1081daec693f req-4a213cb5-38a8-4b49-9f03-7b64d3155074 service nova] Acquiring lock "c81b3e99-e02a-43ae-94fa-165bac55700a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:05:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-fc6298a2-a673-444a-9834-1081daec693f req-4a213cb5-38a8-4b49-9f03-7b64d3155074 service nova] Lock "c81b3e99-e02a-43ae-94fa-165bac55700a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:05:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-fc6298a2-a673-444a-9834-1081daec693f req-4a213cb5-38a8-4b49-9f03-7b64d3155074 service nova] Lock "c81b3e99-e02a-43ae-94fa-165bac55700a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:05:01 user nova-compute[74247]: DEBUG nova.compute.manager [req-fc6298a2-a673-444a-9834-1081daec693f req-4a213cb5-38a8-4b49-9f03-7b64d3155074 service nova] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] No waiting events found dispatching network-vif-unplugged-8f93697e-d06a-44eb-b63a-b7433c52adb9 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:05:01 user nova-compute[74247]: DEBUG nova.compute.manager [req-fc6298a2-a673-444a-9834-1081daec693f req-4a213cb5-38a8-4b49-9f03-7b64d3155074 service nova] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Received event network-vif-unplugged-8f93697e-d06a-44eb-b63a-b7433c52adb9 for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 19:05:01 user nova-compute[74247]: DEBUG nova.compute.manager [req-fc6298a2-a673-444a-9834-1081daec693f req-4a213cb5-38a8-4b49-9f03-7b64d3155074 service nova] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Received event network-vif-plugged-8f93697e-d06a-44eb-b63a-b7433c52adb9 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:05:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-fc6298a2-a673-444a-9834-1081daec693f req-4a213cb5-38a8-4b49-9f03-7b64d3155074 service nova] Acquiring lock "c81b3e99-e02a-43ae-94fa-165bac55700a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:05:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-fc6298a2-a673-444a-9834-1081daec693f req-4a213cb5-38a8-4b49-9f03-7b64d3155074 service nova] Lock "c81b3e99-e02a-43ae-94fa-165bac55700a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:05:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-fc6298a2-a673-444a-9834-1081daec693f req-4a213cb5-38a8-4b49-9f03-7b64d3155074 service nova] Lock "c81b3e99-e02a-43ae-94fa-165bac55700a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:05:01 user nova-compute[74247]: DEBUG nova.compute.manager [req-fc6298a2-a673-444a-9834-1081daec693f req-4a213cb5-38a8-4b49-9f03-7b64d3155074 service nova] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] No waiting events found dispatching network-vif-plugged-8f93697e-d06a-44eb-b63a-b7433c52adb9 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:05:01 user nova-compute[74247]: WARNING nova.compute.manager [req-fc6298a2-a673-444a-9834-1081daec693f req-4a213cb5-38a8-4b49-9f03-7b64d3155074 service nova] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Received unexpected event network-vif-plugged-8f93697e-d06a-44eb-b63a-b7433c52adb9 for instance with vm_state active and task_state deleting.
Oct 16 19:05:01 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19cfabef25d7a3b36f6641053ac16011ef6876af --force-share --output=json" returned: 0 in 0.181s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:05:01 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Checking if we can resize image /opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f/disk. size=1073741824 {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 19:05:01 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:05:01 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:05:01 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Cannot resize image /opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f/disk to a smaller size. {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 19:05:01 user nova-compute[74247]: DEBUG nova.objects.instance [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lazy-loading 'migration_context' on Instance uuid 68edbfa7-0752-42fb-bad8-eb7121796e9f {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:05:01 user nova-compute[74247]: DEBUG nova.objects.base [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Object Instance<68edbfa7-0752-42fb-bad8-eb7121796e9f> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 19:05:01 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T19:02:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1906922734',display_name='tempest-TestMinimumBasicScenario-server-1906922734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1906922734',id=47,image_ref='46d6f108-3b2e-41c3-8694-65606e2769ee',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1caxevCdksN3AlmBdVwZfiOOScHN4VaKza+143cbh60V4VUdpuh75jnICCBVrEWNOsZzHUyPA9sdF/wl46FD7/FpfokUQQw4OLB6uN6SSD+v6cZrKs558k5Gsx5iCxEQ==',key_name='tempest-TestMinimumBasicScenario-344900198',keypairs=<?>,launch_index=0,launched_at=2023-10-16T19:02:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='42cb6a3c6bdd484d9a8d0c27bf1ac2fb',ramdisk_id='',reservation_id='r-47ytcjou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='46d6f108-3b2e-41c3-8694-65606e2769ee',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-218992455',owner_user_name='tempest-TestMinimumBasicScenario-218992455-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T19:04:58Z,user_data=None,user_id='7414f773f7a94a13938c406bf02b3bac',uuid=68edbfa7-0752-42fb-bad8-eb7121796e9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "address": "fa:16:3e:ae:24:ed", "network": {"id": "5801391d-4968-4504-9f23-8683eeb63a54", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2082110052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cb6a3c6bdd484d9a8d0c27bf1ac2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e4186ff-26", "ovs_interfaceid": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 19:05:01 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Converting VIF {"id": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "address": "fa:16:3e:ae:24:ed", "network": {"id": "5801391d-4968-4504-9f23-8683eeb63a54", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2082110052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cb6a3c6bdd484d9a8d0c27bf1ac2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e4186ff-26", "ovs_interfaceid": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 19:05:01 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:24:ed,bridge_name='br-int',has_traffic_filtering=True,id=1e4186ff-26a0-43b8-8b0a-2f62eb718451,network=Network(5801391d-4968-4504-9f23-8683eeb63a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e4186ff-26') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 19:05:01 user nova-compute[74247]: DEBUG os_vif [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:24:ed,bridge_name='br-int',has_traffic_filtering=True,id=1e4186ff-26a0-43b8-8b0a-2f62eb718451,network=Network(5801391d-4968-4504-9f23-8683eeb63a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e4186ff-26') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 19:05:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:05:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 19:05:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9d1a74a7-765d-5e51-8d1c-631c2822494c', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:05:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:05:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e4186ff-26, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:05:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1e4186ff-26, col_values=(('qos', UUID('547ac91e-266f-40f3-b1cc-15c9677fc738')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:05:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1e4186ff-26, col_values=(('external_ids', {'iface-id': '1e4186ff-26a0-43b8-8b0a-2f62eb718451', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:24:ed', 'vm-uuid': '68edbfa7-0752-42fb-bad8-eb7121796e9f'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:05:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:05:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:01 user nova-compute[74247]: INFO os_vif [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:24:ed,bridge_name='br-int',has_traffic_filtering=True,id=1e4186ff-26a0-43b8-8b0a-2f62eb718451,network=Network(5801391d-4968-4504-9f23-8683eeb63a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e4186ff-26')
Oct 16 19:05:01 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:05:01 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Took 0.46 seconds to deallocate network for instance.
Oct 16 19:05:01 user nova-compute[74247]: DEBUG nova.compute.manager [req-01f0b397-f64f-4fa5-9884-f74253da266f req-d500e672-3571-4d01-9192-2b611ea902d0 service nova] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Received event network-vif-deleted-8f93697e-d06a-44eb-b63a-b7433c52adb9 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:05:01 user nova-compute[74247]: INFO nova.compute.manager [req-01f0b397-f64f-4fa5-9884-f74253da266f req-d500e672-3571-4d01-9192-2b611ea902d0 service nova] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Neutron deleted interface 8f93697e-d06a-44eb-b63a-b7433c52adb9; detaching it from the instance and deleting it from the info cache
Oct 16 19:05:01 user nova-compute[74247]: DEBUG nova.network.neutron [req-01f0b397-f64f-4fa5-9884-f74253da266f req-d500e672-3571-4d01-9192-2b611ea902d0 service nova] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:05:01 user nova-compute[74247]: DEBUG nova.compute.manager [req-01f0b397-f64f-4fa5-9884-f74253da266f req-d500e672-3571-4d01-9192-2b611ea902d0 service nova] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Detach interface failed, port_id=8f93697e-d06a-44eb-b63a-b7433c52adb9, reason: Instance c81b3e99-e02a-43ae-94fa-165bac55700a could not be found. {{(pid=74247) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 19:05:02 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:02 user nova-compute[74247]: INFO nova.compute.manager [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: c81b3e99-e02a-43ae-94fa-165bac55700a] Took 0.79 seconds to detach 1 volumes for instance.
Oct 16 19:05:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:05:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:05:02 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 19:05:02 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 19:05:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.163s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:05:02 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Deleted allocations for instance c81b3e99-e02a-43ae-94fa-165bac55700a
Oct 16 19:05:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-78c1adcb-55f3-4007-acd0-a7d009f44994 tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "c81b3e99-e02a-43ae-94fa-165bac55700a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.483s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:05:02 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:02 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:02 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:02 user nova-compute[74247]: DEBUG nova.compute.manager [req-223dc633-0d91-4b15-821c-1e808360e46d req-c49886a4-7c82-4172-ad49-51680dbc9192 service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Received event network-vif-plugged-1e4186ff-26a0-43b8-8b0a-2f62eb718451 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:05:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-223dc633-0d91-4b15-821c-1e808360e46d req-c49886a4-7c82-4172-ad49-51680dbc9192 service nova] Acquiring lock "68edbfa7-0752-42fb-bad8-eb7121796e9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:05:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-223dc633-0d91-4b15-821c-1e808360e46d req-c49886a4-7c82-4172-ad49-51680dbc9192 service nova] Lock "68edbfa7-0752-42fb-bad8-eb7121796e9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:05:02 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-223dc633-0d91-4b15-821c-1e808360e46d req-c49886a4-7c82-4172-ad49-51680dbc9192 service nova] Lock "68edbfa7-0752-42fb-bad8-eb7121796e9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:05:02 user nova-compute[74247]: DEBUG nova.compute.manager [req-223dc633-0d91-4b15-821c-1e808360e46d req-c49886a4-7c82-4172-ad49-51680dbc9192 service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] No waiting events found dispatching network-vif-plugged-1e4186ff-26a0-43b8-8b0a-2f62eb718451 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:05:02 user nova-compute[74247]: WARNING nova.compute.manager [req-223dc633-0d91-4b15-821c-1e808360e46d req-c49886a4-7c82-4172-ad49-51680dbc9192 service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Received unexpected event network-vif-plugged-1e4186ff-26a0-43b8-8b0a-2f62eb718451 for instance with vm_state active and task_state reboot_started_hard.
Oct 16 19:05:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:05 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 19:05:05 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Instance rebooted successfully.
Oct 16 19:05:05 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 19:05:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4d6d1bd0-2d8d-4128-ab7c-4ec138206a0e tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "68edbfa7-0752-42fb-bad8-eb7121796e9f" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.785s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:05:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-1b6a2589-cf82-452a-ba86-2ed03a12c6e6 req-88188955-dbaf-46fa-b95d-337550507029 service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Received event network-vif-plugged-1e4186ff-26a0-43b8-8b0a-2f62eb718451 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:05:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1b6a2589-cf82-452a-ba86-2ed03a12c6e6 req-88188955-dbaf-46fa-b95d-337550507029 service nova] Acquiring lock "68edbfa7-0752-42fb-bad8-eb7121796e9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:05:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1b6a2589-cf82-452a-ba86-2ed03a12c6e6 req-88188955-dbaf-46fa-b95d-337550507029 service nova] Lock "68edbfa7-0752-42fb-bad8-eb7121796e9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:05:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1b6a2589-cf82-452a-ba86-2ed03a12c6e6 req-88188955-dbaf-46fa-b95d-337550507029 service nova] Lock "68edbfa7-0752-42fb-bad8-eb7121796e9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:05:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-1b6a2589-cf82-452a-ba86-2ed03a12c6e6 req-88188955-dbaf-46fa-b95d-337550507029 service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] No waiting events found dispatching network-vif-plugged-1e4186ff-26a0-43b8-8b0a-2f62eb718451 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:05:05 user nova-compute[74247]: WARNING nova.compute.manager [req-1b6a2589-cf82-452a-ba86-2ed03a12c6e6 req-88188955-dbaf-46fa-b95d-337550507029 service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Received unexpected event network-vif-plugged-1e4186ff-26a0-43b8-8b0a-2f62eb718451 for instance with vm_state active and task_state None.
Oct 16 19:05:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:05:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:05:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:05:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:05:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:05:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:20 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:05:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:25 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:05:25 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:05:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:05:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:05:25 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:05:25 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 19:05:25 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 19:05:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:05:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:05:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:05:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:05:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 19:05:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:26 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:05:26 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:05:26 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=8708MB free_disk=24.89575958251953GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 19:05:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:05:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:05:26 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance e506e951-e694-40bc-a91a-800ac91e658e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 19:05:26 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 68edbfa7-0752-42fb-bad8-eb7121796e9f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 19:05:26 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 19:05:26 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 19:05:26 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 19:05:26 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 19:05:26 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 19:05:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.197s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:05:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Acquiring lock "c98f761b-9569-4bdc-bb41-87201d78ee1c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:05:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "c98f761b-9569-4bdc-bb41-87201d78ee1c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:05:28 user nova-compute[74247]: DEBUG nova.compute.manager [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 19:05:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:05:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:05:28 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 19:05:28 user nova-compute[74247]: INFO nova.compute.claims [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Claim successful on node user
Oct 16 19:05:28 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 19:05:28 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 19:05:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.309s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:05:28 user nova-compute[74247]: DEBUG nova.compute.manager [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 19:05:28 user nova-compute[74247]: DEBUG nova.compute.manager [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 19:05:28 user nova-compute[74247]: DEBUG nova.network.neutron [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 19:05:28 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 19:05:28 user nova-compute[74247]: DEBUG nova.compute.manager [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 19:05:28 user nova-compute[74247]: DEBUG nova.policy [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b28a77b1cf14454595a99c9428c687b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c41a39f4784703bcad1f7591a76d11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 19:05:28 user nova-compute[74247]: DEBUG nova.compute.manager [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 19:05:28 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 19:05:28 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Creating image(s)
Oct 16 19:05:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Acquiring lock "/opt/stack/data/nova/instances/c98f761b-9569-4bdc-bb41-87201d78ee1c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:05:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "/opt/stack/data/nova/instances/c98f761b-9569-4bdc-bb41-87201d78ee1c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:05:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "/opt/stack/data/nova/instances/c98f761b-9569-4bdc-bb41-87201d78ee1c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:05:28 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:05:29 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.241s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:05:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Acquiring lock "37399febbd18f60b85fd0f833558f6a3539ab231" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:05:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:05:29 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:05:29 user nova-compute[74247]: DEBUG nova.network.neutron [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Successfully created port: ca03492e-c602-4ae1-ae43-63b37a989463 {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 19:05:29 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.177s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:05:29 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/c98f761b-9569-4bdc-bb41-87201d78ee1c/disk 1073741824 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:05:29 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/c98f761b-9569-4bdc-bb41-87201d78ee1c/disk 1073741824" returned: 0 in 0.052s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:05:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:05:29 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:05:29 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.176s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:05:29 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c98f761b-9569-4bdc-bb41-87201d78ee1c/disk. size=1073741824 {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 19:05:29 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c98f761b-9569-4bdc-bb41-87201d78ee1c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:05:29 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c98f761b-9569-4bdc-bb41-87201d78ee1c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:05:29 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Cannot resize image /opt/stack/data/nova/instances/c98f761b-9569-4bdc-bb41-87201d78ee1c/disk to a smaller size. {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 19:05:29 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 19:05:29 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Ensure instance console log exists: /opt/stack/data/nova/instances/c98f761b-9569-4bdc-bb41-87201d78ee1c/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 19:05:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:05:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:05:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:05:29 user nova-compute[74247]: DEBUG nova.network.neutron [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Successfully updated port: ca03492e-c602-4ae1-ae43-63b37a989463 {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 19:05:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Acquiring lock "refresh_cache-c98f761b-9569-4bdc-bb41-87201d78ee1c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:05:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Acquired lock "refresh_cache-c98f761b-9569-4bdc-bb41-87201d78ee1c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:05:29 user nova-compute[74247]: DEBUG nova.network.neutron [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 19:05:29 user nova-compute[74247]: DEBUG nova.compute.manager [req-7ecfa5b0-ab1e-4639-b8a0-cb71c5768295 req-874b9058-3adf-4ce9-9a64-73fe587b95cf service nova] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Received event network-changed-ca03492e-c602-4ae1-ae43-63b37a989463 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:05:29 user nova-compute[74247]: DEBUG nova.compute.manager [req-7ecfa5b0-ab1e-4639-b8a0-cb71c5768295 req-874b9058-3adf-4ce9-9a64-73fe587b95cf service nova] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Refreshing instance network info cache due to event network-changed-ca03492e-c602-4ae1-ae43-63b37a989463. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 19:05:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7ecfa5b0-ab1e-4639-b8a0-cb71c5768295 req-874b9058-3adf-4ce9-9a64-73fe587b95cf service nova] Acquiring lock "refresh_cache-c98f761b-9569-4bdc-bb41-87201d78ee1c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG nova.network.neutron [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG nova.network.neutron [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Updating instance_info_cache with network_info: [{"id": "ca03492e-c602-4ae1-ae43-63b37a989463", "address": "fa:16:3e:34:00:5c", "network": {"id": "baf3f2f3-1b8b-4c83-b488-9e7bd2323e54", "bridge": "br-int", "label": "tempest-TestStampPattern-1706551992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c41a39f4784703bcad1f7591a76d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca03492e-c6", "ovs_interfaceid": "ca03492e-c602-4ae1-ae43-63b37a989463", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Releasing lock "refresh_cache-c98f761b-9569-4bdc-bb41-87201d78ee1c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG nova.compute.manager [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Instance network_info: |[{"id": "ca03492e-c602-4ae1-ae43-63b37a989463", "address": "fa:16:3e:34:00:5c", "network": {"id": "baf3f2f3-1b8b-4c83-b488-9e7bd2323e54", "bridge": "br-int", "label": "tempest-TestStampPattern-1706551992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c41a39f4784703bcad1f7591a76d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca03492e-c6", "ovs_interfaceid": "ca03492e-c602-4ae1-ae43-63b37a989463", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7ecfa5b0-ab1e-4639-b8a0-cb71c5768295 req-874b9058-3adf-4ce9-9a64-73fe587b95cf service nova] Acquired lock "refresh_cache-c98f761b-9569-4bdc-bb41-87201d78ee1c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG nova.network.neutron [req-7ecfa5b0-ab1e-4639-b8a0-cb71c5768295 req-874b9058-3adf-4ce9-9a64-73fe587b95cf service nova] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Refreshing network info cache for port ca03492e-c602-4ae1-ae43-63b37a989463 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Start _get_guest_xml network_info=[{"id": "ca03492e-c602-4ae1-ae43-63b37a989463", "address": "fa:16:3e:34:00:5c", "network": {"id": "baf3f2f3-1b8b-4c83-b488-9e7bd2323e54", "bridge": "br-int", "label": "tempest-TestStampPattern-1706551992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c41a39f4784703bcad1f7591a76d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca03492e-c6", "ovs_interfaceid": "ca03492e-c602-4ae1-ae43-63b37a989463", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': '83126bb1-29f5-42fe-8620-72ab0797f776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 19:05:30 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:05:30 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:05:30 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T19:05:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1510741437',display_name='tempest-TestStampPattern-server-1510741437',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1510741437',id=49,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNxEdjHCqXg36WXekMM1Zh/PyzVI0ul1kYnElgqTDHXdRIJob26QfSPrWsyAE9isu855bMWOwxFPWIr1rugbT9wqVDtsPKJbjyx5N9NGEec2huAjGi342Kiv9qTpABeJw==',key_name='tempest-TestStampPattern-547736775',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1c41a39f4784703bcad1f7591a76d11',ramdisk_id='',reservation_id='r-shyy4w85',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-595700511',owner_user_name='tempest-TestStampPattern-595700511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T19:05:29Z,user_data=None,user_id='b28a77b1cf14454595a99c9428c687b9',uuid=c98f761b-9569-4bdc-bb41-87201d78ee1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca03492e-c602-4ae1-ae43-63b37a989463", "address": "fa:16:3e:34:00:5c", "network": {"id": "baf3f2f3-1b8b-4c83-b488-9e7bd2323e54", "bridge": "br-int", "label": "tempest-TestStampPattern-1706551992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c41a39f4784703bcad1f7591a76d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca03492e-c6", "ovs_interfaceid": "ca03492e-c602-4ae1-ae43-63b37a989463", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Converting VIF {"id": "ca03492e-c602-4ae1-ae43-63b37a989463", "address": "fa:16:3e:34:00:5c", "network": {"id": "baf3f2f3-1b8b-4c83-b488-9e7bd2323e54", "bridge": "br-int", "label": "tempest-TestStampPattern-1706551992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c41a39f4784703bcad1f7591a76d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca03492e-c6", "ovs_interfaceid": "ca03492e-c602-4ae1-ae43-63b37a989463", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:00:5c,bridge_name='br-int',has_traffic_filtering=True,id=ca03492e-c602-4ae1-ae43-63b37a989463,network=Network(baf3f2f3-1b8b-4c83-b488-9e7bd2323e54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca03492e-c6') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG nova.objects.instance [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lazy-loading 'pci_devices' on Instance uuid c98f761b-9569-4bdc-bb41-87201d78ee1c {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] End _get_guest_xml xml=<domain type="kvm">
Oct 16 19:05:30 user nova-compute[74247]:   <uuid>c98f761b-9569-4bdc-bb41-87201d78ee1c</uuid>
Oct 16 19:05:30 user nova-compute[74247]:   <name>instance-00000031</name>
Oct 16 19:05:30 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 19:05:30 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 19:05:30 user nova-compute[74247]:   <metadata>
Oct 16 19:05:30 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 19:05:30 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 19:05:30 user nova-compute[74247]:       <nova:name>tempest-TestStampPattern-server-1510741437</nova:name>
Oct 16 19:05:30 user nova-compute[74247]:       <nova:creationTime>2023-10-16 19:05:30</nova:creationTime>
Oct 16 19:05:30 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 19:05:30 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 19:05:30 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 19:05:30 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 19:05:30 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 19:05:30 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 19:05:30 user nova-compute[74247]:       </nova:flavor>
Oct 16 19:05:30 user nova-compute[74247]:       <nova:owner>
Oct 16 19:05:30 user nova-compute[74247]:         <nova:user uuid="b28a77b1cf14454595a99c9428c687b9">tempest-TestStampPattern-595700511-project-member</nova:user>
Oct 16 19:05:30 user nova-compute[74247]:         <nova:project uuid="c1c41a39f4784703bcad1f7591a76d11">tempest-TestStampPattern-595700511</nova:project>
Oct 16 19:05:30 user nova-compute[74247]:       </nova:owner>
Oct 16 19:05:30 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 19:05:30 user nova-compute[74247]:       <nova:ports>
Oct 16 19:05:30 user nova-compute[74247]:         <nova:port uuid="ca03492e-c602-4ae1-ae43-63b37a989463">
Oct 16 19:05:30 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 16 19:05:30 user nova-compute[74247]:         </nova:port>
Oct 16 19:05:30 user nova-compute[74247]:       </nova:ports>
Oct 16 19:05:30 user nova-compute[74247]:     </nova:instance>
Oct 16 19:05:30 user nova-compute[74247]:   </metadata>
Oct 16 19:05:30 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 19:05:30 user nova-compute[74247]:     <system>
Oct 16 19:05:30 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 19:05:30 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 19:05:30 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 19:05:30 user nova-compute[74247]:       <entry name="serial">c98f761b-9569-4bdc-bb41-87201d78ee1c</entry>
Oct 16 19:05:30 user nova-compute[74247]:       <entry name="uuid">c98f761b-9569-4bdc-bb41-87201d78ee1c</entry>
Oct 16 19:05:30 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 19:05:30 user nova-compute[74247]:     </system>
Oct 16 19:05:30 user nova-compute[74247]:   </sysinfo>
Oct 16 19:05:30 user nova-compute[74247]:   <os>
Oct 16 19:05:30 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 19:05:30 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 19:05:30 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 19:05:30 user nova-compute[74247]:   </os>
Oct 16 19:05:30 user nova-compute[74247]:   <features>
Oct 16 19:05:30 user nova-compute[74247]:     <acpi/>
Oct 16 19:05:30 user nova-compute[74247]:     <apic/>
Oct 16 19:05:30 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 19:05:30 user nova-compute[74247]:   </features>
Oct 16 19:05:30 user nova-compute[74247]:   <clock offset="utc">
Oct 16 19:05:30 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 19:05:30 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 19:05:30 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 19:05:30 user nova-compute[74247]:   </clock>
Oct 16 19:05:30 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 19:05:30 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 19:05:30 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 19:05:30 user nova-compute[74247]:   </cpu>
Oct 16 19:05:30 user nova-compute[74247]:   <devices>
Oct 16 19:05:30 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 19:05:30 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 19:05:30 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/c98f761b-9569-4bdc-bb41-87201d78ee1c/disk"/>
Oct 16 19:05:30 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 19:05:30 user nova-compute[74247]:     </disk>
Oct 16 19:05:30 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 19:05:30 user nova-compute[74247]:       <mac address="fa:16:3e:34:00:5c"/>
Oct 16 19:05:30 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 19:05:30 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 19:05:30 user nova-compute[74247]:       <target dev="tapca03492e-c6"/>
Oct 16 19:05:30 user nova-compute[74247]:     </interface>
Oct 16 19:05:30 user nova-compute[74247]:     <serial type="pty">
Oct 16 19:05:30 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/c98f761b-9569-4bdc-bb41-87201d78ee1c/console.log" append="off"/>
Oct 16 19:05:30 user nova-compute[74247]:     </serial>
Oct 16 19:05:30 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 19:05:30 user nova-compute[74247]:     <video>
Oct 16 19:05:30 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 19:05:30 user nova-compute[74247]:     </video>
Oct 16 19:05:30 user nova-compute[74247]:     <rng model="virtio">
Oct 16 19:05:30 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 19:05:30 user nova-compute[74247]:     </rng>
Oct 16 19:05:30 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 19:05:30 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 19:05:30 user nova-compute[74247]:       <stats period="10"/>
Oct 16 19:05:30 user nova-compute[74247]:     </memballoon>
Oct 16 19:05:30 user nova-compute[74247]:   </devices>
Oct 16 19:05:30 user nova-compute[74247]: </domain>
Oct 16 19:05:30 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T19:05:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1510741437',display_name='tempest-TestStampPattern-server-1510741437',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1510741437',id=49,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNxEdjHCqXg36WXekMM1Zh/PyzVI0ul1kYnElgqTDHXdRIJob26QfSPrWsyAE9isu855bMWOwxFPWIr1rugbT9wqVDtsPKJbjyx5N9NGEec2huAjGi342Kiv9qTpABeJw==',key_name='tempest-TestStampPattern-547736775',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1c41a39f4784703bcad1f7591a76d11',ramdisk_id='',reservation_id='r-shyy4w85',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-595700511',owner_user_name='tempest-TestStampPattern-595700511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T19:05:29Z,user_data=None,user_id='b28a77b1cf14454595a99c9428c687b9',uuid=c98f761b-9569-4bdc-bb41-87201d78ee1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca03492e-c602-4ae1-ae43-63b37a989463", "address": "fa:16:3e:34:00:5c", "network": {"id": "baf3f2f3-1b8b-4c83-b488-9e7bd2323e54", "bridge": "br-int", "label": "tempest-TestStampPattern-1706551992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c41a39f4784703bcad1f7591a76d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca03492e-c6", "ovs_interfaceid": "ca03492e-c602-4ae1-ae43-63b37a989463", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Converting VIF {"id": "ca03492e-c602-4ae1-ae43-63b37a989463", "address": "fa:16:3e:34:00:5c", "network": {"id": "baf3f2f3-1b8b-4c83-b488-9e7bd2323e54", "bridge": "br-int", "label": "tempest-TestStampPattern-1706551992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c41a39f4784703bcad1f7591a76d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca03492e-c6", "ovs_interfaceid": "ca03492e-c602-4ae1-ae43-63b37a989463", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:00:5c,bridge_name='br-int',has_traffic_filtering=True,id=ca03492e-c602-4ae1-ae43-63b37a989463,network=Network(baf3f2f3-1b8b-4c83-b488-9e7bd2323e54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca03492e-c6') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG os_vif [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:00:5c,bridge_name='br-int',has_traffic_filtering=True,id=ca03492e-c602-4ae1-ae43-63b37a989463,network=Network(baf3f2f3-1b8b-4c83-b488-9e7bd2323e54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca03492e-c6') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b97b3cee-252e-518a-bb1d-c4abc014fe38', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapca03492e-c6, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapca03492e-c6, col_values=(('qos', UUID('7e1e335d-3785-40ca-bdda-dde7c1cbd008')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapca03492e-c6, col_values=(('external_ids', {'iface-id': 'ca03492e-c602-4ae1-ae43-63b37a989463', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:00:5c', 'vm-uuid': 'c98f761b-9569-4bdc-bb41-87201d78ee1c'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:30 user nova-compute[74247]: INFO os_vif [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:00:5c,bridge_name='br-int',has_traffic_filtering=True,id=ca03492e-c602-4ae1-ae43-63b37a989463,network=Network(baf3f2f3-1b8b-4c83-b488-9e7bd2323e54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca03492e-c6')
Oct 16 19:05:30 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] No VIF found with MAC fa:16:3e:34:00:5c, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG nova.network.neutron [req-7ecfa5b0-ab1e-4639-b8a0-cb71c5768295 req-874b9058-3adf-4ce9-9a64-73fe587b95cf service nova] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Updated VIF entry in instance network info cache for port ca03492e-c602-4ae1-ae43-63b37a989463. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG nova.network.neutron [req-7ecfa5b0-ab1e-4639-b8a0-cb71c5768295 req-874b9058-3adf-4ce9-9a64-73fe587b95cf service nova] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Updating instance_info_cache with network_info: [{"id": "ca03492e-c602-4ae1-ae43-63b37a989463", "address": "fa:16:3e:34:00:5c", "network": {"id": "baf3f2f3-1b8b-4c83-b488-9e7bd2323e54", "bridge": "br-int", "label": "tempest-TestStampPattern-1706551992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c41a39f4784703bcad1f7591a76d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca03492e-c6", "ovs_interfaceid": "ca03492e-c602-4ae1-ae43-63b37a989463", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7ecfa5b0-ab1e-4639-b8a0-cb71c5768295 req-874b9058-3adf-4ce9-9a64-73fe587b95cf service nova] Releasing lock "refresh_cache-c98f761b-9569-4bdc-bb41-87201d78ee1c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "refresh_cache-68edbfa7-0752-42fb-bad8-eb7121796e9f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquired lock "refresh_cache-68edbfa7-0752-42fb-bad8-eb7121796e9f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:05:30 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Forcefully refreshing network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 19:05:31 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Updating instance_info_cache with network_info: [{"id": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "address": "fa:16:3e:ae:24:ed", "network": {"id": "5801391d-4968-4504-9f23-8683eeb63a54", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2082110052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cb6a3c6bdd484d9a8d0c27bf1ac2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e4186ff-26", "ovs_interfaceid": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:05:31 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Releasing lock "refresh_cache-68edbfa7-0752-42fb-bad8-eb7121796e9f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:05:31 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Updated the network info_cache for instance {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 19:05:31 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:05:31 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:05:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:32 user nova-compute[74247]: DEBUG nova.compute.manager [req-91a53a39-fb3f-4224-bcee-98154f52989c req-9e05bd0b-a6be-4f1a-9e62-ae7379f538c4 service nova] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Received event network-vif-plugged-ca03492e-c602-4ae1-ae43-63b37a989463 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:05:32 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-91a53a39-fb3f-4224-bcee-98154f52989c req-9e05bd0b-a6be-4f1a-9e62-ae7379f538c4 service nova] Acquiring lock "c98f761b-9569-4bdc-bb41-87201d78ee1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:05:32 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-91a53a39-fb3f-4224-bcee-98154f52989c req-9e05bd0b-a6be-4f1a-9e62-ae7379f538c4 service nova] Lock "c98f761b-9569-4bdc-bb41-87201d78ee1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:05:32 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-91a53a39-fb3f-4224-bcee-98154f52989c req-9e05bd0b-a6be-4f1a-9e62-ae7379f538c4 service nova] Lock "c98f761b-9569-4bdc-bb41-87201d78ee1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:05:32 user nova-compute[74247]: DEBUG nova.compute.manager [req-91a53a39-fb3f-4224-bcee-98154f52989c req-9e05bd0b-a6be-4f1a-9e62-ae7379f538c4 service nova] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] No waiting events found dispatching network-vif-plugged-ca03492e-c602-4ae1-ae43-63b37a989463 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:05:32 user nova-compute[74247]: WARNING nova.compute.manager [req-91a53a39-fb3f-4224-bcee-98154f52989c req-9e05bd0b-a6be-4f1a-9e62-ae7379f538c4 service nova] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Received unexpected event network-vif-plugged-ca03492e-c602-4ae1-ae43-63b37a989463 for instance with vm_state building and task_state spawning.
Oct 16 19:05:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:33 user nova-compute[74247]: DEBUG nova.compute.manager [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 19:05:33 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 19:05:33 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Instance spawned successfully.
Oct 16 19:05:33 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 19:05:33 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 19:05:33 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 19:05:33 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 19:05:33 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 19:05:33 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 19:05:33 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 19:05:33 user nova-compute[74247]: INFO nova.compute.manager [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Took 4.96 seconds to spawn the instance on the hypervisor.
Oct 16 19:05:33 user nova-compute[74247]: DEBUG nova.compute.manager [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 19:05:33 user nova-compute[74247]: INFO nova.compute.manager [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Took 5.74 seconds to build instance.
Oct 16 19:05:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-430a60d2-ce38-492b-b0f5-122fef9ee7bb tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "c98f761b-9569-4bdc-bb41-87201d78ee1c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.853s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:05:34 user nova-compute[74247]: DEBUG nova.compute.manager [req-414ea09d-fba2-4f87-bedb-ca7df04cf5d0 req-fac43904-2d28-4358-ab44-574ef17a38f8 service nova] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Received event network-vif-plugged-ca03492e-c602-4ae1-ae43-63b37a989463 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:05:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-414ea09d-fba2-4f87-bedb-ca7df04cf5d0 req-fac43904-2d28-4358-ab44-574ef17a38f8 service nova] Acquiring lock "c98f761b-9569-4bdc-bb41-87201d78ee1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:05:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-414ea09d-fba2-4f87-bedb-ca7df04cf5d0 req-fac43904-2d28-4358-ab44-574ef17a38f8 service nova] Lock "c98f761b-9569-4bdc-bb41-87201d78ee1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:05:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-414ea09d-fba2-4f87-bedb-ca7df04cf5d0 req-fac43904-2d28-4358-ab44-574ef17a38f8 service nova] Lock "c98f761b-9569-4bdc-bb41-87201d78ee1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:05:34 user nova-compute[74247]: DEBUG nova.compute.manager [req-414ea09d-fba2-4f87-bedb-ca7df04cf5d0 req-fac43904-2d28-4358-ab44-574ef17a38f8 service nova] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] No waiting events found dispatching network-vif-plugged-ca03492e-c602-4ae1-ae43-63b37a989463 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:05:34 user nova-compute[74247]: WARNING nova.compute.manager [req-414ea09d-fba2-4f87-bedb-ca7df04cf5d0 req-fac43904-2d28-4358-ab44-574ef17a38f8 service nova] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Received unexpected event network-vif-plugged-ca03492e-c602-4ae1-ae43-63b37a989463 for instance with vm_state active and task_state None.
Oct 16 19:05:34 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:05:34 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Cleaning up deleted instances with incomplete migration  {{(pid=74247) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 16 19:05:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:35 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:05:35 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:05:35 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 19:05:37 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:40 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:42 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:05:42 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:05:44 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:05:44 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Cleaning up deleted instances {{(pid=74247) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 16 19:05:44 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] There are 0 instances to clean {{(pid=74247) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 16 19:05:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:05:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:05:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:05:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:05:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:52 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:05:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:06:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:06:02 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:06:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:06:07 user nova-compute[74247]: DEBUG nova.compute.manager [req-92002689-cb2e-4bdd-aa42-5ced62578a60 req-9a9d69fe-3d93-4166-842d-52e0c1da2346 service nova] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Received event network-changed-8a8fd51e-d098-4a89-80cd-eed88d8920a5 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:06:07 user nova-compute[74247]: DEBUG nova.compute.manager [req-92002689-cb2e-4bdd-aa42-5ced62578a60 req-9a9d69fe-3d93-4166-842d-52e0c1da2346 service nova] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Refreshing instance network info cache due to event network-changed-8a8fd51e-d098-4a89-80cd-eed88d8920a5. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 19:06:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-92002689-cb2e-4bdd-aa42-5ced62578a60 req-9a9d69fe-3d93-4166-842d-52e0c1da2346 service nova] Acquiring lock "refresh_cache-e506e951-e694-40bc-a91a-800ac91e658e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:06:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-92002689-cb2e-4bdd-aa42-5ced62578a60 req-9a9d69fe-3d93-4166-842d-52e0c1da2346 service nova] Acquired lock "refresh_cache-e506e951-e694-40bc-a91a-800ac91e658e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:06:07 user nova-compute[74247]: DEBUG nova.network.neutron [req-92002689-cb2e-4bdd-aa42-5ced62578a60 req-9a9d69fe-3d93-4166-842d-52e0c1da2346 service nova] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Refreshing network info cache for port 8a8fd51e-d098-4a89-80cd-eed88d8920a5 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 19:06:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "e506e951-e694-40bc-a91a-800ac91e658e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:06:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "e506e951-e694-40bc-a91a-800ac91e658e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:06:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "e506e951-e694-40bc-a91a-800ac91e658e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:06:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "e506e951-e694-40bc-a91a-800ac91e658e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:06:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "e506e951-e694-40bc-a91a-800ac91e658e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:06:07 user nova-compute[74247]: INFO nova.compute.manager [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Terminating instance
Oct 16 19:06:07 user nova-compute[74247]: DEBUG nova.compute.manager [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 19:06:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:06:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:06:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:06:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:06:07 user nova-compute[74247]: DEBUG nova.compute.manager [req-a551bb22-0b0f-4cce-ab74-39c3b853ccb2 req-516fddae-5033-49fa-8978-58123ac9185e service nova] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Received event network-vif-unplugged-8a8fd51e-d098-4a89-80cd-eed88d8920a5 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:06:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a551bb22-0b0f-4cce-ab74-39c3b853ccb2 req-516fddae-5033-49fa-8978-58123ac9185e service nova] Acquiring lock "e506e951-e694-40bc-a91a-800ac91e658e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:06:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a551bb22-0b0f-4cce-ab74-39c3b853ccb2 req-516fddae-5033-49fa-8978-58123ac9185e service nova] Lock "e506e951-e694-40bc-a91a-800ac91e658e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:06:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a551bb22-0b0f-4cce-ab74-39c3b853ccb2 req-516fddae-5033-49fa-8978-58123ac9185e service nova] Lock "e506e951-e694-40bc-a91a-800ac91e658e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:06:07 user nova-compute[74247]: DEBUG nova.compute.manager [req-a551bb22-0b0f-4cce-ab74-39c3b853ccb2 req-516fddae-5033-49fa-8978-58123ac9185e service nova] [instance: e506e951-e694-40bc-a91a-800ac91e658e] No waiting events found dispatching network-vif-unplugged-8a8fd51e-d098-4a89-80cd-eed88d8920a5 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:06:07 user nova-compute[74247]: DEBUG nova.compute.manager [req-a551bb22-0b0f-4cce-ab74-39c3b853ccb2 req-516fddae-5033-49fa-8978-58123ac9185e service nova] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Received event network-vif-unplugged-8a8fd51e-d098-4a89-80cd-eed88d8920a5 for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 19:06:07 user nova-compute[74247]: DEBUG nova.network.neutron [req-92002689-cb2e-4bdd-aa42-5ced62578a60 req-9a9d69fe-3d93-4166-842d-52e0c1da2346 service nova] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Updated VIF entry in instance network info cache for port 8a8fd51e-d098-4a89-80cd-eed88d8920a5. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 19:06:07 user nova-compute[74247]: DEBUG nova.network.neutron [req-92002689-cb2e-4bdd-aa42-5ced62578a60 req-9a9d69fe-3d93-4166-842d-52e0c1da2346 service nova] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Updating instance_info_cache with network_info: [{"id": "8a8fd51e-d098-4a89-80cd-eed88d8920a5", "address": "fa:16:3e:74:ff:9b", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a8fd51e-d0", "ovs_interfaceid": "8a8fd51e-d098-4a89-80cd-eed88d8920a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:06:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-92002689-cb2e-4bdd-aa42-5ced62578a60 req-9a9d69fe-3d93-4166-842d-52e0c1da2346 service nova] Releasing lock "refresh_cache-e506e951-e694-40bc-a91a-800ac91e658e" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:06:07 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Instance destroyed successfully.
Oct 16 19:06:07 user nova-compute[74247]: DEBUG nova.objects.instance [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lazy-loading 'resources' on Instance uuid e506e951-e694-40bc-a91a-800ac91e658e {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:06:07 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T19:00:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1342335122',display_name='tempest-TestVolumeBootPattern-server-1342335122',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1342335122',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjgu1PdB/VXTN5rZ7oE5e7ovtw+8pzQ24n8jIU2366r669SEEAxAB/9LNF+VOEmvr2qFXyje/n1vbSVuotOeSuaNNrodAuV6fmL4YsSSNhGH3oIDcKRDUc8ro4Dw/7HjQ==',key_name='tempest-TestVolumeBootPattern-34627609',keypairs=<?>,launch_index=0,launched_at=2023-10-16T19:01:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dca6144ea4e14c28b085e271175bbf67',ramdisk_id='',reservation_id='r-umw032rd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1733357121',owner_user_name='tempest-TestVolumeBootPattern-1733357121-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T19:01:20Z,user_data=None,user_id='9608bf58b70248439dbbcc9db38fba08',uuid=e506e951-e694-40bc-a91a-800ac91e658e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a8fd51e-d098-4a89-80cd-eed88d8920a5", "address": "fa:16:3e:74:ff:9b", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a8fd51e-d0", "ovs_interfaceid": "8a8fd51e-d098-4a89-80cd-eed88d8920a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 19:06:07 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Converting VIF {"id": "8a8fd51e-d098-4a89-80cd-eed88d8920a5", "address": "fa:16:3e:74:ff:9b", "network": {"id": "9688c665-d4b7-4179-9a76-fdf6c3013b1c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-155511944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca6144ea4e14c28b085e271175bbf67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a8fd51e-d0", "ovs_interfaceid": "8a8fd51e-d098-4a89-80cd-eed88d8920a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 19:06:07 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:ff:9b,bridge_name='br-int',has_traffic_filtering=True,id=8a8fd51e-d098-4a89-80cd-eed88d8920a5,network=Network(9688c665-d4b7-4179-9a76-fdf6c3013b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a8fd51e-d0') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 19:06:07 user nova-compute[74247]: DEBUG os_vif [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:ff:9b,bridge_name='br-int',has_traffic_filtering=True,id=8a8fd51e-d098-4a89-80cd-eed88d8920a5,network=Network(9688c665-d4b7-4179-9a76-fdf6c3013b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a8fd51e-d0') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 19:06:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:06:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a8fd51e-d0, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:06:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:06:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:06:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=20e9ccd2-672f-484a-8282-4e69c33627f6) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:06:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:06:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:06:07 user nova-compute[74247]: INFO os_vif [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:ff:9b,bridge_name='br-int',has_traffic_filtering=True,id=8a8fd51e-d098-4a89-80cd-eed88d8920a5,network=Network(9688c665-d4b7-4179-9a76-fdf6c3013b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a8fd51e-d0')
Oct 16 19:06:07 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e506e951-e694-40bc-a91a-800ac91e658e] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 19:06:07 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jYJEeRfp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 19:06:07 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 19:06:07 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 19:06:07 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 19:06:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:06:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:06:07 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e8f994-ad5a-4dfc-8cd1-fa9fd14016d5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:06:07 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 19:06:07 user nova-compute[74247]: No targets found.
Oct 16 19:06:07 user nova-compute[74247]: iSNS:
Oct 16 19:06:07 user nova-compute[74247]: No targets found.
Oct 16 19:06:07 user nova-compute[74247]: STATIC:
Oct 16 19:06:07 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec
Oct 16 19:06:07 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 19:06:07 user nova-compute[74247]:                 Iface Name: default
Oct 16 19:06:07 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317
Oct 16 19:06:07 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 19:06:07 user nova-compute[74247]:                 Iface Name: default
Oct 16 19:06:07 user nova-compute[74247]: FIRMWARE:
Oct 16 19:06:07 user nova-compute[74247]: No targets found.
Oct 16 19:06:07 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 19:06:07 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 19:06:07 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 19:06:07 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 19:06:07 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 19:06:07 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:06:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:06:08 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cb874c-b47c-47cd-98dc-04f5e179a79e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:06:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:06:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:06:08 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[945e9bf5-01a2-4538-aeb5-fef19ef29ca0]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:06:08 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)
Oct 16 19:06:08 user nova-compute[74247]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 (non-flash)
Oct 16 19:06:08 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 19:06:08 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec (non-flash)
Oct 16 19:06:08 user nova-compute[74247]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 (non-flash)
Oct 16 19:06:08 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 19:06:08 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe04879b250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec'): ({'sdb'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 19:06:08 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Removing single pathed devices sdb {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 19:06:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:06:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:06:08 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[58210160-7665-4270-8c98-032d9395ab6d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:06:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:06:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:06:08 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f39230-e828-4b9f-a539-cd4c9dd9dd47]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:06:08 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Flushing IO for device /dev/sdb {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 19:06:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:06:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:06:08 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6850dc3a-69a8-4911-91f6-697323698b2a]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:06:08 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 19:06:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:06:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:06:08 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af5b6f9-c1c4-411e-bc81-8f73f2fe76ee]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:06:08 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 19:06:08 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] SCSI volumes sdb have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 19:06:08 user nova-compute[74247]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_b1e16cec', '/dev/disk/by-id/scsi-1SCST_BIOb1e16cec-2ae35c5818c7c266', '/dev/disk/by-id/scsi-23261653335633538') {{(pid=85128) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 16 19:06:08 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[da623db6-492c-450e-b605-03c902edfbbd]: (4, None) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:06:08 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 19:06:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:06:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:06:08 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd1aa45-6615-46e4-85ea-7dc02c6f13b7]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:06:08 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:06:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:06:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:06:08 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3cd588-3227-49dc-a4a1-4e281bc7970a]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:06:08 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec, portal: 172.16.0.220,3260]
Oct 16 19:06:08 user nova-compute[74247]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec, portal: 172.16.0.220,3260] successful.
Oct 16 19:06:08 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:06:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:06:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16745855-2614-4ce8-a013-451d116c1dec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:06:08 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71c0ffb-672a-44ba-8d38-b8eba49f54de]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:06:08 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:06:08 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 19:06:08 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] <== disconnect_volume: return (298ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 19:06:08 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 19:06:08 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Deleting instance files /opt/stack/data/nova/instances/e506e951-e694-40bc-a91a-800ac91e658e_del
Oct 16 19:06:08 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Deletion of /opt/stack/data/nova/instances/e506e951-e694-40bc-a91a-800ac91e658e_del complete
Oct 16 19:06:08 user nova-compute[74247]: INFO nova.compute.manager [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Took 1.15 seconds to destroy the instance on the hypervisor.
Oct 16 19:06:08 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 19:06:08 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 19:06:08 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: e506e951-e694-40bc-a91a-800ac91e658e] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 19:06:08 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:06:08 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Took 0.46 seconds to deallocate network for instance.
Oct 16 19:06:09 user nova-compute[74247]: DEBUG nova.compute.manager [req-2fed31b3-ffb5-47f3-8b45-25110eff4dcf req-07ce76b4-60ad-499d-a286-912363ce0556 service nova] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Received event network-vif-plugged-8a8fd51e-d098-4a89-80cd-eed88d8920a5 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:06:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-2fed31b3-ffb5-47f3-8b45-25110eff4dcf req-07ce76b4-60ad-499d-a286-912363ce0556 service nova] Acquiring lock "e506e951-e694-40bc-a91a-800ac91e658e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:06:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-2fed31b3-ffb5-47f3-8b45-25110eff4dcf req-07ce76b4-60ad-499d-a286-912363ce0556 service nova] Lock "e506e951-e694-40bc-a91a-800ac91e658e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:06:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-2fed31b3-ffb5-47f3-8b45-25110eff4dcf req-07ce76b4-60ad-499d-a286-912363ce0556 service nova] Lock "e506e951-e694-40bc-a91a-800ac91e658e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:06:09 user nova-compute[74247]: DEBUG nova.compute.manager [req-2fed31b3-ffb5-47f3-8b45-25110eff4dcf req-07ce76b4-60ad-499d-a286-912363ce0556 service nova] [instance: e506e951-e694-40bc-a91a-800ac91e658e] No waiting events found dispatching network-vif-plugged-8a8fd51e-d098-4a89-80cd-eed88d8920a5 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:06:09 user nova-compute[74247]: WARNING nova.compute.manager [req-2fed31b3-ffb5-47f3-8b45-25110eff4dcf req-07ce76b4-60ad-499d-a286-912363ce0556 service nova] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Received unexpected event network-vif-plugged-8a8fd51e-d098-4a89-80cd-eed88d8920a5 for instance with vm_state active and task_state deleting.
Oct 16 19:06:09 user nova-compute[74247]: DEBUG nova.compute.manager [req-2fed31b3-ffb5-47f3-8b45-25110eff4dcf req-07ce76b4-60ad-499d-a286-912363ce0556 service nova] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Received event network-vif-deleted-8a8fd51e-d098-4a89-80cd-eed88d8920a5 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:06:09 user nova-compute[74247]: INFO nova.compute.manager [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] [instance: e506e951-e694-40bc-a91a-800ac91e658e] Took 0.84 seconds to detach 1 volumes for instance.
Oct 16 19:06:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:06:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:06:09 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Refreshing inventories for resource provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 16 19:06:09 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Updating ProviderTree inventory for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 16 19:06:09 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Updating inventory in ProviderTree for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 16 19:06:09 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Refreshing aggregate associations for resource provider 7b8a7b7b-c686-4162-903b-700fbc4d7273, aggregates: None {{(pid=74247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 16 19:06:09 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Refreshing trait associations for resource provider 7b8a7b7b-c686-4162-903b-700fbc4d7273, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=74247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 16 19:06:09 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 19:06:09 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 19:06:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.325s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:06:10 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Deleted allocations for instance e506e951-e694-40bc-a91a-800ac91e658e
Oct 16 19:06:10 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-5ecc83dd-1177-4802-abfe-ab226731f95a tempest-TestVolumeBootPattern-1733357121 tempest-TestVolumeBootPattern-1733357121-project-member] Lock "e506e951-e694-40bc-a91a-800ac91e658e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.946s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:06:12 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:06:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:06:20 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:06:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:06:24 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:06:25 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:06:27 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:06:27 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:06:27 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:06:27 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:06:27 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 19:06:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c98f761b-9569-4bdc-bb41-87201d78ee1c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:06:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c98f761b-9569-4bdc-bb41-87201d78ee1c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:06:27 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c98f761b-9569-4bdc-bb41-87201d78ee1c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:06:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:06:28 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c98f761b-9569-4bdc-bb41-87201d78ee1c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:06:28 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:06:28 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:06:28 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:06:28 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:06:28 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 19:06:28 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:06:28 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:06:28 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=8755MB free_disk=24.865638732910156GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 19:06:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:06:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:06:28 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 68edbfa7-0752-42fb-bad8-eb7121796e9f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 19:06:28 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance c98f761b-9569-4bdc-bb41-87201d78ee1c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 19:06:28 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 19:06:28 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 19:06:28 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 19:06:28 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 19:06:29 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 19:06:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.213s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:06:31 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:06:31 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 19:06:31 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Didn't find any instances for network info cache update. {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 19:06:31 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:06:31 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:06:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:06:35 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:06:36 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:06:36 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 19:06:37 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:06:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:06:43 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:06:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:06:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:06:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:06:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:06:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:06:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:06:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:06:49 user nova-compute[74247]: DEBUG nova.compute.manager [req-aed50f14-b941-46d1-9adb-81149fff7b3f req-1758cf80-b16e-40cc-a572-a498b1012b4e service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Received event network-changed-1e4186ff-26a0-43b8-8b0a-2f62eb718451 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:06:49 user nova-compute[74247]: DEBUG nova.compute.manager [req-aed50f14-b941-46d1-9adb-81149fff7b3f req-1758cf80-b16e-40cc-a572-a498b1012b4e service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Refreshing instance network info cache due to event network-changed-1e4186ff-26a0-43b8-8b0a-2f62eb718451. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 19:06:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-aed50f14-b941-46d1-9adb-81149fff7b3f req-1758cf80-b16e-40cc-a572-a498b1012b4e service nova] Acquiring lock "refresh_cache-68edbfa7-0752-42fb-bad8-eb7121796e9f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:06:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-aed50f14-b941-46d1-9adb-81149fff7b3f req-1758cf80-b16e-40cc-a572-a498b1012b4e service nova] Acquired lock "refresh_cache-68edbfa7-0752-42fb-bad8-eb7121796e9f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:06:49 user nova-compute[74247]: DEBUG nova.network.neutron [req-aed50f14-b941-46d1-9adb-81149fff7b3f req-1758cf80-b16e-40cc-a572-a498b1012b4e service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Refreshing network info cache for port 1e4186ff-26a0-43b8-8b0a-2f62eb718451 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 19:06:49 user nova-compute[74247]: DEBUG nova.network.neutron [req-aed50f14-b941-46d1-9adb-81149fff7b3f req-1758cf80-b16e-40cc-a572-a498b1012b4e service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Updated VIF entry in instance network info cache for port 1e4186ff-26a0-43b8-8b0a-2f62eb718451. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 19:06:49 user nova-compute[74247]: DEBUG nova.network.neutron [req-aed50f14-b941-46d1-9adb-81149fff7b3f req-1758cf80-b16e-40cc-a572-a498b1012b4e service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Updating instance_info_cache with network_info: [{"id": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "address": "fa:16:3e:ae:24:ed", "network": {"id": "5801391d-4968-4504-9f23-8683eeb63a54", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2082110052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cb6a3c6bdd484d9a8d0c27bf1ac2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e4186ff-26", "ovs_interfaceid": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:06:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-aed50f14-b941-46d1-9adb-81149fff7b3f req-1758cf80-b16e-40cc-a572-a498b1012b4e service nova] Releasing lock "refresh_cache-68edbfa7-0752-42fb-bad8-eb7121796e9f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:06:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4002dca5-7250-4d6f-b333-320854e3c3aa tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Acquiring lock "68edbfa7-0752-42fb-bad8-eb7121796e9f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:06:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4002dca5-7250-4d6f-b333-320854e3c3aa tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "68edbfa7-0752-42fb-bad8-eb7121796e9f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:06:51 user nova-compute[74247]: INFO nova.compute.manager [None req-4002dca5-7250-4d6f-b333-320854e3c3aa tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Detaching volume cfc1e0e6-3cb8-4c38-a36c-7636f3e35317
Oct 16 19:06:51 user nova-compute[74247]: INFO nova.virt.block_device [None req-4002dca5-7250-4d6f-b333-320854e3c3aa tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Attempting to driver detach volume cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 from mountpoint /dev/vdb
Oct 16 19:06:51 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4002dca5-7250-4d6f-b333-320854e3c3aa tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Attempting to detach device vdb from instance 68edbfa7-0752-42fb-bad8-eb7121796e9f from the persistent domain config. {{(pid=74247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 19:06:51 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-4002dca5-7250-4d6f-b333-320854e3c3aa tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 19:06:51 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 19:06:51 user nova-compute[74247]:   <source dev="/dev/sdc"/>
Oct 16 19:06:51 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 19:06:51 user nova-compute[74247]:   <serial>cfc1e0e6-3cb8-4c38-a36c-7636f3e35317</serial>
Oct 16 19:06:51 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 16 19:06:51 user nova-compute[74247]: </disk>
Oct 16 19:06:51 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 19:06:51 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-4002dca5-7250-4d6f-b333-320854e3c3aa tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Successfully detached device vdb from instance 68edbfa7-0752-42fb-bad8-eb7121796e9f from the persistent domain config.
Oct 16 19:06:51 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4002dca5-7250-4d6f-b333-320854e3c3aa tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 68edbfa7-0752-42fb-bad8-eb7121796e9f from the live domain config. {{(pid=74247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 19:06:51 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-4002dca5-7250-4d6f-b333-320854e3c3aa tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 19:06:51 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 19:06:51 user nova-compute[74247]:   <source dev="/dev/sdc"/>
Oct 16 19:06:51 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 19:06:51 user nova-compute[74247]:   <serial>cfc1e0e6-3cb8-4c38-a36c-7636f3e35317</serial>
Oct 16 19:06:51 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 16 19:06:51 user nova-compute[74247]: </disk>
Oct 16 19:06:51 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 19:06:51 user nova-compute[74247]: DEBUG nova.compute.manager [req-bfdb12a4-30bc-4aa9-b3b6-ce42a0e5cb66 req-d84a7448-19f6-4586-b490-ec79b5979f28 service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Received event network-changed-1e4186ff-26a0-43b8-8b0a-2f62eb718451 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:06:51 user nova-compute[74247]: DEBUG nova.compute.manager [req-bfdb12a4-30bc-4aa9-b3b6-ce42a0e5cb66 req-d84a7448-19f6-4586-b490-ec79b5979f28 service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Refreshing instance network info cache due to event network-changed-1e4186ff-26a0-43b8-8b0a-2f62eb718451. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 19:06:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-bfdb12a4-30bc-4aa9-b3b6-ce42a0e5cb66 req-d84a7448-19f6-4586-b490-ec79b5979f28 service nova] Acquiring lock "refresh_cache-68edbfa7-0752-42fb-bad8-eb7121796e9f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:06:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-bfdb12a4-30bc-4aa9-b3b6-ce42a0e5cb66 req-d84a7448-19f6-4586-b490-ec79b5979f28 service nova] Acquired lock "refresh_cache-68edbfa7-0752-42fb-bad8-eb7121796e9f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:06:51 user nova-compute[74247]: DEBUG nova.network.neutron [req-bfdb12a4-30bc-4aa9-b3b6-ce42a0e5cb66 req-d84a7448-19f6-4586-b490-ec79b5979f28 service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Refreshing network info cache for port 1e4186ff-26a0-43b8-8b0a-2f62eb718451 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 19:06:51 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4002dca5-7250-4d6f-b333-320854e3c3aa tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 68edbfa7-0752-42fb-bad8-eb7121796e9f {{(pid=74247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 19:06:51 user nova-compute[74247]: DEBUG nova.network.neutron [req-bfdb12a4-30bc-4aa9-b3b6-ce42a0e5cb66 req-d84a7448-19f6-4586-b490-ec79b5979f28 service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Updated VIF entry in instance network info cache for port 1e4186ff-26a0-43b8-8b0a-2f62eb718451. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 19:06:51 user nova-compute[74247]: DEBUG nova.network.neutron [req-bfdb12a4-30bc-4aa9-b3b6-ce42a0e5cb66 req-d84a7448-19f6-4586-b490-ec79b5979f28 service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Updating instance_info_cache with network_info: [{"id": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "address": "fa:16:3e:ae:24:ed", "network": {"id": "5801391d-4968-4504-9f23-8683eeb63a54", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2082110052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cb6a3c6bdd484d9a8d0c27bf1ac2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e4186ff-26", "ovs_interfaceid": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:06:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-bfdb12a4-30bc-4aa9-b3b6-ce42a0e5cb66 req-d84a7448-19f6-4586-b490-ec79b5979f28 service nova] Releasing lock "refresh_cache-68edbfa7-0752-42fb-bad8-eb7121796e9f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:06:52 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:06:52 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:06:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:07:02 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:07:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:07:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:07:11 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4002dca5-7250-4d6f-b333-320854e3c3aa tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 68edbfa7-0752-42fb-bad8-eb7121796e9f is timed out.
Oct 16 19:07:11 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-4002dca5-7250-4d6f-b333-320854e3c3aa tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Successfully detached device vdb from instance 68edbfa7-0752-42fb-bad8-eb7121796e9f from the live domain config.
Oct 16 19:07:11 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4002dca5-7250-4d6f-b333-320854e3c3aa tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4002dca5-7250-4d6f-b333-320854e3c3aa tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FBWoyVtI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 19:07:11 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-4002dca5-7250-4d6f-b333-320854e3c3aa tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 19:07:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-4002dca5-7250-4d6f-b333-320854e3c3aa tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-4002dca5-7250-4d6f-b333-320854e3c3aa tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60fa24f-9913-4819-a2a7-77bfc25de684]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4002dca5-7250-4d6f-b333-320854e3c3aa tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 19:07:11 user nova-compute[74247]: No targets found.
Oct 16 19:07:11 user nova-compute[74247]: iSNS:
Oct 16 19:07:11 user nova-compute[74247]: No targets found.
Oct 16 19:07:11 user nova-compute[74247]: STATIC:
Oct 16 19:07:11 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317
Oct 16 19:07:11 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 19:07:11 user nova-compute[74247]:                 Iface Name: default
Oct 16 19:07:11 user nova-compute[74247]: FIRMWARE:
Oct 16 19:07:11 user nova-compute[74247]: No targets found.
Oct 16 19:07:11 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4002dca5-7250-4d6f-b333-320854e3c3aa tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 19:07:11 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 19:07:11 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4002dca5-7250-4d6f-b333-320854e3c3aa tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4a4b24-3316-4b39-9d46-91f9fc8f2979]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc77d77-ef00-4ba4-9a8e-3b95414b73fc]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4002dca5-7250-4d6f-b333-320854e3c3aa tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 (non-flash)
Oct 16 19:07:11 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4002dca5-7250-4d6f-b333-320854e3c3aa tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 (non-flash)
Oct 16 19:07:11 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4002dca5-7250-4d6f-b333-320854e3c3aa tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe06810f910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317'): ({'sdc'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-4002dca5-7250-4d6f-b333-320854e3c3aa tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Removing single pathed devices sdc {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5749ec-e893-4870-a209-7529790df111]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f705b2fb-50e2-43fa-bdf2-c5d6475221e2]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-4002dca5-7250-4d6f-b333-320854e3c3aa tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Flushing IO for device /dev/sdc {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc939bd-360e-49c8-bad2-eef495e8b6bb]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-4002dca5-7250-4d6f-b333-320854e3c3aa tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f0e5f4-78ef-4800-a704-163f88f0eb20]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-4002dca5-7250-4d6f-b333-320854e3c3aa tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-4002dca5-7250-4d6f-b333-320854e3c3aa tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] SCSI volumes sdc have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4002dca5-7250-4d6f-b333-320854e3c3aa tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4e4053-88ba-4627-a98c-2465890dafa0]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4002dca5-7250-4d6f-b333-320854e3c3aa tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d65d3b8-ccb0-457c-afa7-9d8144d515dc]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4002dca5-7250-4d6f-b333-320854e3c3aa tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317, portal: 172.16.0.220,3260]
Oct 16 19:07:11 user nova-compute[74247]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317, portal: 172.16.0.220,3260] successful.
Oct 16 19:07:11 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfc1e0e6-3cb8-4c38-a36c-7636f3e35317 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e0ad4f-fb7b-44cd-8cde-bccc7a23a5e4]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4002dca5-7250-4d6f-b333-320854e3c3aa tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-4002dca5-7250-4d6f-b333-320854e3c3aa tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4002dca5-7250-4d6f-b333-320854e3c3aa tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] <== disconnect_volume: return (279ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 19:07:11 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4002dca5-7250-4d6f-b333-320854e3c3aa tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 19:07:12 user nova-compute[74247]: DEBUG nova.objects.instance [None req-4002dca5-7250-4d6f-b333-320854e3c3aa tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lazy-loading 'flavor' on Instance uuid 68edbfa7-0752-42fb-bad8-eb7121796e9f {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:07:12 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4002dca5-7250-4d6f-b333-320854e3c3aa tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "68edbfa7-0752-42fb-bad8-eb7121796e9f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.786s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:07:12 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:07:12 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:07:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:07:19 user nova-compute[74247]: DEBUG nova.compute.manager [req-f9250f49-9fc7-47c3-8296-9c371a21a523 req-73444343-a608-4be9-9573-3e6f86c3d657 service nova] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Received event network-changed-ca03492e-c602-4ae1-ae43-63b37a989463 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:07:19 user nova-compute[74247]: DEBUG nova.compute.manager [req-f9250f49-9fc7-47c3-8296-9c371a21a523 req-73444343-a608-4be9-9573-3e6f86c3d657 service nova] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Refreshing instance network info cache due to event network-changed-ca03492e-c602-4ae1-ae43-63b37a989463. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 19:07:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f9250f49-9fc7-47c3-8296-9c371a21a523 req-73444343-a608-4be9-9573-3e6f86c3d657 service nova] Acquiring lock "refresh_cache-c98f761b-9569-4bdc-bb41-87201d78ee1c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:07:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f9250f49-9fc7-47c3-8296-9c371a21a523 req-73444343-a608-4be9-9573-3e6f86c3d657 service nova] Acquired lock "refresh_cache-c98f761b-9569-4bdc-bb41-87201d78ee1c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:07:19 user nova-compute[74247]: DEBUG nova.network.neutron [req-f9250f49-9fc7-47c3-8296-9c371a21a523 req-73444343-a608-4be9-9573-3e6f86c3d657 service nova] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Refreshing network info cache for port ca03492e-c602-4ae1-ae43-63b37a989463 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 19:07:20 user nova-compute[74247]: DEBUG nova.network.neutron [req-f9250f49-9fc7-47c3-8296-9c371a21a523 req-73444343-a608-4be9-9573-3e6f86c3d657 service nova] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Updated VIF entry in instance network info cache for port ca03492e-c602-4ae1-ae43-63b37a989463. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 19:07:20 user nova-compute[74247]: DEBUG nova.network.neutron [req-f9250f49-9fc7-47c3-8296-9c371a21a523 req-73444343-a608-4be9-9573-3e6f86c3d657 service nova] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Updating instance_info_cache with network_info: [{"id": "ca03492e-c602-4ae1-ae43-63b37a989463", "address": "fa:16:3e:34:00:5c", "network": {"id": "baf3f2f3-1b8b-4c83-b488-9e7bd2323e54", "bridge": "br-int", "label": "tempest-TestStampPattern-1706551992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c41a39f4784703bcad1f7591a76d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca03492e-c6", "ovs_interfaceid": "ca03492e-c602-4ae1-ae43-63b37a989463", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:07:20 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f9250f49-9fc7-47c3-8296-9c371a21a523 req-73444343-a608-4be9-9573-3e6f86c3d657 service nova] Releasing lock "refresh_cache-c98f761b-9569-4bdc-bb41-87201d78ee1c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:07:20 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:07:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Acquiring lock "c98f761b-9569-4bdc-bb41-87201d78ee1c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:07:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "c98f761b-9569-4bdc-bb41-87201d78ee1c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:07:21 user nova-compute[74247]: DEBUG nova.objects.instance [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lazy-loading 'flavor' on Instance uuid c98f761b-9569-4bdc-bb41-87201d78ee1c {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:07:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "c98f761b-9569-4bdc-bb41-87201d78ee1c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:07:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Acquiring lock "c98f761b-9569-4bdc-bb41-87201d78ee1c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:07:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "c98f761b-9569-4bdc-bb41-87201d78ee1c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:07:21 user nova-compute[74247]: INFO nova.compute.manager [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Attaching volume 004f04f9-a0cf-4645-afb9-d673ecdea1a7 to /dev/vdb
Oct 16 19:07:21 user nova-compute[74247]: DEBUG os_brick.utils [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 19:07:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:07:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:07:21 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7692ec9-17a9-4c00-96e7-c8a92488fc59]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:07:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:07:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:07:21 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f28cb61-67fa-4151-a8c2-deb6d620a2c7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:07:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:07:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:07:21 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[93745c62-2cbc-43a6-b7f5-0d7769128825]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:07:21 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba13c15-dacb-4902-9afa-89a7e64bca6b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:07:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:07:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 19:07:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 19:07:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:07:21 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 19:07:21 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 19:07:21 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98c88cb-d688-4dd4-8bf1-e00f778e93c2]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:07:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 19:07:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 19:07:21 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 19:07:21 user nova-compute[74247]: DEBUG os_brick.utils [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 19:07:21 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Updating existing volume attachment record: 7d5d0688-2335-4ac5-b661-68df4fa2c7b5 {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 19:07:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:07:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:07:26 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:07:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:07:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:07:28 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:07:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:07:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:07:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:07:28 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 19:07:28 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c98f761b-9569-4bdc-bb41-87201d78ee1c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:07:28 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c98f761b-9569-4bdc-bb41-87201d78ee1c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:07:28 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c98f761b-9569-4bdc-bb41-87201d78ee1c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:07:29 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c98f761b-9569-4bdc-bb41-87201d78ee1c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:07:29 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:07:29 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:07:29 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:07:29 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:07:29 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:07:29 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:07:29 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=8827MB free_disk=24.863994598388672GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 19:07:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:07:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:07:29 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 68edbfa7-0752-42fb-bad8-eb7121796e9f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 19:07:29 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance c98f761b-9569-4bdc-bb41-87201d78ee1c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 19:07:29 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 19:07:29 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 19:07:30 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 19:07:30 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 19:07:30 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 19:07:30 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.226s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:07:32 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:07:32 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 19:07:32 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Rebuilding the list of instances to heal {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 19:07:32 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "refresh_cache-68edbfa7-0752-42fb-bad8-eb7121796e9f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:07:32 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquired lock "refresh_cache-68edbfa7-0752-42fb-bad8-eb7121796e9f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:07:32 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Forcefully refreshing network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 19:07:32 user nova-compute[74247]: DEBUG nova.objects.instance [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lazy-loading 'info_cache' on Instance uuid 68edbfa7-0752-42fb-bad8-eb7121796e9f {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:07:32 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Updating instance_info_cache with network_info: [{"id": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "address": "fa:16:3e:ae:24:ed", "network": {"id": "5801391d-4968-4504-9f23-8683eeb63a54", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2082110052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cb6a3c6bdd484d9a8d0c27bf1ac2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e4186ff-26", "ovs_interfaceid": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:07:32 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Releasing lock "refresh_cache-68edbfa7-0752-42fb-bad8-eb7121796e9f" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:07:32 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Updated the network info_cache for instance {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 19:07:32 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:07:32 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:07:32 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'guwUXbPm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 19:07:37 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 19:07:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 19:07:37 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 19:07:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 19:07:37 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 19:07:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7 -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9b3e80-47d9-441c-a57b-77f6c1d8cbc9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 19:07:37 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b467d3-06c5-425a-ad0b-3003a8fb32b6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7] added
Oct 16 19:07:37 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec2ef7a-83ec-4f33-991e-7d471be09de7]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a831abb-52c6-42d4-b5b6-1ec78b52fd7a]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v guwUXbPm {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v guwUXbPm" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[701b8d43-bf29-416e-b921-63ea7f3c48ce]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'guwUXbPm'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[129af086-3743-415c-8f41-c9c198f6a698]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4db623-9120-44ff-93c0-20e6caaca3db]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 16 19:07:37 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 16 19:07:37 user nova-compute[74247]:  {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 19:07:37 user nova-compute[74247]: WARNING os_brick.initiator.connectors.iscsi [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 16 19:07:37 user nova-compute[74247]: 
Oct 16 19:07:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7 -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[170e6e02-3eac-4c4e-acba-c0433218e33c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7, portal: 172.16.0.220,3260]
Oct 16 19:07:37 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7, portal: 172.16.0.220,3260] successful.
Oct 16 19:07:37 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5698fc6c-8b60-4984-9b6f-f192fb8d6df1]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b953eaf7-5dc2-467d-bd41-ecc4eb41d9ec]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7 (non-flash)
Oct 16 19:07:37 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7 (non-flash)
Oct 16 19:07:37 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.233s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ced48b-154b-4189-8b89-7355cda54a0c]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: None {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 19:07:37 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:07:38 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 19:07:38 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'guwUXbPm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 19:07:38 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.262s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 19:07:38 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] <== connect_volume: return (1264ms) {'type': 'block', 'scsi_wwn': '26462636139336466', 'path': '/dev/sdb'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 19:07:38 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462636139336466', 'path': '/dev/sdb'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 19:07:38 user nova-compute[74247]: DEBUG nova.objects.instance [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lazy-loading 'flavor' on Instance uuid c98f761b-9569-4bdc-bb41-87201d78ee1c {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:07:38 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 19:07:38 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 19:07:38 user nova-compute[74247]:   <source dev="/dev/sdb"/>
Oct 16 19:07:38 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 19:07:38 user nova-compute[74247]:   <serial>004f04f9-a0cf-4645-afb9-d673ecdea1a7</serial>
Oct 16 19:07:38 user nova-compute[74247]: </disk>
Oct 16 19:07:38 user nova-compute[74247]:  {{(pid=74247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 19:07:38 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 19:07:38 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 19:07:38 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] No VIF found with MAC fa:16:3e:34:00:5c, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 19:07:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-bc857fd0-0458-4ea0-af21-6842a9ba6398 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "c98f761b-9569-4bdc-bb41-87201d78ee1c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.445s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:07:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0b64cfbf-f639-49da-a545-c3f7b823f220 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Acquiring lock "c98f761b-9569-4bdc-bb41-87201d78ee1c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:07:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0b64cfbf-f639-49da-a545-c3f7b823f220 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "c98f761b-9569-4bdc-bb41-87201d78ee1c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:07:41 user nova-compute[74247]: INFO nova.compute.manager [None req-0b64cfbf-f639-49da-a545-c3f7b823f220 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Detaching volume 004f04f9-a0cf-4645-afb9-d673ecdea1a7
Oct 16 19:07:41 user nova-compute[74247]: INFO nova.virt.block_device [None req-0b64cfbf-f639-49da-a545-c3f7b823f220 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Attempting to driver detach volume 004f04f9-a0cf-4645-afb9-d673ecdea1a7 from mountpoint /dev/vdb
Oct 16 19:07:41 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0b64cfbf-f639-49da-a545-c3f7b823f220 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Attempting to detach device vdb from instance c98f761b-9569-4bdc-bb41-87201d78ee1c from the persistent domain config. {{(pid=74247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 19:07:41 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-0b64cfbf-f639-49da-a545-c3f7b823f220 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 19:07:41 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 19:07:41 user nova-compute[74247]:   <source dev="/dev/sdb"/>
Oct 16 19:07:41 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 19:07:41 user nova-compute[74247]:   <serial>004f04f9-a0cf-4645-afb9-d673ecdea1a7</serial>
Oct 16 19:07:41 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 19:07:41 user nova-compute[74247]: </disk>
Oct 16 19:07:41 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 19:07:41 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-0b64cfbf-f639-49da-a545-c3f7b823f220 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Successfully detached device vdb from instance c98f761b-9569-4bdc-bb41-87201d78ee1c from the persistent domain config.
Oct 16 19:07:41 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0b64cfbf-f639-49da-a545-c3f7b823f220 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c98f761b-9569-4bdc-bb41-87201d78ee1c from the live domain config. {{(pid=74247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 19:07:41 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-0b64cfbf-f639-49da-a545-c3f7b823f220 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 19:07:41 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 19:07:41 user nova-compute[74247]:   <source dev="/dev/sdb"/>
Oct 16 19:07:41 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 19:07:41 user nova-compute[74247]:   <serial>004f04f9-a0cf-4645-afb9-d673ecdea1a7</serial>
Oct 16 19:07:41 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 19:07:41 user nova-compute[74247]: </disk>
Oct 16 19:07:41 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 19:07:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:07:42 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0b64cfbf-f639-49da-a545-c3f7b823f220 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c98f761b-9569-4bdc-bb41-87201d78ee1c {{(pid=74247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 19:07:43 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:07:44 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:07:48 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:07:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-9d33aac0-7fcb-418b-85f4-2efd7953f52c tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Acquiring lock "68edbfa7-0752-42fb-bad8-eb7121796e9f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:07:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-9d33aac0-7fcb-418b-85f4-2efd7953f52c tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "68edbfa7-0752-42fb-bad8-eb7121796e9f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:07:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-9d33aac0-7fcb-418b-85f4-2efd7953f52c tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Acquiring lock "68edbfa7-0752-42fb-bad8-eb7121796e9f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:07:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-9d33aac0-7fcb-418b-85f4-2efd7953f52c tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "68edbfa7-0752-42fb-bad8-eb7121796e9f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:07:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-9d33aac0-7fcb-418b-85f4-2efd7953f52c tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "68edbfa7-0752-42fb-bad8-eb7121796e9f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:07:50 user nova-compute[74247]: INFO nova.compute.manager [None req-9d33aac0-7fcb-418b-85f4-2efd7953f52c tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Terminating instance
Oct 16 19:07:50 user nova-compute[74247]: DEBUG nova.compute.manager [None req-9d33aac0-7fcb-418b-85f4-2efd7953f52c tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 19:07:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:07:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:07:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:07:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:07:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:07:50 user nova-compute[74247]: DEBUG nova.compute.manager [req-dc3d4e17-970f-41f6-8764-2977e35769b2 req-ec6d19c2-68b3-4764-9aa6-95145cf29b46 service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Received event network-vif-unplugged-1e4186ff-26a0-43b8-8b0a-2f62eb718451 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:07:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-dc3d4e17-970f-41f6-8764-2977e35769b2 req-ec6d19c2-68b3-4764-9aa6-95145cf29b46 service nova] Acquiring lock "68edbfa7-0752-42fb-bad8-eb7121796e9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:07:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-dc3d4e17-970f-41f6-8764-2977e35769b2 req-ec6d19c2-68b3-4764-9aa6-95145cf29b46 service nova] Lock "68edbfa7-0752-42fb-bad8-eb7121796e9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:07:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-dc3d4e17-970f-41f6-8764-2977e35769b2 req-ec6d19c2-68b3-4764-9aa6-95145cf29b46 service nova] Lock "68edbfa7-0752-42fb-bad8-eb7121796e9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:07:50 user nova-compute[74247]: DEBUG nova.compute.manager [req-dc3d4e17-970f-41f6-8764-2977e35769b2 req-ec6d19c2-68b3-4764-9aa6-95145cf29b46 service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] No waiting events found dispatching network-vif-unplugged-1e4186ff-26a0-43b8-8b0a-2f62eb718451 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:07:50 user nova-compute[74247]: DEBUG nova.compute.manager [req-dc3d4e17-970f-41f6-8764-2977e35769b2 req-ec6d19c2-68b3-4764-9aa6-95145cf29b46 service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Received event network-vif-unplugged-1e4186ff-26a0-43b8-8b0a-2f62eb718451 for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 19:07:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:07:50 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Instance destroyed successfully.
Oct 16 19:07:50 user nova-compute[74247]: DEBUG nova.objects.instance [None req-9d33aac0-7fcb-418b-85f4-2efd7953f52c tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lazy-loading 'resources' on Instance uuid 68edbfa7-0752-42fb-bad8-eb7121796e9f {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:07:50 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-9d33aac0-7fcb-418b-85f4-2efd7953f52c tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T19:02:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1906922734',display_name='tempest-TestMinimumBasicScenario-server-1906922734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1906922734',id=47,image_ref='46d6f108-3b2e-41c3-8694-65606e2769ee',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1caxevCdksN3AlmBdVwZfiOOScHN4VaKza+143cbh60V4VUdpuh75jnICCBVrEWNOsZzHUyPA9sdF/wl46FD7/FpfokUQQw4OLB6uN6SSD+v6cZrKs558k5Gsx5iCxEQ==',key_name='tempest-TestMinimumBasicScenario-344900198',keypairs=<?>,launch_index=0,launched_at=2023-10-16T19:02:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42cb6a3c6bdd484d9a8d0c27bf1ac2fb',ramdisk_id='',reservation_id='r-47ytcjou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='46d6f108-3b2e-41c3-8694-65606e2769ee',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-218992455',owner_user_name='tempest-TestMinimumBasicScenario-218992455-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T19:05:05Z,user_data=None,user_id='7414f773f7a94a13938c406bf02b3bac',uuid=68edbfa7-0752-42fb-bad8-eb7121796e9f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "address": "fa:16:3e:ae:24:ed", "network": {"id": "5801391d-4968-4504-9f23-8683eeb63a54", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2082110052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cb6a3c6bdd484d9a8d0c27bf1ac2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e4186ff-26", "ovs_interfaceid": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 19:07:50 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-9d33aac0-7fcb-418b-85f4-2efd7953f52c tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Converting VIF {"id": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "address": "fa:16:3e:ae:24:ed", "network": {"id": "5801391d-4968-4504-9f23-8683eeb63a54", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2082110052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cb6a3c6bdd484d9a8d0c27bf1ac2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e4186ff-26", "ovs_interfaceid": "1e4186ff-26a0-43b8-8b0a-2f62eb718451", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 19:07:50 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-9d33aac0-7fcb-418b-85f4-2efd7953f52c tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:24:ed,bridge_name='br-int',has_traffic_filtering=True,id=1e4186ff-26a0-43b8-8b0a-2f62eb718451,network=Network(5801391d-4968-4504-9f23-8683eeb63a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e4186ff-26') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 19:07:50 user nova-compute[74247]: DEBUG os_vif [None req-9d33aac0-7fcb-418b-85f4-2efd7953f52c tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:24:ed,bridge_name='br-int',has_traffic_filtering=True,id=1e4186ff-26a0-43b8-8b0a-2f62eb718451,network=Network(5801391d-4968-4504-9f23-8683eeb63a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e4186ff-26') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 19:07:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:07:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e4186ff-26, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:07:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:07:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:07:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=547ac91e-266f-40f3-b1cc-15c9677fc738) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:07:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:07:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:07:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:07:50 user nova-compute[74247]: INFO os_vif [None req-9d33aac0-7fcb-418b-85f4-2efd7953f52c tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:24:ed,bridge_name='br-int',has_traffic_filtering=True,id=1e4186ff-26a0-43b8-8b0a-2f62eb718451,network=Network(5801391d-4968-4504-9f23-8683eeb63a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e4186ff-26')
Oct 16 19:07:50 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-9d33aac0-7fcb-418b-85f4-2efd7953f52c tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Deleting instance files /opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f_del
Oct 16 19:07:50 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-9d33aac0-7fcb-418b-85f4-2efd7953f52c tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Deletion of /opt/stack/data/nova/instances/68edbfa7-0752-42fb-bad8-eb7121796e9f_del complete
Oct 16 19:07:51 user nova-compute[74247]: INFO nova.compute.manager [None req-9d33aac0-7fcb-418b-85f4-2efd7953f52c tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 16 19:07:51 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-9d33aac0-7fcb-418b-85f4-2efd7953f52c tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 19:07:51 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 19:07:51 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 19:07:51 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:07:51 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Took 0.43 seconds to deallocate network for instance.
Oct 16 19:07:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-9d33aac0-7fcb-418b-85f4-2efd7953f52c tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:07:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-9d33aac0-7fcb-418b-85f4-2efd7953f52c tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:07:51 user nova-compute[74247]: DEBUG nova.compute.manager [req-b016045c-a7c0-482b-ac9d-6abba62b54e6 req-758da94b-497b-4454-8961-bd7c814cf034 service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Received event network-vif-deleted-1e4186ff-26a0-43b8-8b0a-2f62eb718451 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:07:51 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-9d33aac0-7fcb-418b-85f4-2efd7953f52c tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 19:07:51 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-9d33aac0-7fcb-418b-85f4-2efd7953f52c tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 19:07:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-9d33aac0-7fcb-418b-85f4-2efd7953f52c tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.215s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:07:51 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-9d33aac0-7fcb-418b-85f4-2efd7953f52c tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Deleted allocations for instance 68edbfa7-0752-42fb-bad8-eb7121796e9f
Oct 16 19:07:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-9d33aac0-7fcb-418b-85f4-2efd7953f52c tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "68edbfa7-0752-42fb-bad8-eb7121796e9f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.700s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:07:52 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:07:52 user nova-compute[74247]: DEBUG nova.compute.manager [req-ec30014c-809a-4aea-bee7-144a8484cd00 req-5a2aa4c1-325c-47bb-a9f3-f828d2e381a0 service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Received event network-vif-plugged-1e4186ff-26a0-43b8-8b0a-2f62eb718451 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:07:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-ec30014c-809a-4aea-bee7-144a8484cd00 req-5a2aa4c1-325c-47bb-a9f3-f828d2e381a0 service nova] Acquiring lock "68edbfa7-0752-42fb-bad8-eb7121796e9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:07:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-ec30014c-809a-4aea-bee7-144a8484cd00 req-5a2aa4c1-325c-47bb-a9f3-f828d2e381a0 service nova] Lock "68edbfa7-0752-42fb-bad8-eb7121796e9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:07:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-ec30014c-809a-4aea-bee7-144a8484cd00 req-5a2aa4c1-325c-47bb-a9f3-f828d2e381a0 service nova] Lock "68edbfa7-0752-42fb-bad8-eb7121796e9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:07:52 user nova-compute[74247]: DEBUG nova.compute.manager [req-ec30014c-809a-4aea-bee7-144a8484cd00 req-5a2aa4c1-325c-47bb-a9f3-f828d2e381a0 service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] No waiting events found dispatching network-vif-plugged-1e4186ff-26a0-43b8-8b0a-2f62eb718451 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:07:52 user nova-compute[74247]: WARNING nova.compute.manager [req-ec30014c-809a-4aea-bee7-144a8484cd00 req-5a2aa4c1-325c-47bb-a9f3-f828d2e381a0 service nova] [instance: 68edbfa7-0752-42fb-bad8-eb7121796e9f] Received unexpected event network-vif-plugged-1e4186ff-26a0-43b8-8b0a-2f62eb718451 for instance with vm_state deleted and task_state None.
Oct 16 19:07:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:08:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:08:02 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-0b64cfbf-f639-49da-a545-c3f7b823f220 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c98f761b-9569-4bdc-bb41-87201d78ee1c is timed out.
Oct 16 19:08:02 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-0b64cfbf-f639-49da-a545-c3f7b823f220 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Successfully detached device vdb from instance c98f761b-9569-4bdc-bb41-87201d78ee1c from the live domain config.
Oct 16 19:08:02 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b64cfbf-f639-49da-a545-c3f7b823f220 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b64cfbf-f639-49da-a545-c3f7b823f220 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'guwUXbPm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 19:08:02 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-0b64cfbf-f639-49da-a545-c3f7b823f220 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 19:08:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-0b64cfbf-f639-49da-a545-c3f7b823f220 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-0b64cfbf-f639-49da-a545-c3f7b823f220 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9198005-3bc5-4ea2-9bdd-24f7f369ebb6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b64cfbf-f639-49da-a545-c3f7b823f220 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 19:08:02 user nova-compute[74247]: No targets found.
Oct 16 19:08:02 user nova-compute[74247]: iSNS:
Oct 16 19:08:02 user nova-compute[74247]: No targets found.
Oct 16 19:08:02 user nova-compute[74247]: STATIC:
Oct 16 19:08:02 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7
Oct 16 19:08:02 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 19:08:02 user nova-compute[74247]:                 Iface Name: default
Oct 16 19:08:02 user nova-compute[74247]: FIRMWARE:
Oct 16 19:08:02 user nova-compute[74247]: No targets found.
Oct 16 19:08:02 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b64cfbf-f639-49da-a545-c3f7b823f220 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 19:08:02 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 19:08:02 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b64cfbf-f639-49da-a545-c3f7b823f220 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef60d393-4a42-452e-a2a4-6e94e82a4101]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[da99f6e9-a81f-4e7b-855d-f64817224c61]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b64cfbf-f639-49da-a545-c3f7b823f220 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7 (non-flash)
Oct 16 19:08:02 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b64cfbf-f639-49da-a545-c3f7b823f220 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7 (non-flash)
Oct 16 19:08:02 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b64cfbf-f639-49da-a545-c3f7b823f220 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe048413910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7'): ({'sdb'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-0b64cfbf-f639-49da-a545-c3f7b823f220 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Removing single pathed devices sdb {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f5bda5-d52f-4fa0-a1d3-1692bc399ab6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a8086f-5788-4bac-a762-c06a44d936bb]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-0b64cfbf-f639-49da-a545-c3f7b823f220 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Flushing IO for device /dev/sdb {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f0d562-c25c-4105-b610-342348554524]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-0b64cfbf-f639-49da-a545-c3f7b823f220 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa76d64f-907f-4ec1-b745-130ec14613d9]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-0b64cfbf-f639-49da-a545-c3f7b823f220 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-0b64cfbf-f639-49da-a545-c3f7b823f220 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] SCSI volumes sdb have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b64cfbf-f639-49da-a545-c3f7b823f220 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e925f7ed-aa9f-4092-ab66-2626c74de27f]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b64cfbf-f639-49da-a545-c3f7b823f220 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7 -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a9d2b4-5c68-4013-b140-246eb8eac4cc]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b64cfbf-f639-49da-a545-c3f7b823f220 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7, portal: 172.16.0.220,3260]
Oct 16 19:08:02 user nova-compute[74247]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7, portal: 172.16.0.220,3260] successful.
Oct 16 19:08:02 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7 -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:004f04f9-a0cf-4645-afb9-d673ecdea1a7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2870af-dbef-4b6f-ba53-78eb6f2e6fe1]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b64cfbf-f639-49da-a545-c3f7b823f220 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-0b64cfbf-f639-49da-a545-c3f7b823f220 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b64cfbf-f639-49da-a545-c3f7b823f220 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] <== disconnect_volume: return (274ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 19:08:02 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b64cfbf-f639-49da-a545-c3f7b823f220 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 19:08:03 user nova-compute[74247]: DEBUG nova.objects.instance [None req-0b64cfbf-f639-49da-a545-c3f7b823f220 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lazy-loading 'flavor' on Instance uuid c98f761b-9569-4bdc-bb41-87201d78ee1c {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:08:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0b64cfbf-f639-49da-a545-c3f7b823f220 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "c98f761b-9569-4bdc-bb41-87201d78ee1c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.714s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:08:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:08:10 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:08:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:08:20 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:08:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:08:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:08:28 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:08:28 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:08:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:08:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:08:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:08:28 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 19:08:28 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c98f761b-9569-4bdc-bb41-87201d78ee1c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:08:28 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c98f761b-9569-4bdc-bb41-87201d78ee1c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:08:28 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c98f761b-9569-4bdc-bb41-87201d78ee1c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:08:29 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c98f761b-9569-4bdc-bb41-87201d78ee1c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:08:29 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:08:29 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:08:29 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=8935MB free_disk=24.890945434570312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 19:08:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:08:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:08:29 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance c98f761b-9569-4bdc-bb41-87201d78ee1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 19:08:29 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 19:08:29 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 19:08:29 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 19:08:29 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 19:08:29 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 19:08:29 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.201s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:08:30 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:08:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:08:31 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:08:32 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:08:32 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 19:08:32 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "refresh_cache-c98f761b-9569-4bdc-bb41-87201d78ee1c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:08:32 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquired lock "refresh_cache-c98f761b-9569-4bdc-bb41-87201d78ee1c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:08:32 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Forcefully refreshing network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 19:08:33 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Updating instance_info_cache with network_info: [{"id": "ca03492e-c602-4ae1-ae43-63b37a989463", "address": "fa:16:3e:34:00:5c", "network": {"id": "baf3f2f3-1b8b-4c83-b488-9e7bd2323e54", "bridge": "br-int", "label": "tempest-TestStampPattern-1706551992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c41a39f4784703bcad1f7591a76d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca03492e-c6", "ovs_interfaceid": "ca03492e-c602-4ae1-ae43-63b37a989463", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:08:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Releasing lock "refresh_cache-c98f761b-9569-4bdc-bb41-87201d78ee1c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:08:33 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Updated the network info_cache for instance {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 19:08:34 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:08:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:08:37 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:08:37 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 19:08:38 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:08:40 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:08:42 user nova-compute[74247]: DEBUG nova.compute.manager [None req-d84f9c44-1867-4aeb-a992-d6a35e4b33a5 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 19:08:42 user nova-compute[74247]: INFO nova.compute.manager [None req-d84f9c44-1867-4aeb-a992-d6a35e4b33a5 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] instance snapshotting
Oct 16 19:08:42 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-d84f9c44-1867-4aeb-a992-d6a35e4b33a5 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Beginning live snapshot process
Oct 16 19:08:42 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-d84f9c44-1867-4aeb-a992-d6a35e4b33a5 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c98f761b-9569-4bdc-bb41-87201d78ee1c/disk --force-share --output=json -f qcow2 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:08:42 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-d84f9c44-1867-4aeb-a992-d6a35e4b33a5 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c98f761b-9569-4bdc-bb41-87201d78ee1c/disk --force-share --output=json -f qcow2" returned: 0 in 0.183s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:08:42 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-d84f9c44-1867-4aeb-a992-d6a35e4b33a5 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c98f761b-9569-4bdc-bb41-87201d78ee1c/disk --force-share --output=json -f qcow2 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:08:42 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-d84f9c44-1867-4aeb-a992-d6a35e4b33a5 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c98f761b-9569-4bdc-bb41-87201d78ee1c/disk --force-share --output=json -f qcow2" returned: 0 in 0.177s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:08:42 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-d84f9c44-1867-4aeb-a992-d6a35e4b33a5 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:08:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-d84f9c44-1867-4aeb-a992-d6a35e4b33a5 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.209s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:08:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-d84f9c44-1867-4aeb-a992-d6a35e4b33a5 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmps0r15o35/db21622cd4f6407ba51901f497dcb725.delta 1073741824 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:08:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-d84f9c44-1867-4aeb-a992-d6a35e4b33a5 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmps0r15o35/db21622cd4f6407ba51901f497dcb725.delta 1073741824" returned: 0 in 0.049s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:08:43 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-d84f9c44-1867-4aeb-a992-d6a35e4b33a5 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 16 19:08:43 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-d84f9c44-1867-4aeb-a992-d6a35e4b33a5 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 19:08:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Acquiring lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:08:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:08:44 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-d84f9c44-1867-4aeb-a992-d6a35e4b33a5 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 19:08:44 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-d84f9c44-1867-4aeb-a992-d6a35e4b33a5 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 16 19:08:44 user nova-compute[74247]: DEBUG nova.compute.manager [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 19:08:44 user nova-compute[74247]: DEBUG nova.privsep.utils [None req-d84f9c44-1867-4aeb-a992-d6a35e4b33a5 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74247) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 19:08:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-d84f9c44-1867-4aeb-a992-d6a35e4b33a5 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmps0r15o35/db21622cd4f6407ba51901f497dcb725.delta /opt/stack/data/nova/instances/snapshots/tmps0r15o35/db21622cd4f6407ba51901f497dcb725 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:08:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:08:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:08:44 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 19:08:44 user nova-compute[74247]: INFO nova.compute.claims [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Claim successful on node user
Oct 16 19:08:44 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 19:08:44 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 19:08:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.340s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:08:44 user nova-compute[74247]: DEBUG nova.compute.manager [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 19:08:44 user nova-compute[74247]: DEBUG nova.compute.manager [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 19:08:44 user nova-compute[74247]: DEBUG nova.network.neutron [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 19:08:44 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 19:08:44 user nova-compute[74247]: DEBUG nova.compute.manager [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 19:08:44 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-d84f9c44-1867-4aeb-a992-d6a35e4b33a5 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmps0r15o35/db21622cd4f6407ba51901f497dcb725.delta /opt/stack/data/nova/instances/snapshots/tmps0r15o35/db21622cd4f6407ba51901f497dcb725" returned: 0 in 0.557s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:08:44 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-d84f9c44-1867-4aeb-a992-d6a35e4b33a5 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Snapshot extracted, beginning image upload
Oct 16 19:08:45 user nova-compute[74247]: DEBUG nova.policy [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7414f773f7a94a13938c406bf02b3bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42cb6a3c6bdd484d9a8d0c27bf1ac2fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 19:08:45 user nova-compute[74247]: DEBUG nova.compute.manager [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 19:08:45 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 19:08:45 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Creating image(s)
Oct 16 19:08:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Acquiring lock "/opt/stack/data/nova/instances/7342c6b4-7597-4a4d-a2a2-c770ff99398c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:08:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "/opt/stack/data/nova/instances/7342c6b4-7597-4a4d-a2a2-c770ff99398c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:08:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "/opt/stack/data/nova/instances/7342c6b4-7597-4a4d-a2a2-c770ff99398c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:08:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Acquiring lock "6bf213d84938908ff69f1e8a8f8343c619aae65e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:08:45 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "6bf213d84938908ff69f1e8a8f8343c619aae65e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:08:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6bf213d84938908ff69f1e8a8f8343c619aae65e.part --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:08:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:08:45 user nova-compute[74247]: DEBUG nova.network.neutron [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Successfully created port: 94e4aefa-d790-4eb7-ba5e-6437f32b3305 {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 19:08:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6bf213d84938908ff69f1e8a8f8343c619aae65e.part --force-share --output=json" returned: 0 in 0.197s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:08:45 user nova-compute[74247]: DEBUG nova.virt.images [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] d76765c7-e435-419a-a1e6-135b68d25bc6 was qcow2, converting to raw {{(pid=74247) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 16 19:08:45 user nova-compute[74247]: DEBUG nova.privsep.utils [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74247) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 19:08:45 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6bf213d84938908ff69f1e8a8f8343c619aae65e.part /opt/stack/data/nova/instances/_base/6bf213d84938908ff69f1e8a8f8343c619aae65e.converted {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:08:46 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:08:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6bf213d84938908ff69f1e8a8f8343c619aae65e.part /opt/stack/data/nova/instances/_base/6bf213d84938908ff69f1e8a8f8343c619aae65e.converted" returned: 0 in 0.331s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:08:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6bf213d84938908ff69f1e8a8f8343c619aae65e.converted --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:08:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6bf213d84938908ff69f1e8a8f8343c619aae65e.converted --force-share --output=json" returned: 0 in 0.189s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:08:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "6bf213d84938908ff69f1e8a8f8343c619aae65e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.155s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:08:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6bf213d84938908ff69f1e8a8f8343c619aae65e --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:08:46 user nova-compute[74247]: DEBUG nova.network.neutron [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Successfully updated port: 94e4aefa-d790-4eb7-ba5e-6437f32b3305 {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 19:08:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Acquiring lock "refresh_cache-7342c6b4-7597-4a4d-a2a2-c770ff99398c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:08:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Acquired lock "refresh_cache-7342c6b4-7597-4a4d-a2a2-c770ff99398c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:08:46 user nova-compute[74247]: DEBUG nova.network.neutron [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 19:08:46 user nova-compute[74247]: DEBUG nova.compute.manager [req-ba95cda6-f648-4713-be24-b92d9298550c req-53577fc5-b658-4d15-86e3-9ecc01b64a94 service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Received event network-changed-94e4aefa-d790-4eb7-ba5e-6437f32b3305 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:08:46 user nova-compute[74247]: DEBUG nova.compute.manager [req-ba95cda6-f648-4713-be24-b92d9298550c req-53577fc5-b658-4d15-86e3-9ecc01b64a94 service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Refreshing instance network info cache due to event network-changed-94e4aefa-d790-4eb7-ba5e-6437f32b3305. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 19:08:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-ba95cda6-f648-4713-be24-b92d9298550c req-53577fc5-b658-4d15-86e3-9ecc01b64a94 service nova] Acquiring lock "refresh_cache-7342c6b4-7597-4a4d-a2a2-c770ff99398c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:08:46 user nova-compute[74247]: DEBUG nova.network.neutron [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 19:08:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6bf213d84938908ff69f1e8a8f8343c619aae65e --force-share --output=json" returned: 0 in 0.174s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:08:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Acquiring lock "6bf213d84938908ff69f1e8a8f8343c619aae65e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:08:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "6bf213d84938908ff69f1e8a8f8343c619aae65e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:08:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6bf213d84938908ff69f1e8a8f8343c619aae65e --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:08:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6bf213d84938908ff69f1e8a8f8343c619aae65e --force-share --output=json" returned: 0 in 0.184s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:08:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6bf213d84938908ff69f1e8a8f8343c619aae65e,backing_fmt=raw /opt/stack/data/nova/instances/7342c6b4-7597-4a4d-a2a2-c770ff99398c/disk 1073741824 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:08:46 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:08:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6bf213d84938908ff69f1e8a8f8343c619aae65e,backing_fmt=raw /opt/stack/data/nova/instances/7342c6b4-7597-4a4d-a2a2-c770ff99398c/disk 1073741824" returned: 0 in 0.051s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:08:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "6bf213d84938908ff69f1e8a8f8343c619aae65e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:08:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6bf213d84938908ff69f1e8a8f8343c619aae65e --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:08:46 user nova-compute[74247]: DEBUG nova.network.neutron [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Updating instance_info_cache with network_info: [{"id": "94e4aefa-d790-4eb7-ba5e-6437f32b3305", "address": "fa:16:3e:7a:e1:0d", "network": {"id": "5801391d-4968-4504-9f23-8683eeb63a54", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2082110052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cb6a3c6bdd484d9a8d0c27bf1ac2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e4aefa-d7", "ovs_interfaceid": "94e4aefa-d790-4eb7-ba5e-6437f32b3305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:08:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Releasing lock "refresh_cache-7342c6b4-7597-4a4d-a2a2-c770ff99398c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:08:46 user nova-compute[74247]: DEBUG nova.compute.manager [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Instance network_info: |[{"id": "94e4aefa-d790-4eb7-ba5e-6437f32b3305", "address": "fa:16:3e:7a:e1:0d", "network": {"id": "5801391d-4968-4504-9f23-8683eeb63a54", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2082110052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cb6a3c6bdd484d9a8d0c27bf1ac2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e4aefa-d7", "ovs_interfaceid": "94e4aefa-d790-4eb7-ba5e-6437f32b3305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 19:08:46 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-ba95cda6-f648-4713-be24-b92d9298550c req-53577fc5-b658-4d15-86e3-9ecc01b64a94 service nova] Acquired lock "refresh_cache-7342c6b4-7597-4a4d-a2a2-c770ff99398c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:08:46 user nova-compute[74247]: DEBUG nova.network.neutron [req-ba95cda6-f648-4713-be24-b92d9298550c req-53577fc5-b658-4d15-86e3-9ecc01b64a94 service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Refreshing network info cache for port 94e4aefa-d790-4eb7-ba5e-6437f32b3305 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 19:08:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6bf213d84938908ff69f1e8a8f8343c619aae65e --force-share --output=json" returned: 0 in 0.172s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:08:46 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7342c6b4-7597-4a4d-a2a2-c770ff99398c/disk. size=1073741824 {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 19:08:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7342c6b4-7597-4a4d-a2a2-c770ff99398c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7342c6b4-7597-4a4d-a2a2-c770ff99398c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Cannot resize image /opt/stack/data/nova/instances/7342c6b4-7597-4a4d-a2a2-c770ff99398c/disk to a smaller size. {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Ensure instance console log exists: /opt/stack/data/nova/instances/7342c6b4-7597-4a4d-a2a2-c770ff99398c/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Start _get_guest_xml network_info=[{"id": "94e4aefa-d790-4eb7-ba5e-6437f32b3305", "address": "fa:16:3e:7a:e1:0d", "network": {"id": "5801391d-4968-4504-9f23-8683eeb63a54", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2082110052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cb6a3c6bdd484d9a8d0c27bf1ac2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e4aefa-d7", "ovs_interfaceid": "94e4aefa-d790-4eb7-ba5e-6437f32b3305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T19:08:41Z,direct_url=<?>,disk_format='qcow2',id=d76765c7-e435-419a-a1e6-135b68d25bc6,min_disk=0,min_ram=0,name='tempest-scenario-img--1918039991',owner='42cb6a3c6bdd484d9a8d0c27bf1ac2fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T19:08:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': 'd76765c7-e435-419a-a1e6-135b68d25bc6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 19:08:47 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:08:47 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:08:47 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T19:08:41Z,direct_url=<?>,disk_format='qcow2',id=d76765c7-e435-419a-a1e6-135b68d25bc6,min_disk=0,min_ram=0,name='tempest-scenario-img--1918039991',owner='42cb6a3c6bdd484d9a8d0c27bf1ac2fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T19:08:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T19:08:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1474275686',display_name='tempest-TestMinimumBasicScenario-server-1474275686',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1474275686',id=50,image_ref='d76765c7-e435-419a-a1e6-135b68d25bc6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLy984zKXfWcr+qrmnnf+PRN3ZevxqvwoR8EVBJsoKsGkrUb+S3p672oy87GJpObXxQd5tsI1EwukbRXJx2NMzK2VW9PVG+t9s1MntGX1icQApLfLM5huuv9OE55lGakEA==',key_name='tempest-TestMinimumBasicScenario-451463780',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42cb6a3c6bdd484d9a8d0c27bf1ac2fb',ramdisk_id='',reservation_id='r-cn1s0417',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d76765c7-e435-419a-a1e6-135b68d25bc6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-218992455',owner_user_name='tempest-TestMinimumBasicScenario-218992455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T19:08:45Z,user_data=None,user_id='7414f773f7a94a13938c406bf02b3bac',uuid=7342c6b4-7597-4a4d-a2a2-c770ff99398c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94e4aefa-d790-4eb7-ba5e-6437f32b3305", "address": "fa:16:3e:7a:e1:0d", "network": {"id": "5801391d-4968-4504-9f23-8683eeb63a54", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2082110052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cb6a3c6bdd484d9a8d0c27bf1ac2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e4aefa-d7", "ovs_interfaceid": "94e4aefa-d790-4eb7-ba5e-6437f32b3305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Converting VIF {"id": "94e4aefa-d790-4eb7-ba5e-6437f32b3305", "address": "fa:16:3e:7a:e1:0d", "network": {"id": "5801391d-4968-4504-9f23-8683eeb63a54", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2082110052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cb6a3c6bdd484d9a8d0c27bf1ac2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e4aefa-d7", "ovs_interfaceid": "94e4aefa-d790-4eb7-ba5e-6437f32b3305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:e1:0d,bridge_name='br-int',has_traffic_filtering=True,id=94e4aefa-d790-4eb7-ba5e-6437f32b3305,network=Network(5801391d-4968-4504-9f23-8683eeb63a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94e4aefa-d7') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG nova.objects.instance [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lazy-loading 'pci_devices' on Instance uuid 7342c6b4-7597-4a4d-a2a2-c770ff99398c {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] End _get_guest_xml xml=<domain type="kvm">
Oct 16 19:08:47 user nova-compute[74247]:   <uuid>7342c6b4-7597-4a4d-a2a2-c770ff99398c</uuid>
Oct 16 19:08:47 user nova-compute[74247]:   <name>instance-00000032</name>
Oct 16 19:08:47 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 19:08:47 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 19:08:47 user nova-compute[74247]:   <metadata>
Oct 16 19:08:47 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 19:08:47 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 19:08:47 user nova-compute[74247]:       <nova:name>tempest-TestMinimumBasicScenario-server-1474275686</nova:name>
Oct 16 19:08:47 user nova-compute[74247]:       <nova:creationTime>2023-10-16 19:08:47</nova:creationTime>
Oct 16 19:08:47 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 19:08:47 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 19:08:47 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 19:08:47 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 19:08:47 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 19:08:47 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 19:08:47 user nova-compute[74247]:       </nova:flavor>
Oct 16 19:08:47 user nova-compute[74247]:       <nova:owner>
Oct 16 19:08:47 user nova-compute[74247]:         <nova:user uuid="7414f773f7a94a13938c406bf02b3bac">tempest-TestMinimumBasicScenario-218992455-project-member</nova:user>
Oct 16 19:08:47 user nova-compute[74247]:         <nova:project uuid="42cb6a3c6bdd484d9a8d0c27bf1ac2fb">tempest-TestMinimumBasicScenario-218992455</nova:project>
Oct 16 19:08:47 user nova-compute[74247]:       </nova:owner>
Oct 16 19:08:47 user nova-compute[74247]:       <nova:root type="image" uuid="d76765c7-e435-419a-a1e6-135b68d25bc6"/>
Oct 16 19:08:47 user nova-compute[74247]:       <nova:ports>
Oct 16 19:08:47 user nova-compute[74247]:         <nova:port uuid="94e4aefa-d790-4eb7-ba5e-6437f32b3305">
Oct 16 19:08:47 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 16 19:08:47 user nova-compute[74247]:         </nova:port>
Oct 16 19:08:47 user nova-compute[74247]:       </nova:ports>
Oct 16 19:08:47 user nova-compute[74247]:     </nova:instance>
Oct 16 19:08:47 user nova-compute[74247]:   </metadata>
Oct 16 19:08:47 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 19:08:47 user nova-compute[74247]:     <system>
Oct 16 19:08:47 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 19:08:47 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 19:08:47 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 19:08:47 user nova-compute[74247]:       <entry name="serial">7342c6b4-7597-4a4d-a2a2-c770ff99398c</entry>
Oct 16 19:08:47 user nova-compute[74247]:       <entry name="uuid">7342c6b4-7597-4a4d-a2a2-c770ff99398c</entry>
Oct 16 19:08:47 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 19:08:47 user nova-compute[74247]:     </system>
Oct 16 19:08:47 user nova-compute[74247]:   </sysinfo>
Oct 16 19:08:47 user nova-compute[74247]:   <os>
Oct 16 19:08:47 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 19:08:47 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 19:08:47 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 19:08:47 user nova-compute[74247]:   </os>
Oct 16 19:08:47 user nova-compute[74247]:   <features>
Oct 16 19:08:47 user nova-compute[74247]:     <acpi/>
Oct 16 19:08:47 user nova-compute[74247]:     <apic/>
Oct 16 19:08:47 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 19:08:47 user nova-compute[74247]:   </features>
Oct 16 19:08:47 user nova-compute[74247]:   <clock offset="utc">
Oct 16 19:08:47 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 19:08:47 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 19:08:47 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 19:08:47 user nova-compute[74247]:   </clock>
Oct 16 19:08:47 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 19:08:47 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 19:08:47 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 19:08:47 user nova-compute[74247]:   </cpu>
Oct 16 19:08:47 user nova-compute[74247]:   <devices>
Oct 16 19:08:47 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 19:08:47 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 19:08:47 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/7342c6b4-7597-4a4d-a2a2-c770ff99398c/disk"/>
Oct 16 19:08:47 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 19:08:47 user nova-compute[74247]:     </disk>
Oct 16 19:08:47 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 19:08:47 user nova-compute[74247]:       <mac address="fa:16:3e:7a:e1:0d"/>
Oct 16 19:08:47 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 19:08:47 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 19:08:47 user nova-compute[74247]:       <target dev="tap94e4aefa-d7"/>
Oct 16 19:08:47 user nova-compute[74247]:     </interface>
Oct 16 19:08:47 user nova-compute[74247]:     <serial type="pty">
Oct 16 19:08:47 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/7342c6b4-7597-4a4d-a2a2-c770ff99398c/console.log" append="off"/>
Oct 16 19:08:47 user nova-compute[74247]:     </serial>
Oct 16 19:08:47 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 19:08:47 user nova-compute[74247]:     <video>
Oct 16 19:08:47 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 19:08:47 user nova-compute[74247]:     </video>
Oct 16 19:08:47 user nova-compute[74247]:     <rng model="virtio">
Oct 16 19:08:47 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 19:08:47 user nova-compute[74247]:     </rng>
Oct 16 19:08:47 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 19:08:47 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 19:08:47 user nova-compute[74247]:       <stats period="10"/>
Oct 16 19:08:47 user nova-compute[74247]:     </memballoon>
Oct 16 19:08:47 user nova-compute[74247]:   </devices>
Oct 16 19:08:47 user nova-compute[74247]: </domain>
Oct 16 19:08:47 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T19:08:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1474275686',display_name='tempest-TestMinimumBasicScenario-server-1474275686',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1474275686',id=50,image_ref='d76765c7-e435-419a-a1e6-135b68d25bc6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLy984zKXfWcr+qrmnnf+PRN3ZevxqvwoR8EVBJsoKsGkrUb+S3p672oy87GJpObXxQd5tsI1EwukbRXJx2NMzK2VW9PVG+t9s1MntGX1icQApLfLM5huuv9OE55lGakEA==',key_name='tempest-TestMinimumBasicScenario-451463780',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42cb6a3c6bdd484d9a8d0c27bf1ac2fb',ramdisk_id='',reservation_id='r-cn1s0417',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d76765c7-e435-419a-a1e6-135b68d25bc6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-218992455',owner_user_name='tempest-TestMinimumBasicScenario-218992455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T19:08:45Z,user_data=None,user_id='7414f773f7a94a13938c406bf02b3bac',uuid=7342c6b4-7597-4a4d-a2a2-c770ff99398c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94e4aefa-d790-4eb7-ba5e-6437f32b3305", "address": "fa:16:3e:7a:e1:0d", "network": {"id": "5801391d-4968-4504-9f23-8683eeb63a54", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2082110052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cb6a3c6bdd484d9a8d0c27bf1ac2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e4aefa-d7", "ovs_interfaceid": "94e4aefa-d790-4eb7-ba5e-6437f32b3305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Converting VIF {"id": "94e4aefa-d790-4eb7-ba5e-6437f32b3305", "address": "fa:16:3e:7a:e1:0d", "network": {"id": "5801391d-4968-4504-9f23-8683eeb63a54", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2082110052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cb6a3c6bdd484d9a8d0c27bf1ac2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e4aefa-d7", "ovs_interfaceid": "94e4aefa-d790-4eb7-ba5e-6437f32b3305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:e1:0d,bridge_name='br-int',has_traffic_filtering=True,id=94e4aefa-d790-4eb7-ba5e-6437f32b3305,network=Network(5801391d-4968-4504-9f23-8683eeb63a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94e4aefa-d7') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG os_vif [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:e1:0d,bridge_name='br-int',has_traffic_filtering=True,id=94e4aefa-d790-4eb7-ba5e-6437f32b3305,network=Network(5801391d-4968-4504-9f23-8683eeb63a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94e4aefa-d7') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '253164bb-ab6b-5421-9c3e-00ad02077033', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94e4aefa-d7, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap94e4aefa-d7, col_values=(('qos', UUID('ba1df6c4-1e6e-423b-89b0-4c08ef42c69d')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap94e4aefa-d7, col_values=(('external_ids', {'iface-id': '94e4aefa-d790-4eb7-ba5e-6437f32b3305', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:e1:0d', 'vm-uuid': '7342c6b4-7597-4a4d-a2a2-c770ff99398c'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:08:47 user nova-compute[74247]: INFO os_vif [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:e1:0d,bridge_name='br-int',has_traffic_filtering=True,id=94e4aefa-d790-4eb7-ba5e-6437f32b3305,network=Network(5801391d-4968-4504-9f23-8683eeb63a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94e4aefa-d7')
Oct 16 19:08:47 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] No VIF found with MAC fa:16:3e:7a:e1:0d, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG nova.network.neutron [req-ba95cda6-f648-4713-be24-b92d9298550c req-53577fc5-b658-4d15-86e3-9ecc01b64a94 service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Updated VIF entry in instance network info cache for port 94e4aefa-d790-4eb7-ba5e-6437f32b3305. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG nova.network.neutron [req-ba95cda6-f648-4713-be24-b92d9298550c req-53577fc5-b658-4d15-86e3-9ecc01b64a94 service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Updating instance_info_cache with network_info: [{"id": "94e4aefa-d790-4eb7-ba5e-6437f32b3305", "address": "fa:16:3e:7a:e1:0d", "network": {"id": "5801391d-4968-4504-9f23-8683eeb63a54", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2082110052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cb6a3c6bdd484d9a8d0c27bf1ac2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e4aefa-d7", "ovs_interfaceid": "94e4aefa-d790-4eb7-ba5e-6437f32b3305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:08:47 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-ba95cda6-f648-4713-be24-b92d9298550c req-53577fc5-b658-4d15-86e3-9ecc01b64a94 service nova] Releasing lock "refresh_cache-7342c6b4-7597-4a4d-a2a2-c770ff99398c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:08:47 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-d84f9c44-1867-4aeb-a992-d6a35e4b33a5 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Snapshot image upload complete
Oct 16 19:08:47 user nova-compute[74247]: INFO nova.compute.manager [None req-d84f9c44-1867-4aeb-a992-d6a35e4b33a5 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Took 5.38 seconds to snapshot the instance on the hypervisor.
Oct 16 19:08:48 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:08:48 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:08:48 user nova-compute[74247]: DEBUG nova.compute.manager [req-a7067146-9c2d-4b79-9926-833f602b7b84 req-ce9c781b-77c9-4290-a9dd-70e6ce421329 service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Received event network-vif-plugged-94e4aefa-d790-4eb7-ba5e-6437f32b3305 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:08:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a7067146-9c2d-4b79-9926-833f602b7b84 req-ce9c781b-77c9-4290-a9dd-70e6ce421329 service nova] Acquiring lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:08:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a7067146-9c2d-4b79-9926-833f602b7b84 req-ce9c781b-77c9-4290-a9dd-70e6ce421329 service nova] Lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:08:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a7067146-9c2d-4b79-9926-833f602b7b84 req-ce9c781b-77c9-4290-a9dd-70e6ce421329 service nova] Lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:08:48 user nova-compute[74247]: DEBUG nova.compute.manager [req-a7067146-9c2d-4b79-9926-833f602b7b84 req-ce9c781b-77c9-4290-a9dd-70e6ce421329 service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] No waiting events found dispatching network-vif-plugged-94e4aefa-d790-4eb7-ba5e-6437f32b3305 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:08:48 user nova-compute[74247]: WARNING nova.compute.manager [req-a7067146-9c2d-4b79-9926-833f602b7b84 req-ce9c781b-77c9-4290-a9dd-70e6ce421329 service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Received unexpected event network-vif-plugged-94e4aefa-d790-4eb7-ba5e-6437f32b3305 for instance with vm_state building and task_state spawning.
Oct 16 19:08:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:08:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:08:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:08:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Acquiring lock "1ed9efd5-9b55-4c9f-ad24-1f00958a8163" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:08:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "1ed9efd5-9b55-4c9f-ad24-1f00958a8163" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:08:50 user nova-compute[74247]: DEBUG nova.compute.manager [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 19:08:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:08:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:08:50 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 19:08:50 user nova-compute[74247]: INFO nova.compute.claims [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Claim successful on node user
Oct 16 19:08:50 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 19:08:50 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 19:08:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.246s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:08:50 user nova-compute[74247]: DEBUG nova.compute.manager [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 19:08:50 user nova-compute[74247]: DEBUG nova.compute.manager [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 19:08:50 user nova-compute[74247]: DEBUG nova.network.neutron [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 19:08:50 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 19:08:50 user nova-compute[74247]: DEBUG nova.compute.manager [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 19:08:50 user nova-compute[74247]: DEBUG nova.policy [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b28a77b1cf14454595a99c9428c687b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c41a39f4784703bcad1f7591a76d11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 19:08:50 user nova-compute[74247]: DEBUG nova.compute.manager [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 19:08:50 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 19:08:50 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Instance spawned successfully.
Oct 16 19:08:50 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 19:08:50 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 19:08:50 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 19:08:50 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 19:08:50 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 19:08:50 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 19:08:50 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 19:08:50 user nova-compute[74247]: DEBUG nova.compute.manager [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 19:08:50 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 19:08:50 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Creating image(s)
Oct 16 19:08:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Acquiring lock "/opt/stack/data/nova/instances/1ed9efd5-9b55-4c9f-ad24-1f00958a8163/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:08:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "/opt/stack/data/nova/instances/1ed9efd5-9b55-4c9f-ad24-1f00958a8163/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:08:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "/opt/stack/data/nova/instances/1ed9efd5-9b55-4c9f-ad24-1f00958a8163/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:08:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Acquiring lock "99b186d892fb99f5c5242e4ac900a40f245b43f1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:08:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "99b186d892fb99f5c5242e4ac900a40f245b43f1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:08:50 user nova-compute[74247]: INFO nova.compute.manager [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Took 5.66 seconds to spawn the instance on the hypervisor.
Oct 16 19:08:50 user nova-compute[74247]: DEBUG nova.compute.manager [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 19:08:50 user nova-compute[74247]: DEBUG nova.compute.manager [req-7ae3f113-2d06-446f-ad20-58697215117d req-2235a1a1-da9c-4253-8861-168066a5074a service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Received event network-vif-plugged-94e4aefa-d790-4eb7-ba5e-6437f32b3305 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:08:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7ae3f113-2d06-446f-ad20-58697215117d req-2235a1a1-da9c-4253-8861-168066a5074a service nova] Acquiring lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:08:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7ae3f113-2d06-446f-ad20-58697215117d req-2235a1a1-da9c-4253-8861-168066a5074a service nova] Lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:08:50 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-7ae3f113-2d06-446f-ad20-58697215117d req-2235a1a1-da9c-4253-8861-168066a5074a service nova] Lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:08:50 user nova-compute[74247]: DEBUG nova.compute.manager [req-7ae3f113-2d06-446f-ad20-58697215117d req-2235a1a1-da9c-4253-8861-168066a5074a service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] No waiting events found dispatching network-vif-plugged-94e4aefa-d790-4eb7-ba5e-6437f32b3305 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:08:50 user nova-compute[74247]: WARNING nova.compute.manager [req-7ae3f113-2d06-446f-ad20-58697215117d req-2235a1a1-da9c-4253-8861-168066a5074a service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Received unexpected event network-vif-plugged-94e4aefa-d790-4eb7-ba5e-6437f32b3305 for instance with vm_state building and task_state spawning.
Oct 16 19:08:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/99b186d892fb99f5c5242e4ac900a40f245b43f1.part --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:08:51 user nova-compute[74247]: DEBUG nova.network.neutron [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Successfully created port: 451a1a94-8dfe-4110-b756-665820c97e64 {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 19:08:51 user nova-compute[74247]: INFO nova.compute.manager [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Took 7.30 seconds to build instance.
Oct 16 19:08:51 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-662a2afb-e5d1-45f1-9c8b-3624642adfbc tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.426s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:08:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/99b186d892fb99f5c5242e4ac900a40f245b43f1.part --force-share --output=json" returned: 0 in 0.199s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:08:51 user nova-compute[74247]: DEBUG nova.virt.images [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] 82d96b97-b2af-4d74-9461-8691f6c34ae9 was qcow2, converting to raw {{(pid=74247) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 16 19:08:51 user nova-compute[74247]: DEBUG nova.privsep.utils [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74247) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 19:08:51 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/99b186d892fb99f5c5242e4ac900a40f245b43f1.part /opt/stack/data/nova/instances/_base/99b186d892fb99f5c5242e4ac900a40f245b43f1.converted {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:08:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/99b186d892fb99f5c5242e4ac900a40f245b43f1.part /opt/stack/data/nova/instances/_base/99b186d892fb99f5c5242e4ac900a40f245b43f1.converted" returned: 0 in 0.253s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:08:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/99b186d892fb99f5c5242e4ac900a40f245b43f1.converted --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:08:52 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:08:52 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:08:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/99b186d892fb99f5c5242e4ac900a40f245b43f1.converted --force-share --output=json" returned: 0 in 0.209s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:08:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "99b186d892fb99f5c5242e4ac900a40f245b43f1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.644s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:08:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/99b186d892fb99f5c5242e4ac900a40f245b43f1 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:08:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/99b186d892fb99f5c5242e4ac900a40f245b43f1 --force-share --output=json" returned: 0 in 0.194s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:08:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Acquiring lock "99b186d892fb99f5c5242e4ac900a40f245b43f1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:08:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "99b186d892fb99f5c5242e4ac900a40f245b43f1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:08:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/99b186d892fb99f5c5242e4ac900a40f245b43f1 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:08:52 user nova-compute[74247]: DEBUG nova.network.neutron [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Successfully updated port: 451a1a94-8dfe-4110-b756-665820c97e64 {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 19:08:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Acquiring lock "refresh_cache-1ed9efd5-9b55-4c9f-ad24-1f00958a8163" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:08:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Acquired lock "refresh_cache-1ed9efd5-9b55-4c9f-ad24-1f00958a8163" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:08:52 user nova-compute[74247]: DEBUG nova.network.neutron [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 19:08:52 user nova-compute[74247]: DEBUG nova.compute.manager [req-109885cb-a04a-47df-a667-395ab268d70e req-1d358854-c34a-49e2-ab97-6e6f3477c73f service nova] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Received event network-changed-451a1a94-8dfe-4110-b756-665820c97e64 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:08:52 user nova-compute[74247]: DEBUG nova.compute.manager [req-109885cb-a04a-47df-a667-395ab268d70e req-1d358854-c34a-49e2-ab97-6e6f3477c73f service nova] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Refreshing instance network info cache due to event network-changed-451a1a94-8dfe-4110-b756-665820c97e64. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 19:08:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-109885cb-a04a-47df-a667-395ab268d70e req-1d358854-c34a-49e2-ab97-6e6f3477c73f service nova] Acquiring lock "refresh_cache-1ed9efd5-9b55-4c9f-ad24-1f00958a8163" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:08:52 user nova-compute[74247]: DEBUG nova.network.neutron [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 19:08:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/99b186d892fb99f5c5242e4ac900a40f245b43f1 --force-share --output=json" returned: 0 in 0.229s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:08:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/99b186d892fb99f5c5242e4ac900a40f245b43f1,backing_fmt=raw /opt/stack/data/nova/instances/1ed9efd5-9b55-4c9f-ad24-1f00958a8163/disk 1073741824 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:08:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/99b186d892fb99f5c5242e4ac900a40f245b43f1,backing_fmt=raw /opt/stack/data/nova/instances/1ed9efd5-9b55-4c9f-ad24-1f00958a8163/disk 1073741824" returned: 0 in 0.050s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:08:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "99b186d892fb99f5c5242e4ac900a40f245b43f1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:08:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/99b186d892fb99f5c5242e4ac900a40f245b43f1 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:08:52 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/99b186d892fb99f5c5242e4ac900a40f245b43f1 --force-share --output=json" returned: 0 in 0.188s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:08:52 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 19:08:52 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Ensure instance console log exists: /opt/stack/data/nova/instances/1ed9efd5-9b55-4c9f-ad24-1f00958a8163/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 19:08:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:08:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:08:52 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG nova.network.neutron [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Updating instance_info_cache with network_info: [{"id": "451a1a94-8dfe-4110-b756-665820c97e64", "address": "fa:16:3e:ed:f3:a4", "network": {"id": "baf3f2f3-1b8b-4c83-b488-9e7bd2323e54", "bridge": "br-int", "label": "tempest-TestStampPattern-1706551992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c41a39f4784703bcad1f7591a76d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451a1a94-8d", "ovs_interfaceid": "451a1a94-8dfe-4110-b756-665820c97e64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Releasing lock "refresh_cache-1ed9efd5-9b55-4c9f-ad24-1f00958a8163" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG nova.compute.manager [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Instance network_info: |[{"id": "451a1a94-8dfe-4110-b756-665820c97e64", "address": "fa:16:3e:ed:f3:a4", "network": {"id": "baf3f2f3-1b8b-4c83-b488-9e7bd2323e54", "bridge": "br-int", "label": "tempest-TestStampPattern-1706551992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c41a39f4784703bcad1f7591a76d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451a1a94-8d", "ovs_interfaceid": "451a1a94-8dfe-4110-b756-665820c97e64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-109885cb-a04a-47df-a667-395ab268d70e req-1d358854-c34a-49e2-ab97-6e6f3477c73f service nova] Acquired lock "refresh_cache-1ed9efd5-9b55-4c9f-ad24-1f00958a8163" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG nova.network.neutron [req-109885cb-a04a-47df-a667-395ab268d70e req-1d358854-c34a-49e2-ab97-6e6f3477c73f service nova] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Refreshing network info cache for port 451a1a94-8dfe-4110-b756-665820c97e64 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Start _get_guest_xml network_info=[{"id": "451a1a94-8dfe-4110-b756-665820c97e64", "address": "fa:16:3e:ed:f3:a4", "network": {"id": "baf3f2f3-1b8b-4c83-b488-9e7bd2323e54", "bridge": "br-int", "label": "tempest-TestStampPattern-1706551992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c41a39f4784703bcad1f7591a76d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451a1a94-8d", "ovs_interfaceid": "451a1a94-8dfe-4110-b756-665820c97e64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='a14e8d5505d02ca8b03ae1bb6c95777d',container_format='bare',created_at=2023-10-16T19:08:42Z,direct_url=<?>,disk_format='qcow2',id=82d96b97-b2af-4d74-9461-8691f6c34ae9,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-2099781874',owner='c1c41a39f4784703bcad1f7591a76d11',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-16T19:08:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': '82d96b97-b2af-4d74-9461-8691f6c34ae9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 19:08:53 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:08:53 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:08:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='a14e8d5505d02ca8b03ae1bb6c95777d',container_format='bare',created_at=2023-10-16T19:08:42Z,direct_url=<?>,disk_format='qcow2',id=82d96b97-b2af-4d74-9461-8691f6c34ae9,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-2099781874',owner='c1c41a39f4784703bcad1f7591a76d11',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-16T19:08:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T19:08:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1135142007',display_name='tempest-TestStampPattern-server-1135142007',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1135142007',id=51,image_ref='82d96b97-b2af-4d74-9461-8691f6c34ae9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNxEdjHCqXg36WXekMM1Zh/PyzVI0ul1kYnElgqTDHXdRIJob26QfSPrWsyAE9isu855bMWOwxFPWIr1rugbT9wqVDtsPKJbjyx5N9NGEec2huAjGi342Kiv9qTpABeJw==',key_name='tempest-TestStampPattern-547736775',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1c41a39f4784703bcad1f7591a76d11',ramdisk_id='',reservation_id='r-jjj9yw05',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='c98f761b-9569-4bdc-bb41-87201d78ee1c',image_min_disk='1',image_min_ram='0',image_owner_id='c1c41a39f4784703bcad1f7591a76d11',image_owner_project_name='tempest-TestStampPattern-595700511',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-595700511-project-member',image_user_id='b28a77b1cf14454595a99c9428c687b9',network_allocated='True',owner_project_name='tempest-TestStampPattern-595700511',owner_user_name='tempest-TestStampPattern-595700511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T19:08:51Z,user_data=None,user_id='b28a77b1cf14454595a99c9428c687b9',uuid=1ed9efd5-9b55-4c9f-ad24-1f00958a8163,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "451a1a94-8dfe-4110-b756-665820c97e64", "address": "fa:16:3e:ed:f3:a4", "network": {"id": "baf3f2f3-1b8b-4c83-b488-9e7bd2323e54", "bridge": "br-int", "label": "tempest-TestStampPattern-1706551992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c41a39f4784703bcad1f7591a76d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451a1a94-8d", "ovs_interfaceid": "451a1a94-8dfe-4110-b756-665820c97e64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Converting VIF {"id": "451a1a94-8dfe-4110-b756-665820c97e64", "address": "fa:16:3e:ed:f3:a4", "network": {"id": "baf3f2f3-1b8b-4c83-b488-9e7bd2323e54", "bridge": "br-int", "label": "tempest-TestStampPattern-1706551992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c41a39f4784703bcad1f7591a76d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451a1a94-8d", "ovs_interfaceid": "451a1a94-8dfe-4110-b756-665820c97e64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f3:a4,bridge_name='br-int',has_traffic_filtering=True,id=451a1a94-8dfe-4110-b756-665820c97e64,network=Network(baf3f2f3-1b8b-4c83-b488-9e7bd2323e54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap451a1a94-8d') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG nova.objects.instance [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ed9efd5-9b55-4c9f-ad24-1f00958a8163 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] End _get_guest_xml xml=<domain type="kvm">
Oct 16 19:08:53 user nova-compute[74247]:   <uuid>1ed9efd5-9b55-4c9f-ad24-1f00958a8163</uuid>
Oct 16 19:08:53 user nova-compute[74247]:   <name>instance-00000033</name>
Oct 16 19:08:53 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 19:08:53 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 19:08:53 user nova-compute[74247]:   <metadata>
Oct 16 19:08:53 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 19:08:53 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 19:08:53 user nova-compute[74247]:       <nova:name>tempest-TestStampPattern-server-1135142007</nova:name>
Oct 16 19:08:53 user nova-compute[74247]:       <nova:creationTime>2023-10-16 19:08:53</nova:creationTime>
Oct 16 19:08:53 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 19:08:53 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 19:08:53 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 19:08:53 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 19:08:53 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 19:08:53 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 19:08:53 user nova-compute[74247]:       </nova:flavor>
Oct 16 19:08:53 user nova-compute[74247]:       <nova:owner>
Oct 16 19:08:53 user nova-compute[74247]:         <nova:user uuid="b28a77b1cf14454595a99c9428c687b9">tempest-TestStampPattern-595700511-project-member</nova:user>
Oct 16 19:08:53 user nova-compute[74247]:         <nova:project uuid="c1c41a39f4784703bcad1f7591a76d11">tempest-TestStampPattern-595700511</nova:project>
Oct 16 19:08:53 user nova-compute[74247]:       </nova:owner>
Oct 16 19:08:53 user nova-compute[74247]:       <nova:root type="image" uuid="82d96b97-b2af-4d74-9461-8691f6c34ae9"/>
Oct 16 19:08:53 user nova-compute[74247]:       <nova:ports>
Oct 16 19:08:53 user nova-compute[74247]:         <nova:port uuid="451a1a94-8dfe-4110-b756-665820c97e64">
Oct 16 19:08:53 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 16 19:08:53 user nova-compute[74247]:         </nova:port>
Oct 16 19:08:53 user nova-compute[74247]:       </nova:ports>
Oct 16 19:08:53 user nova-compute[74247]:     </nova:instance>
Oct 16 19:08:53 user nova-compute[74247]:   </metadata>
Oct 16 19:08:53 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 19:08:53 user nova-compute[74247]:     <system>
Oct 16 19:08:53 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 19:08:53 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 19:08:53 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 19:08:53 user nova-compute[74247]:       <entry name="serial">1ed9efd5-9b55-4c9f-ad24-1f00958a8163</entry>
Oct 16 19:08:53 user nova-compute[74247]:       <entry name="uuid">1ed9efd5-9b55-4c9f-ad24-1f00958a8163</entry>
Oct 16 19:08:53 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 19:08:53 user nova-compute[74247]:     </system>
Oct 16 19:08:53 user nova-compute[74247]:   </sysinfo>
Oct 16 19:08:53 user nova-compute[74247]:   <os>
Oct 16 19:08:53 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 19:08:53 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 19:08:53 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 19:08:53 user nova-compute[74247]:   </os>
Oct 16 19:08:53 user nova-compute[74247]:   <features>
Oct 16 19:08:53 user nova-compute[74247]:     <acpi/>
Oct 16 19:08:53 user nova-compute[74247]:     <apic/>
Oct 16 19:08:53 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 19:08:53 user nova-compute[74247]:   </features>
Oct 16 19:08:53 user nova-compute[74247]:   <clock offset="utc">
Oct 16 19:08:53 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 19:08:53 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 19:08:53 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 19:08:53 user nova-compute[74247]:   </clock>
Oct 16 19:08:53 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 19:08:53 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 19:08:53 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 19:08:53 user nova-compute[74247]:   </cpu>
Oct 16 19:08:53 user nova-compute[74247]:   <devices>
Oct 16 19:08:53 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 19:08:53 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 19:08:53 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/1ed9efd5-9b55-4c9f-ad24-1f00958a8163/disk"/>
Oct 16 19:08:53 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 19:08:53 user nova-compute[74247]:     </disk>
Oct 16 19:08:53 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 19:08:53 user nova-compute[74247]:       <mac address="fa:16:3e:ed:f3:a4"/>
Oct 16 19:08:53 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 19:08:53 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 19:08:53 user nova-compute[74247]:       <target dev="tap451a1a94-8d"/>
Oct 16 19:08:53 user nova-compute[74247]:     </interface>
Oct 16 19:08:53 user nova-compute[74247]:     <serial type="pty">
Oct 16 19:08:53 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/1ed9efd5-9b55-4c9f-ad24-1f00958a8163/console.log" append="off"/>
Oct 16 19:08:53 user nova-compute[74247]:     </serial>
Oct 16 19:08:53 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 19:08:53 user nova-compute[74247]:     <video>
Oct 16 19:08:53 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 19:08:53 user nova-compute[74247]:     </video>
Oct 16 19:08:53 user nova-compute[74247]:     <rng model="virtio">
Oct 16 19:08:53 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 19:08:53 user nova-compute[74247]:     </rng>
Oct 16 19:08:53 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 19:08:53 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 19:08:53 user nova-compute[74247]:       <stats period="10"/>
Oct 16 19:08:53 user nova-compute[74247]:     </memballoon>
Oct 16 19:08:53 user nova-compute[74247]:   </devices>
Oct 16 19:08:53 user nova-compute[74247]: </domain>
Oct 16 19:08:53 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T19:08:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1135142007',display_name='tempest-TestStampPattern-server-1135142007',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1135142007',id=51,image_ref='82d96b97-b2af-4d74-9461-8691f6c34ae9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNxEdjHCqXg36WXekMM1Zh/PyzVI0ul1kYnElgqTDHXdRIJob26QfSPrWsyAE9isu855bMWOwxFPWIr1rugbT9wqVDtsPKJbjyx5N9NGEec2huAjGi342Kiv9qTpABeJw==',key_name='tempest-TestStampPattern-547736775',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1c41a39f4784703bcad1f7591a76d11',ramdisk_id='',reservation_id='r-jjj9yw05',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='c98f761b-9569-4bdc-bb41-87201d78ee1c',image_min_disk='1',image_min_ram='0',image_owner_id='c1c41a39f4784703bcad1f7591a76d11',image_owner_project_name='tempest-TestStampPattern-595700511',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-595700511-project-member',image_user_id='b28a77b1cf14454595a99c9428c687b9',network_allocated='True',owner_project_name='tempest-TestStampPattern-595700511',owner_user_name='tempest-TestStampPattern-595700511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T19:08:51Z,user_data=None,user_id='b28a77b1cf14454595a99c9428c687b9',uuid=1ed9efd5-9b55-4c9f-ad24-1f00958a8163,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "451a1a94-8dfe-4110-b756-665820c97e64", "address": "fa:16:3e:ed:f3:a4", "network": {"id": "baf3f2f3-1b8b-4c83-b488-9e7bd2323e54", "bridge": "br-int", "label": "tempest-TestStampPattern-1706551992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c41a39f4784703bcad1f7591a76d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451a1a94-8d", "ovs_interfaceid": "451a1a94-8dfe-4110-b756-665820c97e64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Converting VIF {"id": "451a1a94-8dfe-4110-b756-665820c97e64", "address": "fa:16:3e:ed:f3:a4", "network": {"id": "baf3f2f3-1b8b-4c83-b488-9e7bd2323e54", "bridge": "br-int", "label": "tempest-TestStampPattern-1706551992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c41a39f4784703bcad1f7591a76d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451a1a94-8d", "ovs_interfaceid": "451a1a94-8dfe-4110-b756-665820c97e64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f3:a4,bridge_name='br-int',has_traffic_filtering=True,id=451a1a94-8dfe-4110-b756-665820c97e64,network=Network(baf3f2f3-1b8b-4c83-b488-9e7bd2323e54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap451a1a94-8d') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG os_vif [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f3:a4,bridge_name='br-int',has_traffic_filtering=True,id=451a1a94-8dfe-4110-b756-665820c97e64,network=Network(baf3f2f3-1b8b-4c83-b488-9e7bd2323e54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap451a1a94-8d') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6f98269a-b0dd-52cb-947b-9f1872c2d4ce', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap451a1a94-8d, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap451a1a94-8d, col_values=(('qos', UUID('1261a557-14cd-498c-8cbc-067288eeadfd')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap451a1a94-8d, col_values=(('external_ids', {'iface-id': '451a1a94-8dfe-4110-b756-665820c97e64', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:f3:a4', 'vm-uuid': '1ed9efd5-9b55-4c9f-ad24-1f00958a8163'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:08:53 user nova-compute[74247]: INFO os_vif [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f3:a4,bridge_name='br-int',has_traffic_filtering=True,id=451a1a94-8dfe-4110-b756-665820c97e64,network=Network(baf3f2f3-1b8b-4c83-b488-9e7bd2323e54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap451a1a94-8d')
Oct 16 19:08:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] No VIF found with MAC fa:16:3e:ed:f3:a4, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG nova.network.neutron [req-109885cb-a04a-47df-a667-395ab268d70e req-1d358854-c34a-49e2-ab97-6e6f3477c73f service nova] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Updated VIF entry in instance network info cache for port 451a1a94-8dfe-4110-b756-665820c97e64. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG nova.network.neutron [req-109885cb-a04a-47df-a667-395ab268d70e req-1d358854-c34a-49e2-ab97-6e6f3477c73f service nova] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Updating instance_info_cache with network_info: [{"id": "451a1a94-8dfe-4110-b756-665820c97e64", "address": "fa:16:3e:ed:f3:a4", "network": {"id": "baf3f2f3-1b8b-4c83-b488-9e7bd2323e54", "bridge": "br-int", "label": "tempest-TestStampPattern-1706551992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c41a39f4784703bcad1f7591a76d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451a1a94-8d", "ovs_interfaceid": "451a1a94-8dfe-4110-b756-665820c97e64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:08:53 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-109885cb-a04a-47df-a667-395ab268d70e req-1d358854-c34a-49e2-ab97-6e6f3477c73f service nova] Releasing lock "refresh_cache-1ed9efd5-9b55-4c9f-ad24-1f00958a8163" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:08:54 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:08:54 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:08:54 user nova-compute[74247]: DEBUG nova.compute.manager [req-26a21123-c787-43cc-875d-38f1be48dcd0 req-ae1b9cff-7345-49fc-b416-23cf2985aea6 service nova] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Received event network-vif-plugged-451a1a94-8dfe-4110-b756-665820c97e64 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:08:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-26a21123-c787-43cc-875d-38f1be48dcd0 req-ae1b9cff-7345-49fc-b416-23cf2985aea6 service nova] Acquiring lock "1ed9efd5-9b55-4c9f-ad24-1f00958a8163-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:08:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-26a21123-c787-43cc-875d-38f1be48dcd0 req-ae1b9cff-7345-49fc-b416-23cf2985aea6 service nova] Lock "1ed9efd5-9b55-4c9f-ad24-1f00958a8163-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:08:54 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-26a21123-c787-43cc-875d-38f1be48dcd0 req-ae1b9cff-7345-49fc-b416-23cf2985aea6 service nova] Lock "1ed9efd5-9b55-4c9f-ad24-1f00958a8163-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:08:54 user nova-compute[74247]: DEBUG nova.compute.manager [req-26a21123-c787-43cc-875d-38f1be48dcd0 req-ae1b9cff-7345-49fc-b416-23cf2985aea6 service nova] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] No waiting events found dispatching network-vif-plugged-451a1a94-8dfe-4110-b756-665820c97e64 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:08:54 user nova-compute[74247]: WARNING nova.compute.manager [req-26a21123-c787-43cc-875d-38f1be48dcd0 req-ae1b9cff-7345-49fc-b416-23cf2985aea6 service nova] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Received unexpected event network-vif-plugged-451a1a94-8dfe-4110-b756-665820c97e64 for instance with vm_state building and task_state spawning.
Oct 16 19:08:54 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:08:54 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:08:56 user nova-compute[74247]: DEBUG nova.compute.manager [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 19:08:56 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 19:08:56 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Instance spawned successfully.
Oct 16 19:08:56 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 19:08:56 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 19:08:56 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 19:08:56 user nova-compute[74247]: DEBUG nova.compute.manager [req-014557d5-328e-4cdb-9fe8-6f517b7e56f2 req-f2333090-cc68-45df-8a9a-86aa6a98ec05 service nova] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Received event network-vif-plugged-451a1a94-8dfe-4110-b756-665820c97e64 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:08:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-014557d5-328e-4cdb-9fe8-6f517b7e56f2 req-f2333090-cc68-45df-8a9a-86aa6a98ec05 service nova] Acquiring lock "1ed9efd5-9b55-4c9f-ad24-1f00958a8163-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:08:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-014557d5-328e-4cdb-9fe8-6f517b7e56f2 req-f2333090-cc68-45df-8a9a-86aa6a98ec05 service nova] Lock "1ed9efd5-9b55-4c9f-ad24-1f00958a8163-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:08:56 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-014557d5-328e-4cdb-9fe8-6f517b7e56f2 req-f2333090-cc68-45df-8a9a-86aa6a98ec05 service nova] Lock "1ed9efd5-9b55-4c9f-ad24-1f00958a8163-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:08:56 user nova-compute[74247]: DEBUG nova.compute.manager [req-014557d5-328e-4cdb-9fe8-6f517b7e56f2 req-f2333090-cc68-45df-8a9a-86aa6a98ec05 service nova] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] No waiting events found dispatching network-vif-plugged-451a1a94-8dfe-4110-b756-665820c97e64 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:08:56 user nova-compute[74247]: WARNING nova.compute.manager [req-014557d5-328e-4cdb-9fe8-6f517b7e56f2 req-f2333090-cc68-45df-8a9a-86aa6a98ec05 service nova] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Received unexpected event network-vif-plugged-451a1a94-8dfe-4110-b756-665820c97e64 for instance with vm_state building and task_state spawning.
Oct 16 19:08:56 user nova-compute[74247]: INFO nova.compute.manager [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Took 6.16 seconds to spawn the instance on the hypervisor.
Oct 16 19:08:56 user nova-compute[74247]: DEBUG nova.compute.manager [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 19:08:56 user nova-compute[74247]: INFO nova.compute.manager [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Took 6.85 seconds to build instance.
Oct 16 19:08:57 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-064114a9-6688-43c5-b7a5-ba8c95c2bedf tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "1ed9efd5-9b55-4c9f-ad24-1f00958a8163" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.954s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:08:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:08:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:09:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:09:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:09:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:09:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:09:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:09:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:09:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:09:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:09:12 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:09:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:09:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:09:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:09:21 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:09:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:09:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:09:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:09:28 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:09:30 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:09:30 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:09:30 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:09:30 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:09:30 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:09:30 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 19:09:30 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c98f761b-9569-4bdc-bb41-87201d78ee1c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:09:30 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c98f761b-9569-4bdc-bb41-87201d78ee1c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:09:30 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c98f761b-9569-4bdc-bb41-87201d78ee1c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:09:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c98f761b-9569-4bdc-bb41-87201d78ee1c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:09:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7342c6b4-7597-4a4d-a2a2-c770ff99398c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:09:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7342c6b4-7597-4a4d-a2a2-c770ff99398c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:09:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7342c6b4-7597-4a4d-a2a2-c770ff99398c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:09:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7342c6b4-7597-4a4d-a2a2-c770ff99398c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:09:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9efd5-9b55-4c9f-ad24-1f00958a8163/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:09:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9efd5-9b55-4c9f-ad24-1f00958a8163/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:09:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9efd5-9b55-4c9f-ad24-1f00958a8163/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:09:31 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9efd5-9b55-4c9f-ad24-1f00958a8163/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:09:32 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:09:32 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:09:32 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=8616MB free_disk=24.68710708618164GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 19:09:32 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:09:32 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:09:32 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance c98f761b-9569-4bdc-bb41-87201d78ee1c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 19:09:32 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 7342c6b4-7597-4a4d-a2a2-c770ff99398c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 19:09:32 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 1ed9efd5-9b55-4c9f-ad24-1f00958a8163 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 19:09:32 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 19:09:32 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 19:09:32 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 19:09:32 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 19:09:32 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 19:09:32 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.267s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:09:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:09:33 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:09:33 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 19:09:33 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Rebuilding the list of instances to heal {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 19:09:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "refresh_cache-c98f761b-9569-4bdc-bb41-87201d78ee1c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:09:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquired lock "refresh_cache-c98f761b-9569-4bdc-bb41-87201d78ee1c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:09:33 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Forcefully refreshing network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 19:09:33 user nova-compute[74247]: DEBUG nova.objects.instance [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lazy-loading 'info_cache' on Instance uuid c98f761b-9569-4bdc-bb41-87201d78ee1c {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:09:34 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Updating instance_info_cache with network_info: [{"id": "ca03492e-c602-4ae1-ae43-63b37a989463", "address": "fa:16:3e:34:00:5c", "network": {"id": "baf3f2f3-1b8b-4c83-b488-9e7bd2323e54", "bridge": "br-int", "label": "tempest-TestStampPattern-1706551992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c41a39f4784703bcad1f7591a76d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca03492e-c6", "ovs_interfaceid": "ca03492e-c602-4ae1-ae43-63b37a989463", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:09:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Releasing lock "refresh_cache-c98f761b-9569-4bdc-bb41-87201d78ee1c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:09:34 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Updated the network info_cache for instance {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 19:09:34 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:09:36 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:09:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:09:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:09:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:09:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:09:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:09:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:09:38 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:09:38 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:09:38 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 19:09:43 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:09:46 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:09:48 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:09:48 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:09:48 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:09:48 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:09:48 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:09:48 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:09:48 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:09:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:09:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:09:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:09:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:09:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:09:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:09:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:09:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:09:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:09:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:09:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:09:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:10:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:10:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:10:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:10:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:10:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:10:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:10:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:10:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:10:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:10:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:10:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:10:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:10:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:10:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:10:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:10:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:10:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:10:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:10:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:10:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:10:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:10:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:10:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:10:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:10:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:10:23 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:10:28 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:10:28 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:10:28 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:10:28 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:10:28 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:10:28 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:10:28 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._sync_power_states {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:10:28 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Triggering sync for uuid c98f761b-9569-4bdc-bb41-87201d78ee1c {{(pid=74247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 19:10:28 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Triggering sync for uuid 7342c6b4-7597-4a4d-a2a2-c770ff99398c {{(pid=74247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 19:10:28 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Triggering sync for uuid 1ed9efd5-9b55-4c9f-ad24-1f00958a8163 {{(pid=74247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 19:10:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "c98f761b-9569-4bdc-bb41-87201d78ee1c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:10:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "c98f761b-9569-4bdc-bb41-87201d78ee1c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:10:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:10:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:10:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "1ed9efd5-9b55-4c9f-ad24-1f00958a8163" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:10:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "1ed9efd5-9b55-4c9f-ad24-1f00958a8163" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:10:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "c98f761b-9569-4bdc-bb41-87201d78ee1c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:10:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "1ed9efd5-9b55-4c9f-ad24-1f00958a8163" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:10:28 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:10:30 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:10:30 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:10:32 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:10:32 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 19:10:32 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "refresh_cache-7342c6b4-7597-4a4d-a2a2-c770ff99398c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:10:32 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquired lock "refresh_cache-7342c6b4-7597-4a4d-a2a2-c770ff99398c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:10:32 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Forcefully refreshing network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 19:10:33 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Updating instance_info_cache with network_info: [{"id": "94e4aefa-d790-4eb7-ba5e-6437f32b3305", "address": "fa:16:3e:7a:e1:0d", "network": {"id": "5801391d-4968-4504-9f23-8683eeb63a54", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2082110052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cb6a3c6bdd484d9a8d0c27bf1ac2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e4aefa-d7", "ovs_interfaceid": "94e4aefa-d790-4eb7-ba5e-6437f32b3305", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:10:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Releasing lock "refresh_cache-7342c6b4-7597-4a4d-a2a2-c770ff99398c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:10:33 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Updated the network info_cache for instance {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 19:10:33 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:10:33 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:10:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:10:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:10:33 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:10:33 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 19:10:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:10:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:10:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:10:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:10:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:10:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:10:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c98f761b-9569-4bdc-bb41-87201d78ee1c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:10:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c98f761b-9569-4bdc-bb41-87201d78ee1c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:10:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c98f761b-9569-4bdc-bb41-87201d78ee1c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:10:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c98f761b-9569-4bdc-bb41-87201d78ee1c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:10:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7342c6b4-7597-4a4d-a2a2-c770ff99398c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:10:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7342c6b4-7597-4a4d-a2a2-c770ff99398c/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:10:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7342c6b4-7597-4a4d-a2a2-c770ff99398c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:10:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7342c6b4-7597-4a4d-a2a2-c770ff99398c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:10:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9efd5-9b55-4c9f-ad24-1f00958a8163/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:10:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9efd5-9b55-4c9f-ad24-1f00958a8163/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:10:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9efd5-9b55-4c9f-ad24-1f00958a8163/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:10:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9efd5-9b55-4c9f-ad24-1f00958a8163/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:10:34 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:10:34 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:10:34 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=8753MB free_disk=24.68631362915039GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 19:10:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:10:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:10:34 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance c98f761b-9569-4bdc-bb41-87201d78ee1c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 19:10:34 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 7342c6b4-7597-4a4d-a2a2-c770ff99398c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 19:10:34 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 1ed9efd5-9b55-4c9f-ad24-1f00958a8163 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 19:10:34 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 19:10:34 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 19:10:35 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 19:10:35 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 19:10:35 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 19:10:35 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.244s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:10:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4991-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:10:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:10:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:10:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:10:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:10:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:10:38 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:10:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Acquiring lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:10:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:10:39 user nova-compute[74247]: DEBUG nova.objects.instance [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lazy-loading 'flavor' on Instance uuid 7342c6b4-7597-4a4d-a2a2-c770ff99398c {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:10:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:10:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Acquiring lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:10:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:10:40 user nova-compute[74247]: INFO nova.compute.manager [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Attaching volume d14e8f54-ce4f-4164-a05a-25f78a3c5034 to /dev/vdb
Oct 16 19:10:40 user nova-compute[74247]: DEBUG os_brick.utils [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 19:10:40 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:10:40 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:10:40 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda98204-26ad-4335-aff6-d0e4b5855e67]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:10:40 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:10:40 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:10:40 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6f7669-7885-4480-95b9-dc4752ee1d09]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:10:40 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:10:40 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:10:40 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e957ba6d-ba54-4d18-922d-3e05c460fda9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:10:40 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb1f500-72c6-4e10-acae-1aa37f0b9f09]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:10:40 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:10:40 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 19:10:40 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 19:10:40 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:10:40 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 19:10:40 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 19:10:40 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58cf340-626b-4aef-9138-b9eec6654fe3]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:10:40 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 19:10:40 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 19:10:40 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 19:10:40 user nova-compute[74247]: DEBUG os_brick.utils [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 19:10:40 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Updating existing volume attachment record: f59b7ef6-9fad-4609-b8e7-d85dc6725fd1 {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 19:10:40 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:10:40 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:10:40 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 19:10:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:10:42 user nova-compute[74247]: DEBUG nova.compute.manager [req-9c540d7e-10af-47bd-bb29-edf0f0df35ea req-95da18b8-0d8d-4bcc-87cc-c81f9d02e9ac service nova] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Received event network-changed-451a1a94-8dfe-4110-b756-665820c97e64 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:10:42 user nova-compute[74247]: DEBUG nova.compute.manager [req-9c540d7e-10af-47bd-bb29-edf0f0df35ea req-95da18b8-0d8d-4bcc-87cc-c81f9d02e9ac service nova] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Refreshing instance network info cache due to event network-changed-451a1a94-8dfe-4110-b756-665820c97e64. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 19:10:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9c540d7e-10af-47bd-bb29-edf0f0df35ea req-95da18b8-0d8d-4bcc-87cc-c81f9d02e9ac service nova] Acquiring lock "refresh_cache-1ed9efd5-9b55-4c9f-ad24-1f00958a8163" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:10:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9c540d7e-10af-47bd-bb29-edf0f0df35ea req-95da18b8-0d8d-4bcc-87cc-c81f9d02e9ac service nova] Acquired lock "refresh_cache-1ed9efd5-9b55-4c9f-ad24-1f00958a8163" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:10:42 user nova-compute[74247]: DEBUG nova.network.neutron [req-9c540d7e-10af-47bd-bb29-edf0f0df35ea req-95da18b8-0d8d-4bcc-87cc-c81f9d02e9ac service nova] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Refreshing network info cache for port 451a1a94-8dfe-4110-b756-665820c97e64 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 19:10:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:10:42 user nova-compute[74247]: DEBUG nova.network.neutron [req-9c540d7e-10af-47bd-bb29-edf0f0df35ea req-95da18b8-0d8d-4bcc-87cc-c81f9d02e9ac service nova] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Updated VIF entry in instance network info cache for port 451a1a94-8dfe-4110-b756-665820c97e64. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 19:10:42 user nova-compute[74247]: DEBUG nova.network.neutron [req-9c540d7e-10af-47bd-bb29-edf0f0df35ea req-95da18b8-0d8d-4bcc-87cc-c81f9d02e9ac service nova] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Updating instance_info_cache with network_info: [{"id": "451a1a94-8dfe-4110-b756-665820c97e64", "address": "fa:16:3e:ed:f3:a4", "network": {"id": "baf3f2f3-1b8b-4c83-b488-9e7bd2323e54", "bridge": "br-int", "label": "tempest-TestStampPattern-1706551992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c41a39f4784703bcad1f7591a76d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451a1a94-8d", "ovs_interfaceid": "451a1a94-8dfe-4110-b756-665820c97e64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:10:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9c540d7e-10af-47bd-bb29-edf0f0df35ea req-95da18b8-0d8d-4bcc-87cc-c81f9d02e9ac service nova] Releasing lock "refresh_cache-1ed9efd5-9b55-4c9f-ad24-1f00958a8163" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:10:43 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:10:43 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Acquiring lock "1ed9efd5-9b55-4c9f-ad24-1f00958a8163" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:10:43 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "1ed9efd5-9b55-4c9f-ad24-1f00958a8163" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:10:43 user nova-compute[74247]: DEBUG nova.objects.instance [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lazy-loading 'flavor' on Instance uuid 1ed9efd5-9b55-4c9f-ad24-1f00958a8163 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:10:43 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "1ed9efd5-9b55-4c9f-ad24-1f00958a8163" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:10:43 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Acquiring lock "1ed9efd5-9b55-4c9f-ad24-1f00958a8163" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:10:43 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "1ed9efd5-9b55-4c9f-ad24-1f00958a8163" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:10:43 user nova-compute[74247]: INFO nova.compute.manager [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Attaching volume c5595da2-943b-4307-8cc3-bcb47fc03ed2 to /dev/vdb
Oct 16 19:10:43 user nova-compute[74247]: DEBUG os_brick.utils [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 19:10:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:10:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:10:43 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0470c51-aa76-4f05-acc1-fa9a7f5c1c18]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:10:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:10:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:10:43 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[014caecd-248f-4449-b1a1-de769f74d60c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:10:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:10:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:10:43 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b53572-ca48-487f-aae4-75418395a554]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:10:43 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bf83e1-68d5-4f04-b83c-182622d3e17c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:10:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:10:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 19:10:43 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 19:10:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:10:43 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 19:10:43 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 19:10:43 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e366c208-af62-40a0-88ed-397750211559]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:10:43 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 19:10:43 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 19:10:43 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 19:10:43 user nova-compute[74247]: DEBUG os_brick.utils [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 19:10:43 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Updating existing volume attachment record: fc64e69f-067e-425e-b3a9-8920cfe3d318 {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 19:10:44 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:10:44 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Cleaning up deleted instances with incomplete migration  {{(pid=74247) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 16 19:10:46 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:10:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:10:48 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:10:51 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:10:51 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Cleaning up deleted instances {{(pid=74247) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 16 19:10:51 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] There are 0 instances to clean {{(pid=74247) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 16 19:10:52 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:10:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:10:53 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:10:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:10:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:11:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DbHZYUQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 19:11:05 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 19:11:05 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 19:11:05 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 19:11:05 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 19:11:05 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 19:11:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034 -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f8a093-a571-412d-b5f7-a49b117829d4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 19:11:05 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034 -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef22c82-533c-4ae9-9f04-b348721920a5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034] added
Oct 16 19:11:05 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e176b847-3b54-4501-b060-5a893dd8a389]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50c3e92-a7f4-4934-b053-168ecae58c07]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DbHZYUQA {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DbHZYUQA" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d59718a-ab6d-40ee-983f-bf7b150e4674]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DbHZYUQA'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[141759d9-59c6-4b98-a30c-3478042c7627]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdce4b46-7b00-4a11-b270-a585502141f3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 16 19:11:05 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 16 19:11:05 user nova-compute[74247]:  {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 19:11:05 user nova-compute[74247]: WARNING os_brick.initiator.connectors.iscsi [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 16 19:11:05 user nova-compute[74247]: 
Oct 16 19:11:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034 -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca42262f-8eff-4fb3-872c-206863b16e0a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034, portal: 172.16.0.220,3260]
Oct 16 19:11:05 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034, portal: 172.16.0.220,3260] successful.
Oct 16 19:11:05 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbbc3a1-f8eb-4bbf-89b6-7b2a049c4650]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b879d157-efc3-4a31-9931-65e92ae5e441]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034 (non-flash)
Oct 16 19:11:05 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034 (non-flash)
Oct 16 19:11:05 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdbb809-dbc2-4be7-a27d-6f636925d7e4]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 19:11:05 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DbHZYUQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 19:11:06 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 19:11:06 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '26466663338363063', 'path': '/dev/sdb'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 19:11:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466663338363063', 'path': '/dev/sdb'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 19:11:06 user nova-compute[74247]: DEBUG nova.objects.instance [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lazy-loading 'flavor' on Instance uuid 7342c6b4-7597-4a4d-a2a2-c770ff99398c {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:11:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 19:11:06 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 19:11:06 user nova-compute[74247]:   <source dev="/dev/sdb"/>
Oct 16 19:11:06 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 19:11:06 user nova-compute[74247]:   <serial>d14e8f54-ce4f-4164-a05a-25f78a3c5034</serial>
Oct 16 19:11:06 user nova-compute[74247]: </disk>
Oct 16 19:11:06 user nova-compute[74247]:  {{(pid=74247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 19:11:07 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 19:11:07 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 19:11:07 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] No VIF found with MAC fa:16:3e:7a:e1:0d, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 19:11:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-90deea57-2f16-49be-994a-45147a4af1ef tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.181s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tWvjIqce', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 19:11:08 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 19:11:08 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 19:11:08 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 19:11:08 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 19:11:08 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 19:11:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2 -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[defa94d7-f9de-45a5-94bb-82d42fe20f3a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 19:11:08 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7519aa8-6323-4d03-8c5a-41964a624542]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2] added
Oct 16 19:11:08 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3285bf8c-89e2-4152-8d99-d3891b6c02a3]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0dd125-88f5-48cb-b4c1-b3e9e72f98bc]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tWvjIqce {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tWvjIqce" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ba1e40-2f94-4293-9e46-9c51615f73d0]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tWvjIqce'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a8a7dc-a374-40fc-a175-635f68a342b7]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e5d595-3b42-460f-a717-f544c8ece6ad]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034 (non-flash)
Oct 16 19:11:08 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034 (non-flash)
Oct 16 19:11:08 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2 -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[13aec7af-02b8-44c2-86f8-2db493cb72c8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2, portal: 172.16.0.220,3260]
Oct 16 19:11:08 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2, portal: 172.16.0.220,3260] successful.
Oct 16 19:11:08 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fa2c63-37af-4b44-91aa-5a34537f351a]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c390a8-aee3-4ac0-824e-e469f1869c38]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034 (non-flash)
Oct 16 19:11:08 user nova-compute[74247]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2 (non-flash)
Oct 16 19:11:08 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034 (non-flash)
Oct 16 19:11:08 user nova-compute[74247]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2 (non-flash)
Oct 16 19:11:08 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d72ebc4-1ab6-49f0-8764-8a336c501d98]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 19:11:08 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tWvjIqce', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 19:11:09 user nova-compute[74247]: DEBUG nova.compute.manager [req-e358a2b3-d736-427b-b90f-8fb707512028 req-349cfaed-47ed-4bbd-bdab-c641df2ff815 service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Received event network-changed-94e4aefa-d790-4eb7-ba5e-6437f32b3305 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:11:09 user nova-compute[74247]: DEBUG nova.compute.manager [req-e358a2b3-d736-427b-b90f-8fb707512028 req-349cfaed-47ed-4bbd-bdab-c641df2ff815 service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Refreshing instance network info cache due to event network-changed-94e4aefa-d790-4eb7-ba5e-6437f32b3305. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 19:11:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e358a2b3-d736-427b-b90f-8fb707512028 req-349cfaed-47ed-4bbd-bdab-c641df2ff815 service nova] Acquiring lock "refresh_cache-7342c6b4-7597-4a4d-a2a2-c770ff99398c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:11:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e358a2b3-d736-427b-b90f-8fb707512028 req-349cfaed-47ed-4bbd-bdab-c641df2ff815 service nova] Acquired lock "refresh_cache-7342c6b4-7597-4a4d-a2a2-c770ff99398c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:11:09 user nova-compute[74247]: DEBUG nova.network.neutron [req-e358a2b3-d736-427b-b90f-8fb707512028 req-349cfaed-47ed-4bbd-bdab-c641df2ff815 service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Refreshing network info cache for port 94e4aefa-d790-4eb7-ba5e-6437f32b3305 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 19:11:09 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 19:11:09 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26230383262616335', 'path': '/dev/sdc'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 19:11:09 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230383262616335', 'path': '/dev/sdc'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 19:11:09 user nova-compute[74247]: DEBUG nova.objects.instance [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lazy-loading 'flavor' on Instance uuid 1ed9efd5-9b55-4c9f-ad24-1f00958a8163 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:11:09 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 19:11:09 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 19:11:09 user nova-compute[74247]:   <source dev="/dev/sdc"/>
Oct 16 19:11:09 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 19:11:09 user nova-compute[74247]:   <serial>c5595da2-943b-4307-8cc3-bcb47fc03ed2</serial>
Oct 16 19:11:09 user nova-compute[74247]: </disk>
Oct 16 19:11:09 user nova-compute[74247]:  {{(pid=74247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 19:11:10 user nova-compute[74247]: DEBUG nova.network.neutron [req-e358a2b3-d736-427b-b90f-8fb707512028 req-349cfaed-47ed-4bbd-bdab-c641df2ff815 service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Updated VIF entry in instance network info cache for port 94e4aefa-d790-4eb7-ba5e-6437f32b3305. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 19:11:10 user nova-compute[74247]: DEBUG nova.network.neutron [req-e358a2b3-d736-427b-b90f-8fb707512028 req-349cfaed-47ed-4bbd-bdab-c641df2ff815 service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Updating instance_info_cache with network_info: [{"id": "94e4aefa-d790-4eb7-ba5e-6437f32b3305", "address": "fa:16:3e:7a:e1:0d", "network": {"id": "5801391d-4968-4504-9f23-8683eeb63a54", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2082110052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cb6a3c6bdd484d9a8d0c27bf1ac2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e4aefa-d7", "ovs_interfaceid": "94e4aefa-d790-4eb7-ba5e-6437f32b3305", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:11:10 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-e358a2b3-d736-427b-b90f-8fb707512028 req-349cfaed-47ed-4bbd-bdab-c641df2ff815 service nova] Releasing lock "refresh_cache-7342c6b4-7597-4a4d-a2a2-c770ff99398c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:11:10 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 19:11:10 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 19:11:10 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] No VIF found with MAC fa:16:3e:ed:f3:a4, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 19:11:10 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-0f678edc-555a-4355-8fbf-0d82f3a44747 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "1ed9efd5-9b55-4c9f-ad24-1f00958a8163" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.763s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:11:11 user nova-compute[74247]: DEBUG nova.compute.manager [req-bc255fde-5b4c-4484-b548-f7f7f2485051 req-bc8d75a8-b72d-492d-a32f-8424d5a242fb service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Received event network-changed-94e4aefa-d790-4eb7-ba5e-6437f32b3305 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:11:11 user nova-compute[74247]: DEBUG nova.compute.manager [req-bc255fde-5b4c-4484-b548-f7f7f2485051 req-bc8d75a8-b72d-492d-a32f-8424d5a242fb service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Refreshing instance network info cache due to event network-changed-94e4aefa-d790-4eb7-ba5e-6437f32b3305. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 19:11:11 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-bc255fde-5b4c-4484-b548-f7f7f2485051 req-bc8d75a8-b72d-492d-a32f-8424d5a242fb service nova] Acquiring lock "refresh_cache-7342c6b4-7597-4a4d-a2a2-c770ff99398c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:11:11 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-bc255fde-5b4c-4484-b548-f7f7f2485051 req-bc8d75a8-b72d-492d-a32f-8424d5a242fb service nova] Acquired lock "refresh_cache-7342c6b4-7597-4a4d-a2a2-c770ff99398c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:11:11 user nova-compute[74247]: DEBUG nova.network.neutron [req-bc255fde-5b4c-4484-b548-f7f7f2485051 req-bc8d75a8-b72d-492d-a32f-8424d5a242fb service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Refreshing network info cache for port 94e4aefa-d790-4eb7-ba5e-6437f32b3305 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 19:11:12 user nova-compute[74247]: DEBUG nova.network.neutron [req-bc255fde-5b4c-4484-b548-f7f7f2485051 req-bc8d75a8-b72d-492d-a32f-8424d5a242fb service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Updated VIF entry in instance network info cache for port 94e4aefa-d790-4eb7-ba5e-6437f32b3305. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 19:11:12 user nova-compute[74247]: DEBUG nova.network.neutron [req-bc255fde-5b4c-4484-b548-f7f7f2485051 req-bc8d75a8-b72d-492d-a32f-8424d5a242fb service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Updating instance_info_cache with network_info: [{"id": "94e4aefa-d790-4eb7-ba5e-6437f32b3305", "address": "fa:16:3e:7a:e1:0d", "network": {"id": "5801391d-4968-4504-9f23-8683eeb63a54", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2082110052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cb6a3c6bdd484d9a8d0c27bf1ac2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e4aefa-d7", "ovs_interfaceid": "94e4aefa-d790-4eb7-ba5e-6437f32b3305", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:11:12 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f1651cfb-3bd8-4321-8692-94b881cf0bd6 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Acquiring lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:11:12 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f1651cfb-3bd8-4321-8692-94b881cf0bd6 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:11:12 user nova-compute[74247]: INFO nova.compute.manager [None req-f1651cfb-3bd8-4321-8692-94b881cf0bd6 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Rebooting instance
Oct 16 19:11:12 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-bc255fde-5b4c-4484-b548-f7f7f2485051 req-bc8d75a8-b72d-492d-a32f-8424d5a242fb service nova] Releasing lock "refresh_cache-7342c6b4-7597-4a4d-a2a2-c770ff99398c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:11:12 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f1651cfb-3bd8-4321-8692-94b881cf0bd6 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Acquiring lock "refresh_cache-7342c6b4-7597-4a4d-a2a2-c770ff99398c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:11:12 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f1651cfb-3bd8-4321-8692-94b881cf0bd6 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Acquired lock "refresh_cache-7342c6b4-7597-4a4d-a2a2-c770ff99398c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:11:12 user nova-compute[74247]: DEBUG nova.network.neutron [None req-f1651cfb-3bd8-4321-8692-94b881cf0bd6 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 19:11:12 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:11:12 user nova-compute[74247]: DEBUG nova.network.neutron [None req-f1651cfb-3bd8-4321-8692-94b881cf0bd6 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Updating instance_info_cache with network_info: [{"id": "94e4aefa-d790-4eb7-ba5e-6437f32b3305", "address": "fa:16:3e:7a:e1:0d", "network": {"id": "5801391d-4968-4504-9f23-8683eeb63a54", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2082110052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cb6a3c6bdd484d9a8d0c27bf1ac2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e4aefa-d7", "ovs_interfaceid": "94e4aefa-d790-4eb7-ba5e-6437f32b3305", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:11:12 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3fd13cc3-a301-45f4-a260-a420014d9bf0 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Acquiring lock "1ed9efd5-9b55-4c9f-ad24-1f00958a8163" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:11:12 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3fd13cc3-a301-45f4-a260-a420014d9bf0 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "1ed9efd5-9b55-4c9f-ad24-1f00958a8163" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:11:12 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f1651cfb-3bd8-4321-8692-94b881cf0bd6 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Releasing lock "refresh_cache-7342c6b4-7597-4a4d-a2a2-c770ff99398c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:11:12 user nova-compute[74247]: DEBUG nova.compute.manager [None req-f1651cfb-3bd8-4321-8692-94b881cf0bd6 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 19:11:12 user nova-compute[74247]: INFO nova.compute.manager [None req-3fd13cc3-a301-45f4-a260-a420014d9bf0 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Detaching volume c5595da2-943b-4307-8cc3-bcb47fc03ed2
Oct 16 19:11:12 user nova-compute[74247]: INFO nova.virt.block_device [None req-3fd13cc3-a301-45f4-a260-a420014d9bf0 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Attempting to driver detach volume c5595da2-943b-4307-8cc3-bcb47fc03ed2 from mountpoint /dev/vdb
Oct 16 19:11:12 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3fd13cc3-a301-45f4-a260-a420014d9bf0 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Attempting to detach device vdb from instance 1ed9efd5-9b55-4c9f-ad24-1f00958a8163 from the persistent domain config. {{(pid=74247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 19:11:12 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-3fd13cc3-a301-45f4-a260-a420014d9bf0 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 19:11:12 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 19:11:12 user nova-compute[74247]:   <source dev="/dev/sdc"/>
Oct 16 19:11:12 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 19:11:12 user nova-compute[74247]:   <serial>c5595da2-943b-4307-8cc3-bcb47fc03ed2</serial>
Oct 16 19:11:12 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 19:11:12 user nova-compute[74247]: </disk>
Oct 16 19:11:12 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 19:11:12 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-3fd13cc3-a301-45f4-a260-a420014d9bf0 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Successfully detached device vdb from instance 1ed9efd5-9b55-4c9f-ad24-1f00958a8163 from the persistent domain config.
Oct 16 19:11:12 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3fd13cc3-a301-45f4-a260-a420014d9bf0 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1ed9efd5-9b55-4c9f-ad24-1f00958a8163 from the live domain config. {{(pid=74247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 19:11:12 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-3fd13cc3-a301-45f4-a260-a420014d9bf0 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 19:11:12 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 19:11:12 user nova-compute[74247]:   <source dev="/dev/sdc"/>
Oct 16 19:11:12 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 19:11:12 user nova-compute[74247]:   <serial>c5595da2-943b-4307-8cc3-bcb47fc03ed2</serial>
Oct 16 19:11:12 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 19:11:12 user nova-compute[74247]: </disk>
Oct 16 19:11:12 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 19:11:13 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3fd13cc3-a301-45f4-a260-a420014d9bf0 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1ed9efd5-9b55-4c9f-ad24-1f00958a8163 {{(pid=74247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 19:11:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:11:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:11:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:11:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:11:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:11:15 user nova-compute[74247]: DEBUG nova.compute.manager [req-22feb0db-811e-4201-a0c2-5c1945f3e4e7 req-9592030c-7fb5-4c28-be81-67cdfad68990 service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Received event network-vif-unplugged-94e4aefa-d790-4eb7-ba5e-6437f32b3305 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:11:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-22feb0db-811e-4201-a0c2-5c1945f3e4e7 req-9592030c-7fb5-4c28-be81-67cdfad68990 service nova] Acquiring lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:11:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-22feb0db-811e-4201-a0c2-5c1945f3e4e7 req-9592030c-7fb5-4c28-be81-67cdfad68990 service nova] Lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:11:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-22feb0db-811e-4201-a0c2-5c1945f3e4e7 req-9592030c-7fb5-4c28-be81-67cdfad68990 service nova] Lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:11:15 user nova-compute[74247]: DEBUG nova.compute.manager [req-22feb0db-811e-4201-a0c2-5c1945f3e4e7 req-9592030c-7fb5-4c28-be81-67cdfad68990 service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] No waiting events found dispatching network-vif-unplugged-94e4aefa-d790-4eb7-ba5e-6437f32b3305 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:11:15 user nova-compute[74247]: WARNING nova.compute.manager [req-22feb0db-811e-4201-a0c2-5c1945f3e4e7 req-9592030c-7fb5-4c28-be81-67cdfad68990 service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Received unexpected event network-vif-unplugged-94e4aefa-d790-4eb7-ba5e-6437f32b3305 for instance with vm_state active and task_state reboot_started.
Oct 16 19:11:15 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-f1651cfb-3bd8-4321-8692-94b881cf0bd6 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Instance shutdown successfully.
Oct 16 19:11:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:11:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:11:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:11:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:11:17 user nova-compute[74247]: DEBUG nova.compute.manager [req-1b06b102-c99b-46e0-935a-10b59ac033c6 req-843e27ed-dfd3-40cb-8bb8-842419004559 service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Received event network-vif-plugged-94e4aefa-d790-4eb7-ba5e-6437f32b3305 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:11:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1b06b102-c99b-46e0-935a-10b59ac033c6 req-843e27ed-dfd3-40cb-8bb8-842419004559 service nova] Acquiring lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:11:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1b06b102-c99b-46e0-935a-10b59ac033c6 req-843e27ed-dfd3-40cb-8bb8-842419004559 service nova] Lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:11:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-1b06b102-c99b-46e0-935a-10b59ac033c6 req-843e27ed-dfd3-40cb-8bb8-842419004559 service nova] Lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:11:17 user nova-compute[74247]: DEBUG nova.compute.manager [req-1b06b102-c99b-46e0-935a-10b59ac033c6 req-843e27ed-dfd3-40cb-8bb8-842419004559 service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] No waiting events found dispatching network-vif-plugged-94e4aefa-d790-4eb7-ba5e-6437f32b3305 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:11:17 user nova-compute[74247]: WARNING nova.compute.manager [req-1b06b102-c99b-46e0-935a-10b59ac033c6 req-843e27ed-dfd3-40cb-8bb8-842419004559 service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Received unexpected event network-vif-plugged-94e4aefa-d790-4eb7-ba5e-6437f32b3305 for instance with vm_state active and task_state reboot_started.
Oct 16 19:11:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:11:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:11:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:11:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:11:18 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:11:19 user nova-compute[74247]: DEBUG nova.compute.manager [req-ac4198e7-8ac3-4ae1-b27f-50f2f02b0673 req-9a0a75da-7fa5-4d40-9b3a-9189aad6dd1c service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Received event network-vif-plugged-94e4aefa-d790-4eb7-ba5e-6437f32b3305 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:11:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-ac4198e7-8ac3-4ae1-b27f-50f2f02b0673 req-9a0a75da-7fa5-4d40-9b3a-9189aad6dd1c service nova] Acquiring lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:11:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-ac4198e7-8ac3-4ae1-b27f-50f2f02b0673 req-9a0a75da-7fa5-4d40-9b3a-9189aad6dd1c service nova] Lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:11:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-ac4198e7-8ac3-4ae1-b27f-50f2f02b0673 req-9a0a75da-7fa5-4d40-9b3a-9189aad6dd1c service nova] Lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:11:19 user nova-compute[74247]: DEBUG nova.compute.manager [req-ac4198e7-8ac3-4ae1-b27f-50f2f02b0673 req-9a0a75da-7fa5-4d40-9b3a-9189aad6dd1c service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] No waiting events found dispatching network-vif-plugged-94e4aefa-d790-4eb7-ba5e-6437f32b3305 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:11:19 user nova-compute[74247]: WARNING nova.compute.manager [req-ac4198e7-8ac3-4ae1-b27f-50f2f02b0673 req-9a0a75da-7fa5-4d40-9b3a-9189aad6dd1c service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Received unexpected event network-vif-plugged-94e4aefa-d790-4eb7-ba5e-6437f32b3305 for instance with vm_state active and task_state reboot_started.
Oct 16 19:11:19 user nova-compute[74247]: DEBUG nova.compute.manager [req-ac4198e7-8ac3-4ae1-b27f-50f2f02b0673 req-9a0a75da-7fa5-4d40-9b3a-9189aad6dd1c service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Received event network-vif-plugged-94e4aefa-d790-4eb7-ba5e-6437f32b3305 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:11:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-ac4198e7-8ac3-4ae1-b27f-50f2f02b0673 req-9a0a75da-7fa5-4d40-9b3a-9189aad6dd1c service nova] Acquiring lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:11:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-ac4198e7-8ac3-4ae1-b27f-50f2f02b0673 req-9a0a75da-7fa5-4d40-9b3a-9189aad6dd1c service nova] Lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:11:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-ac4198e7-8ac3-4ae1-b27f-50f2f02b0673 req-9a0a75da-7fa5-4d40-9b3a-9189aad6dd1c service nova] Lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:11:19 user nova-compute[74247]: DEBUG nova.compute.manager [req-ac4198e7-8ac3-4ae1-b27f-50f2f02b0673 req-9a0a75da-7fa5-4d40-9b3a-9189aad6dd1c service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] No waiting events found dispatching network-vif-plugged-94e4aefa-d790-4eb7-ba5e-6437f32b3305 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:11:19 user nova-compute[74247]: WARNING nova.compute.manager [req-ac4198e7-8ac3-4ae1-b27f-50f2f02b0673 req-9a0a75da-7fa5-4d40-9b3a-9189aad6dd1c service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Received unexpected event network-vif-plugged-94e4aefa-d790-4eb7-ba5e-6437f32b3305 for instance with vm_state active and task_state reboot_started.
Oct 16 19:11:19 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Instance running successfully.
Oct 16 19:11:19 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-f1651cfb-3bd8-4321-8692-94b881cf0bd6 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Instance soft rebooted successfully.
Oct 16 19:11:19 user nova-compute[74247]: DEBUG nova.compute.manager [None req-f1651cfb-3bd8-4321-8692-94b881cf0bd6 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 19:11:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-f1651cfb-3bd8-4321-8692-94b881cf0bd6 tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.130s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:11:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:11:23 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:11:23 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:11:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:11:28 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:11:31 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:11:32 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:11:33 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-3fd13cc3-a301-45f4-a260-a420014d9bf0 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1ed9efd5-9b55-4c9f-ad24-1f00958a8163 is timed out.
Oct 16 19:11:33 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-3fd13cc3-a301-45f4-a260-a420014d9bf0 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Successfully detached device vdb from instance 1ed9efd5-9b55-4c9f-ad24-1f00958a8163 from the live domain config.
Oct 16 19:11:33 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fd13cc3-a301-45f4-a260-a420014d9bf0 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd13cc3-a301-45f4-a260-a420014d9bf0 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tWvjIqce', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 19:11:33 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-3fd13cc3-a301-45f4-a260-a420014d9bf0 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 19:11:33 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-3fd13cc3-a301-45f4-a260-a420014d9bf0 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-3fd13cc3-a301-45f4-a260-a420014d9bf0 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0963000c-528b-4ff5-aabb-7f044a50f22e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd13cc3-a301-45f4-a260-a420014d9bf0 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 19:11:33 user nova-compute[74247]: No targets found.
Oct 16 19:11:33 user nova-compute[74247]: iSNS:
Oct 16 19:11:33 user nova-compute[74247]: No targets found.
Oct 16 19:11:33 user nova-compute[74247]: STATIC:
Oct 16 19:11:33 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2
Oct 16 19:11:33 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 19:11:33 user nova-compute[74247]:                 Iface Name: default
Oct 16 19:11:33 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034
Oct 16 19:11:33 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 19:11:33 user nova-compute[74247]:                 Iface Name: default
Oct 16 19:11:33 user nova-compute[74247]: FIRMWARE:
Oct 16 19:11:33 user nova-compute[74247]: No targets found.
Oct 16 19:11:33 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd13cc3-a301-45f4-a260-a420014d9bf0 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 19:11:33 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 19:11:33 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd13cc3-a301-45f4-a260-a420014d9bf0 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[092e30e8-b5e4-479b-9dd6-2a1f83e88bdd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca293fe6-7e76-4a0f-bdaa-a3a2c7e17cff]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd13cc3-a301-45f4-a260-a420014d9bf0 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034 (non-flash)
Oct 16 19:11:33 user nova-compute[74247]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2 (non-flash)
Oct 16 19:11:33 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd13cc3-a301-45f4-a260-a420014d9bf0 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034 (non-flash)
Oct 16 19:11:33 user nova-compute[74247]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2 (non-flash)
Oct 16 19:11:33 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd13cc3-a301-45f4-a260-a420014d9bf0 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe048399510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2'): ({'sdc'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-3fd13cc3-a301-45f4-a260-a420014d9bf0 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Removing single pathed devices sdc {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5f89be-fdca-4a7a-aec6-3ca42ffe600f]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2faf7c1-4665-4d5b-97e7-a7c8078d4f1f]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-3fd13cc3-a301-45f4-a260-a420014d9bf0 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Flushing IO for device /dev/sdc {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3362b5-3534-4097-bed3-abb3e86ce54e]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-3fd13cc3-a301-45f4-a260-a420014d9bf0 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6458ead6-7da8-4916-8bb9-11e01f3a971d]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-3fd13cc3-a301-45f4-a260-a420014d9bf0 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-3fd13cc3-a301-45f4-a260-a420014d9bf0 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] SCSI volumes sdc have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd13cc3-a301-45f4-a260-a420014d9bf0 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f1d256-d58e-471e-906c-6af2267f89c6]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd13cc3-a301-45f4-a260-a420014d9bf0 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2 -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac14e3f-1f11-4fa5-a769-a935c2f1fa2c]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd13cc3-a301-45f4-a260-a420014d9bf0 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2, portal: 172.16.0.220,3260]
Oct 16 19:11:33 user nova-compute[74247]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2, portal: 172.16.0.220,3260] successful.
Oct 16 19:11:33 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2 -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5595da2-943b-4307-8cc3-bcb47fc03ed2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7d065f-f227-4c00-9317-2e52eee0a309]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd13cc3-a301-45f4-a260-a420014d9bf0 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-3fd13cc3-a301-45f4-a260-a420014d9bf0 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd13cc3-a301-45f4-a260-a420014d9bf0 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] <== disconnect_volume: return (290ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 19:11:33 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fd13cc3-a301-45f4-a260-a420014d9bf0 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 19:11:34 user nova-compute[74247]: DEBUG nova.objects.instance [None req-3fd13cc3-a301-45f4-a260-a420014d9bf0 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lazy-loading 'flavor' on Instance uuid 1ed9efd5-9b55-4c9f-ad24-1f00958a8163 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:11:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3fd13cc3-a301-45f4-a260-a420014d9bf0 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "1ed9efd5-9b55-4c9f-ad24-1f00958a8163" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.664s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:11:34 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:11:34 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 19:11:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "refresh_cache-1ed9efd5-9b55-4c9f-ad24-1f00958a8163" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:11:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquired lock "refresh_cache-1ed9efd5-9b55-4c9f-ad24-1f00958a8163" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:11:34 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Forcefully refreshing network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 19:11:35 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Updating instance_info_cache with network_info: [{"id": "451a1a94-8dfe-4110-b756-665820c97e64", "address": "fa:16:3e:ed:f3:a4", "network": {"id": "baf3f2f3-1b8b-4c83-b488-9e7bd2323e54", "bridge": "br-int", "label": "tempest-TestStampPattern-1706551992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c41a39f4784703bcad1f7591a76d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451a1a94-8d", "ovs_interfaceid": "451a1a94-8dfe-4110-b756-665820c97e64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:11:35 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Releasing lock "refresh_cache-1ed9efd5-9b55-4c9f-ad24-1f00958a8163" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:11:35 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Updated the network info_cache for instance {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 19:11:35 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:11:35 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:11:35 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:11:35 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:11:35 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 19:11:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c98f761b-9569-4bdc-bb41-87201d78ee1c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:11:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c98f761b-9569-4bdc-bb41-87201d78ee1c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:11:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c98f761b-9569-4bdc-bb41-87201d78ee1c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:11:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c98f761b-9569-4bdc-bb41-87201d78ee1c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:11:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7342c6b4-7597-4a4d-a2a2-c770ff99398c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:11:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7342c6b4-7597-4a4d-a2a2-c770ff99398c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:11:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7342c6b4-7597-4a4d-a2a2-c770ff99398c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:11:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7342c6b4-7597-4a4d-a2a2-c770ff99398c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:11:35 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 19:11:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9efd5-9b55-4c9f-ad24-1f00958a8163/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:11:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9efd5-9b55-4c9f-ad24-1f00958a8163/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:11:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9efd5-9b55-4c9f-ad24-1f00958a8163/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:11:36 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9efd5-9b55-4c9f-ad24-1f00958a8163/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:11:36 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:11:36 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:11:36 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=8659MB free_disk=24.6837158203125GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 19:11:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:11:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:11:37 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance c98f761b-9569-4bdc-bb41-87201d78ee1c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 19:11:37 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 7342c6b4-7597-4a4d-a2a2-c770ff99398c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 19:11:37 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 1ed9efd5-9b55-4c9f-ad24-1f00958a8163 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 19:11:37 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 19:11:37 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 19:11:37 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Refreshing inventories for resource provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 16 19:11:37 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Updating ProviderTree inventory for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 16 19:11:37 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Updating inventory in ProviderTree for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 16 19:11:37 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Refreshing aggregate associations for resource provider 7b8a7b7b-c686-4162-903b-700fbc4d7273, aggregates: None {{(pid=74247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 16 19:11:37 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Refreshing trait associations for resource provider 7b8a7b7b-c686-4162-903b-700fbc4d7273, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=74247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 16 19:11:37 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:11:37 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 19:11:37 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 19:11:37 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 19:11:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.673s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:11:38 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:11:38 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:11:41 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:11:41 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:11:41 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 19:11:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:11:43 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:11:46 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:11:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:11:48 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:11:53 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:11:58 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:12:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:12:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:12:03 user nova-compute[74247]: DEBUG nova.compute.manager [req-3df58e10-8c29-404a-b84a-aca4658c2ee8 req-f89edf23-0901-4c9d-888b-3ee0bbcaab5e service nova] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Received event network-changed-451a1a94-8dfe-4110-b756-665820c97e64 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:12:03 user nova-compute[74247]: DEBUG nova.compute.manager [req-3df58e10-8c29-404a-b84a-aca4658c2ee8 req-f89edf23-0901-4c9d-888b-3ee0bbcaab5e service nova] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Refreshing instance network info cache due to event network-changed-451a1a94-8dfe-4110-b756-665820c97e64. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 19:12:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3df58e10-8c29-404a-b84a-aca4658c2ee8 req-f89edf23-0901-4c9d-888b-3ee0bbcaab5e service nova] Acquiring lock "refresh_cache-1ed9efd5-9b55-4c9f-ad24-1f00958a8163" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:12:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3df58e10-8c29-404a-b84a-aca4658c2ee8 req-f89edf23-0901-4c9d-888b-3ee0bbcaab5e service nova] Acquired lock "refresh_cache-1ed9efd5-9b55-4c9f-ad24-1f00958a8163" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:12:03 user nova-compute[74247]: DEBUG nova.network.neutron [req-3df58e10-8c29-404a-b84a-aca4658c2ee8 req-f89edf23-0901-4c9d-888b-3ee0bbcaab5e service nova] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Refreshing network info cache for port 451a1a94-8dfe-4110-b756-665820c97e64 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 19:12:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a0d99899-6a7d-45c6-ab9e-44247a4a1d59 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Acquiring lock "1ed9efd5-9b55-4c9f-ad24-1f00958a8163" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:12:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a0d99899-6a7d-45c6-ab9e-44247a4a1d59 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "1ed9efd5-9b55-4c9f-ad24-1f00958a8163" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:12:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a0d99899-6a7d-45c6-ab9e-44247a4a1d59 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Acquiring lock "1ed9efd5-9b55-4c9f-ad24-1f00958a8163-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:12:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a0d99899-6a7d-45c6-ab9e-44247a4a1d59 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "1ed9efd5-9b55-4c9f-ad24-1f00958a8163-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:12:03 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a0d99899-6a7d-45c6-ab9e-44247a4a1d59 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "1ed9efd5-9b55-4c9f-ad24-1f00958a8163-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:12:03 user nova-compute[74247]: INFO nova.compute.manager [None req-a0d99899-6a7d-45c6-ab9e-44247a4a1d59 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Terminating instance
Oct 16 19:12:03 user nova-compute[74247]: DEBUG nova.compute.manager [None req-a0d99899-6a7d-45c6-ab9e-44247a4a1d59 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 19:12:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:12:04 user nova-compute[74247]: DEBUG nova.compute.manager [req-565a1c6a-b5c5-41c5-9213-b9b93d23e0d8 req-6e696b37-2139-4f4b-b13e-8206cd5ddf99 service nova] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Received event network-vif-unplugged-451a1a94-8dfe-4110-b756-665820c97e64 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:12:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-565a1c6a-b5c5-41c5-9213-b9b93d23e0d8 req-6e696b37-2139-4f4b-b13e-8206cd5ddf99 service nova] Acquiring lock "1ed9efd5-9b55-4c9f-ad24-1f00958a8163-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:12:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-565a1c6a-b5c5-41c5-9213-b9b93d23e0d8 req-6e696b37-2139-4f4b-b13e-8206cd5ddf99 service nova] Lock "1ed9efd5-9b55-4c9f-ad24-1f00958a8163-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:12:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-565a1c6a-b5c5-41c5-9213-b9b93d23e0d8 req-6e696b37-2139-4f4b-b13e-8206cd5ddf99 service nova] Lock "1ed9efd5-9b55-4c9f-ad24-1f00958a8163-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:12:04 user nova-compute[74247]: DEBUG nova.compute.manager [req-565a1c6a-b5c5-41c5-9213-b9b93d23e0d8 req-6e696b37-2139-4f4b-b13e-8206cd5ddf99 service nova] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] No waiting events found dispatching network-vif-unplugged-451a1a94-8dfe-4110-b756-665820c97e64 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:12:04 user nova-compute[74247]: DEBUG nova.compute.manager [req-565a1c6a-b5c5-41c5-9213-b9b93d23e0d8 req-6e696b37-2139-4f4b-b13e-8206cd5ddf99 service nova] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Received event network-vif-unplugged-451a1a94-8dfe-4110-b756-665820c97e64 for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 19:12:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:12:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:12:04 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Instance destroyed successfully.
Oct 16 19:12:04 user nova-compute[74247]: DEBUG nova.objects.instance [None req-a0d99899-6a7d-45c6-ab9e-44247a4a1d59 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lazy-loading 'resources' on Instance uuid 1ed9efd5-9b55-4c9f-ad24-1f00958a8163 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:12:04 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-a0d99899-6a7d-45c6-ab9e-44247a4a1d59 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T19:08:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1135142007',display_name='tempest-TestStampPattern-server-1135142007',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1135142007',id=51,image_ref='82d96b97-b2af-4d74-9461-8691f6c34ae9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNxEdjHCqXg36WXekMM1Zh/PyzVI0ul1kYnElgqTDHXdRIJob26QfSPrWsyAE9isu855bMWOwxFPWIr1rugbT9wqVDtsPKJbjyx5N9NGEec2huAjGi342Kiv9qTpABeJw==',key_name='tempest-TestStampPattern-547736775',keypairs=<?>,launch_index=0,launched_at=2023-10-16T19:08:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c1c41a39f4784703bcad1f7591a76d11',ramdisk_id='',reservation_id='r-jjj9yw05',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='c98f761b-9569-4bdc-bb41-87201d78ee1c',image_min_disk='1',image_min_ram='0',image_owner_id='c1c41a39f4784703bcad1f7591a76d11',image_owner_project_name='tempest-TestStampPattern-595700511',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-595700511-project-member',image_user_id='b28a77b1cf14454595a99c9428c687b9',owner_project_name='tempest-TestStampPattern-595700511',owner_user_name='tempest-TestStampPattern-595700511-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T19:08:57Z,user_data=None,user_id='b28a77b1cf14454595a99c9428c687b9',uuid=1ed9efd5-9b55-4c9f-ad24-1f00958a8163,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "451a1a94-8dfe-4110-b756-665820c97e64", "address": "fa:16:3e:ed:f3:a4", "network": {"id": "baf3f2f3-1b8b-4c83-b488-9e7bd2323e54", "bridge": "br-int", "label": "tempest-TestStampPattern-1706551992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c41a39f4784703bcad1f7591a76d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451a1a94-8d", "ovs_interfaceid": "451a1a94-8dfe-4110-b756-665820c97e64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 19:12:04 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-a0d99899-6a7d-45c6-ab9e-44247a4a1d59 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Converting VIF {"id": "451a1a94-8dfe-4110-b756-665820c97e64", "address": "fa:16:3e:ed:f3:a4", "network": {"id": "baf3f2f3-1b8b-4c83-b488-9e7bd2323e54", "bridge": "br-int", "label": "tempest-TestStampPattern-1706551992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c41a39f4784703bcad1f7591a76d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451a1a94-8d", "ovs_interfaceid": "451a1a94-8dfe-4110-b756-665820c97e64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 19:12:04 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-a0d99899-6a7d-45c6-ab9e-44247a4a1d59 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:f3:a4,bridge_name='br-int',has_traffic_filtering=True,id=451a1a94-8dfe-4110-b756-665820c97e64,network=Network(baf3f2f3-1b8b-4c83-b488-9e7bd2323e54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap451a1a94-8d') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 19:12:04 user nova-compute[74247]: DEBUG os_vif [None req-a0d99899-6a7d-45c6-ab9e-44247a4a1d59 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:f3:a4,bridge_name='br-int',has_traffic_filtering=True,id=451a1a94-8dfe-4110-b756-665820c97e64,network=Network(baf3f2f3-1b8b-4c83-b488-9e7bd2323e54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap451a1a94-8d') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 19:12:04 user nova-compute[74247]: DEBUG nova.network.neutron [req-3df58e10-8c29-404a-b84a-aca4658c2ee8 req-f89edf23-0901-4c9d-888b-3ee0bbcaab5e service nova] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Updated VIF entry in instance network info cache for port 451a1a94-8dfe-4110-b756-665820c97e64. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 19:12:04 user nova-compute[74247]: DEBUG nova.network.neutron [req-3df58e10-8c29-404a-b84a-aca4658c2ee8 req-f89edf23-0901-4c9d-888b-3ee0bbcaab5e service nova] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Updating instance_info_cache with network_info: [{"id": "451a1a94-8dfe-4110-b756-665820c97e64", "address": "fa:16:3e:ed:f3:a4", "network": {"id": "baf3f2f3-1b8b-4c83-b488-9e7bd2323e54", "bridge": "br-int", "label": "tempest-TestStampPattern-1706551992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c41a39f4784703bcad1f7591a76d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451a1a94-8d", "ovs_interfaceid": "451a1a94-8dfe-4110-b756-665820c97e64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:12:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:12:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap451a1a94-8d, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:12:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:12:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:12:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:12:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:12:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1261a557-14cd-498c-8cbc-067288eeadfd) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:12:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:12:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:12:04 user nova-compute[74247]: INFO os_vif [None req-a0d99899-6a7d-45c6-ab9e-44247a4a1d59 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:f3:a4,bridge_name='br-int',has_traffic_filtering=True,id=451a1a94-8dfe-4110-b756-665820c97e64,network=Network(baf3f2f3-1b8b-4c83-b488-9e7bd2323e54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap451a1a94-8d')
Oct 16 19:12:04 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-a0d99899-6a7d-45c6-ab9e-44247a4a1d59 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Deleting instance files /opt/stack/data/nova/instances/1ed9efd5-9b55-4c9f-ad24-1f00958a8163_del
Oct 16 19:12:04 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-a0d99899-6a7d-45c6-ab9e-44247a4a1d59 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Deletion of /opt/stack/data/nova/instances/1ed9efd5-9b55-4c9f-ad24-1f00958a8163_del complete
Oct 16 19:12:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3df58e10-8c29-404a-b84a-aca4658c2ee8 req-f89edf23-0901-4c9d-888b-3ee0bbcaab5e service nova] Releasing lock "refresh_cache-1ed9efd5-9b55-4c9f-ad24-1f00958a8163" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:12:04 user nova-compute[74247]: INFO nova.compute.manager [None req-a0d99899-6a7d-45c6-ab9e-44247a4a1d59 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Took 0.94 seconds to destroy the instance on the hypervisor.
Oct 16 19:12:04 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-a0d99899-6a7d-45c6-ab9e-44247a4a1d59 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 19:12:04 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 19:12:04 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 19:12:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:12:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:12:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:12:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:12:05 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:12:05 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Took 0.75 seconds to deallocate network for instance.
Oct 16 19:12:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a0d99899-6a7d-45c6-ab9e-44247a4a1d59 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:12:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a0d99899-6a7d-45c6-ab9e-44247a4a1d59 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:12:05 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-a0d99899-6a7d-45c6-ab9e-44247a4a1d59 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 19:12:05 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-a0d99899-6a7d-45c6-ab9e-44247a4a1d59 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 19:12:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a0d99899-6a7d-45c6-ab9e-44247a4a1d59 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.163s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:12:05 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-a0d99899-6a7d-45c6-ab9e-44247a4a1d59 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Deleted allocations for instance 1ed9efd5-9b55-4c9f-ad24-1f00958a8163
Oct 16 19:12:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-68ceb6aa-0dc3-4cd6-8597-d87f4943abea req-61c70b9b-1c8d-47ea-b070-c45aadecaf5e service nova] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Received event network-vif-deleted-451a1a94-8dfe-4110-b756-665820c97e64 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:12:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-a0d99899-6a7d-45c6-ab9e-44247a4a1d59 tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "1ed9efd5-9b55-4c9f-ad24-1f00958a8163" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.081s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:12:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-d98c3682-76c8-4041-a6ac-b5fecc2600db req-09d2a66f-0d46-46aa-9866-7f8fdcb92f10 service nova] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Received event network-vif-plugged-451a1a94-8dfe-4110-b756-665820c97e64 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:12:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d98c3682-76c8-4041-a6ac-b5fecc2600db req-09d2a66f-0d46-46aa-9866-7f8fdcb92f10 service nova] Acquiring lock "1ed9efd5-9b55-4c9f-ad24-1f00958a8163-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:12:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d98c3682-76c8-4041-a6ac-b5fecc2600db req-09d2a66f-0d46-46aa-9866-7f8fdcb92f10 service nova] Lock "1ed9efd5-9b55-4c9f-ad24-1f00958a8163-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:12:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d98c3682-76c8-4041-a6ac-b5fecc2600db req-09d2a66f-0d46-46aa-9866-7f8fdcb92f10 service nova] Lock "1ed9efd5-9b55-4c9f-ad24-1f00958a8163-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:12:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-d98c3682-76c8-4041-a6ac-b5fecc2600db req-09d2a66f-0d46-46aa-9866-7f8fdcb92f10 service nova] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] No waiting events found dispatching network-vif-plugged-451a1a94-8dfe-4110-b756-665820c97e64 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:12:05 user nova-compute[74247]: WARNING nova.compute.manager [req-d98c3682-76c8-4041-a6ac-b5fecc2600db req-09d2a66f-0d46-46aa-9866-7f8fdcb92f10 service nova] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Received unexpected event network-vif-plugged-451a1a94-8dfe-4110-b756-665820c97e64 for instance with vm_state deleted and task_state None.
Oct 16 19:12:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-d98c3682-76c8-4041-a6ac-b5fecc2600db req-09d2a66f-0d46-46aa-9866-7f8fdcb92f10 service nova] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Received event network-vif-plugged-451a1a94-8dfe-4110-b756-665820c97e64 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:12:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d98c3682-76c8-4041-a6ac-b5fecc2600db req-09d2a66f-0d46-46aa-9866-7f8fdcb92f10 service nova] Acquiring lock "1ed9efd5-9b55-4c9f-ad24-1f00958a8163-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:12:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d98c3682-76c8-4041-a6ac-b5fecc2600db req-09d2a66f-0d46-46aa-9866-7f8fdcb92f10 service nova] Lock "1ed9efd5-9b55-4c9f-ad24-1f00958a8163-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:12:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d98c3682-76c8-4041-a6ac-b5fecc2600db req-09d2a66f-0d46-46aa-9866-7f8fdcb92f10 service nova] Lock "1ed9efd5-9b55-4c9f-ad24-1f00958a8163-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:12:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-d98c3682-76c8-4041-a6ac-b5fecc2600db req-09d2a66f-0d46-46aa-9866-7f8fdcb92f10 service nova] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] No waiting events found dispatching network-vif-plugged-451a1a94-8dfe-4110-b756-665820c97e64 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:12:05 user nova-compute[74247]: WARNING nova.compute.manager [req-d98c3682-76c8-4041-a6ac-b5fecc2600db req-09d2a66f-0d46-46aa-9866-7f8fdcb92f10 service nova] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Received unexpected event network-vif-plugged-451a1a94-8dfe-4110-b756-665820c97e64 for instance with vm_state deleted and task_state None.
Oct 16 19:12:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-d98c3682-76c8-4041-a6ac-b5fecc2600db req-09d2a66f-0d46-46aa-9866-7f8fdcb92f10 service nova] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Received event network-vif-plugged-451a1a94-8dfe-4110-b756-665820c97e64 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:12:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d98c3682-76c8-4041-a6ac-b5fecc2600db req-09d2a66f-0d46-46aa-9866-7f8fdcb92f10 service nova] Acquiring lock "1ed9efd5-9b55-4c9f-ad24-1f00958a8163-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:12:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d98c3682-76c8-4041-a6ac-b5fecc2600db req-09d2a66f-0d46-46aa-9866-7f8fdcb92f10 service nova] Lock "1ed9efd5-9b55-4c9f-ad24-1f00958a8163-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:12:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d98c3682-76c8-4041-a6ac-b5fecc2600db req-09d2a66f-0d46-46aa-9866-7f8fdcb92f10 service nova] Lock "1ed9efd5-9b55-4c9f-ad24-1f00958a8163-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:12:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-d98c3682-76c8-4041-a6ac-b5fecc2600db req-09d2a66f-0d46-46aa-9866-7f8fdcb92f10 service nova] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] No waiting events found dispatching network-vif-plugged-451a1a94-8dfe-4110-b756-665820c97e64 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:12:05 user nova-compute[74247]: WARNING nova.compute.manager [req-d98c3682-76c8-4041-a6ac-b5fecc2600db req-09d2a66f-0d46-46aa-9866-7f8fdcb92f10 service nova] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Received unexpected event network-vif-plugged-451a1a94-8dfe-4110-b756-665820c97e64 for instance with vm_state deleted and task_state None.
Oct 16 19:12:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-d98c3682-76c8-4041-a6ac-b5fecc2600db req-09d2a66f-0d46-46aa-9866-7f8fdcb92f10 service nova] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Received event network-vif-unplugged-451a1a94-8dfe-4110-b756-665820c97e64 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:12:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d98c3682-76c8-4041-a6ac-b5fecc2600db req-09d2a66f-0d46-46aa-9866-7f8fdcb92f10 service nova] Acquiring lock "1ed9efd5-9b55-4c9f-ad24-1f00958a8163-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:12:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d98c3682-76c8-4041-a6ac-b5fecc2600db req-09d2a66f-0d46-46aa-9866-7f8fdcb92f10 service nova] Lock "1ed9efd5-9b55-4c9f-ad24-1f00958a8163-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:12:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d98c3682-76c8-4041-a6ac-b5fecc2600db req-09d2a66f-0d46-46aa-9866-7f8fdcb92f10 service nova] Lock "1ed9efd5-9b55-4c9f-ad24-1f00958a8163-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:12:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-d98c3682-76c8-4041-a6ac-b5fecc2600db req-09d2a66f-0d46-46aa-9866-7f8fdcb92f10 service nova] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] No waiting events found dispatching network-vif-unplugged-451a1a94-8dfe-4110-b756-665820c97e64 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:12:05 user nova-compute[74247]: WARNING nova.compute.manager [req-d98c3682-76c8-4041-a6ac-b5fecc2600db req-09d2a66f-0d46-46aa-9866-7f8fdcb92f10 service nova] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Received unexpected event network-vif-unplugged-451a1a94-8dfe-4110-b756-665820c97e64 for instance with vm_state deleted and task_state None.
Oct 16 19:12:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-d98c3682-76c8-4041-a6ac-b5fecc2600db req-09d2a66f-0d46-46aa-9866-7f8fdcb92f10 service nova] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Received event network-vif-plugged-451a1a94-8dfe-4110-b756-665820c97e64 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:12:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d98c3682-76c8-4041-a6ac-b5fecc2600db req-09d2a66f-0d46-46aa-9866-7f8fdcb92f10 service nova] Acquiring lock "1ed9efd5-9b55-4c9f-ad24-1f00958a8163-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:12:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d98c3682-76c8-4041-a6ac-b5fecc2600db req-09d2a66f-0d46-46aa-9866-7f8fdcb92f10 service nova] Lock "1ed9efd5-9b55-4c9f-ad24-1f00958a8163-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:12:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d98c3682-76c8-4041-a6ac-b5fecc2600db req-09d2a66f-0d46-46aa-9866-7f8fdcb92f10 service nova] Lock "1ed9efd5-9b55-4c9f-ad24-1f00958a8163-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:12:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-d98c3682-76c8-4041-a6ac-b5fecc2600db req-09d2a66f-0d46-46aa-9866-7f8fdcb92f10 service nova] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] No waiting events found dispatching network-vif-plugged-451a1a94-8dfe-4110-b756-665820c97e64 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:12:05 user nova-compute[74247]: WARNING nova.compute.manager [req-d98c3682-76c8-4041-a6ac-b5fecc2600db req-09d2a66f-0d46-46aa-9866-7f8fdcb92f10 service nova] [instance: 1ed9efd5-9b55-4c9f-ad24-1f00958a8163] Received unexpected event network-vif-plugged-451a1a94-8dfe-4110-b756-665820c97e64 for instance with vm_state deleted and task_state None.
Oct 16 19:12:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:12:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:12:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:12:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:12:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:12:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:12:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:12:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:12:23 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:12:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:12:29 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:12:33 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:12:33 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:12:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:12:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:12:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:12:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:12:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:12:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:12:34 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:12:34 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:12:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:12:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:12:34 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:12:34 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 19:12:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c98f761b-9569-4bdc-bb41-87201d78ee1c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:12:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c98f761b-9569-4bdc-bb41-87201d78ee1c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:12:34 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c98f761b-9569-4bdc-bb41-87201d78ee1c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:12:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c98f761b-9569-4bdc-bb41-87201d78ee1c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:12:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7342c6b4-7597-4a4d-a2a2-c770ff99398c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:12:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7342c6b4-7597-4a4d-a2a2-c770ff99398c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:12:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7342c6b4-7597-4a4d-a2a2-c770ff99398c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:12:35 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7342c6b4-7597-4a4d-a2a2-c770ff99398c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:12:35 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 19:12:35 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:12:35 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:12:35 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=8825MB free_disk=24.684059143066406GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 19:12:35 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:12:35 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:12:36 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance c98f761b-9569-4bdc-bb41-87201d78ee1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 19:12:36 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 7342c6b4-7597-4a4d-a2a2-c770ff99398c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 19:12:36 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 19:12:36 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 19:12:36 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 19:12:36 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 19:12:36 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 19:12:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.320s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:12:38 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:12:38 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 19:12:38 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Rebuilding the list of instances to heal {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 19:12:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "refresh_cache-c98f761b-9569-4bdc-bb41-87201d78ee1c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:12:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquired lock "refresh_cache-c98f761b-9569-4bdc-bb41-87201d78ee1c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:12:38 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Forcefully refreshing network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 19:12:38 user nova-compute[74247]: DEBUG nova.objects.instance [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lazy-loading 'info_cache' on Instance uuid c98f761b-9569-4bdc-bb41-87201d78ee1c {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:12:38 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Updating instance_info_cache with network_info: [{"id": "ca03492e-c602-4ae1-ae43-63b37a989463", "address": "fa:16:3e:34:00:5c", "network": {"id": "baf3f2f3-1b8b-4c83-b488-9e7bd2323e54", "bridge": "br-int", "label": "tempest-TestStampPattern-1706551992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c41a39f4784703bcad1f7591a76d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca03492e-c6", "ovs_interfaceid": "ca03492e-c602-4ae1-ae43-63b37a989463", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:12:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Releasing lock "refresh_cache-c98f761b-9569-4bdc-bb41-87201d78ee1c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:12:38 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Updated the network info_cache for instance {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 19:12:38 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:12:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:12:41 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:12:41 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:12:41 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 19:12:44 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:12:44 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:12:44 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:12:44 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:12:44 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:12:44 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:12:46 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:12:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:12:54 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:12:54 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:12:54 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:12:54 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:12:54 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:12:54 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:12:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:13:03 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:13:04 user nova-compute[74247]: DEBUG nova.compute.manager [req-271901c8-c2aa-4987-926a-b76e4ed3d74d req-f9cbdfc6-91d6-4ac9-ad24-10dacf9f33c3 service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Received event network-changed-94e4aefa-d790-4eb7-ba5e-6437f32b3305 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:13:04 user nova-compute[74247]: DEBUG nova.compute.manager [req-271901c8-c2aa-4987-926a-b76e4ed3d74d req-f9cbdfc6-91d6-4ac9-ad24-10dacf9f33c3 service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Refreshing instance network info cache due to event network-changed-94e4aefa-d790-4eb7-ba5e-6437f32b3305. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 19:13:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-271901c8-c2aa-4987-926a-b76e4ed3d74d req-f9cbdfc6-91d6-4ac9-ad24-10dacf9f33c3 service nova] Acquiring lock "refresh_cache-7342c6b4-7597-4a4d-a2a2-c770ff99398c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:13:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-271901c8-c2aa-4987-926a-b76e4ed3d74d req-f9cbdfc6-91d6-4ac9-ad24-10dacf9f33c3 service nova] Acquired lock "refresh_cache-7342c6b4-7597-4a4d-a2a2-c770ff99398c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:13:04 user nova-compute[74247]: DEBUG nova.network.neutron [req-271901c8-c2aa-4987-926a-b76e4ed3d74d req-f9cbdfc6-91d6-4ac9-ad24-10dacf9f33c3 service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Refreshing network info cache for port 94e4aefa-d790-4eb7-ba5e-6437f32b3305 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 19:13:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:13:04 user nova-compute[74247]: DEBUG nova.network.neutron [req-271901c8-c2aa-4987-926a-b76e4ed3d74d req-f9cbdfc6-91d6-4ac9-ad24-10dacf9f33c3 service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Updated VIF entry in instance network info cache for port 94e4aefa-d790-4eb7-ba5e-6437f32b3305. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 19:13:04 user nova-compute[74247]: DEBUG nova.network.neutron [req-271901c8-c2aa-4987-926a-b76e4ed3d74d req-f9cbdfc6-91d6-4ac9-ad24-10dacf9f33c3 service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Updating instance_info_cache with network_info: [{"id": "94e4aefa-d790-4eb7-ba5e-6437f32b3305", "address": "fa:16:3e:7a:e1:0d", "network": {"id": "5801391d-4968-4504-9f23-8683eeb63a54", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2082110052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cb6a3c6bdd484d9a8d0c27bf1ac2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e4aefa-d7", "ovs_interfaceid": "94e4aefa-d790-4eb7-ba5e-6437f32b3305", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:13:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-271901c8-c2aa-4987-926a-b76e4ed3d74d req-f9cbdfc6-91d6-4ac9-ad24-10dacf9f33c3 service nova] Releasing lock "refresh_cache-7342c6b4-7597-4a4d-a2a2-c770ff99398c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:13:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-fce1c468-0531-4bc3-8c27-dc40dca99bee tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Acquiring lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:13:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-fce1c468-0531-4bc3-8c27-dc40dca99bee tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:13:05 user nova-compute[74247]: INFO nova.compute.manager [None req-fce1c468-0531-4bc3-8c27-dc40dca99bee tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Detaching volume d14e8f54-ce4f-4164-a05a-25f78a3c5034
Oct 16 19:13:05 user nova-compute[74247]: INFO nova.virt.block_device [None req-fce1c468-0531-4bc3-8c27-dc40dca99bee tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Attempting to driver detach volume d14e8f54-ce4f-4164-a05a-25f78a3c5034 from mountpoint /dev/vdb
Oct 16 19:13:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-fce1c468-0531-4bc3-8c27-dc40dca99bee tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Attempting to detach device vdb from instance 7342c6b4-7597-4a4d-a2a2-c770ff99398c from the persistent domain config. {{(pid=74247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 19:13:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-fce1c468-0531-4bc3-8c27-dc40dca99bee tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 19:13:05 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 19:13:05 user nova-compute[74247]:   <source dev="/dev/sdb"/>
Oct 16 19:13:05 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 19:13:05 user nova-compute[74247]:   <serial>d14e8f54-ce4f-4164-a05a-25f78a3c5034</serial>
Oct 16 19:13:05 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 19:13:05 user nova-compute[74247]: </disk>
Oct 16 19:13:05 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 19:13:05 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-fce1c468-0531-4bc3-8c27-dc40dca99bee tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Successfully detached device vdb from instance 7342c6b4-7597-4a4d-a2a2-c770ff99398c from the persistent domain config.
Oct 16 19:13:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-fce1c468-0531-4bc3-8c27-dc40dca99bee tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7342c6b4-7597-4a4d-a2a2-c770ff99398c from the live domain config. {{(pid=74247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 19:13:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-fce1c468-0531-4bc3-8c27-dc40dca99bee tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 19:13:05 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 19:13:05 user nova-compute[74247]:   <source dev="/dev/sdb"/>
Oct 16 19:13:05 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 19:13:05 user nova-compute[74247]:   <serial>d14e8f54-ce4f-4164-a05a-25f78a3c5034</serial>
Oct 16 19:13:05 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 19:13:05 user nova-compute[74247]: </disk>
Oct 16 19:13:05 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 19:13:06 user nova-compute[74247]: DEBUG nova.compute.manager [req-35b0b9a4-094c-46fc-b9eb-318d6bc15d01 req-ddb79ee5-a8c2-4ce4-9439-1df0eddbc06e service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Received event network-changed-94e4aefa-d790-4eb7-ba5e-6437f32b3305 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:13:06 user nova-compute[74247]: DEBUG nova.compute.manager [req-35b0b9a4-094c-46fc-b9eb-318d6bc15d01 req-ddb79ee5-a8c2-4ce4-9439-1df0eddbc06e service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Refreshing instance network info cache due to event network-changed-94e4aefa-d790-4eb7-ba5e-6437f32b3305. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 19:13:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-35b0b9a4-094c-46fc-b9eb-318d6bc15d01 req-ddb79ee5-a8c2-4ce4-9439-1df0eddbc06e service nova] Acquiring lock "refresh_cache-7342c6b4-7597-4a4d-a2a2-c770ff99398c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:13:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-35b0b9a4-094c-46fc-b9eb-318d6bc15d01 req-ddb79ee5-a8c2-4ce4-9439-1df0eddbc06e service nova] Acquired lock "refresh_cache-7342c6b4-7597-4a4d-a2a2-c770ff99398c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:13:06 user nova-compute[74247]: DEBUG nova.network.neutron [req-35b0b9a4-094c-46fc-b9eb-318d6bc15d01 req-ddb79ee5-a8c2-4ce4-9439-1df0eddbc06e service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Refreshing network info cache for port 94e4aefa-d790-4eb7-ba5e-6437f32b3305 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 19:13:06 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-fce1c468-0531-4bc3-8c27-dc40dca99bee tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7342c6b4-7597-4a4d-a2a2-c770ff99398c {{(pid=74247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 19:13:06 user nova-compute[74247]: DEBUG nova.network.neutron [req-35b0b9a4-094c-46fc-b9eb-318d6bc15d01 req-ddb79ee5-a8c2-4ce4-9439-1df0eddbc06e service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Updated VIF entry in instance network info cache for port 94e4aefa-d790-4eb7-ba5e-6437f32b3305. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 19:13:06 user nova-compute[74247]: DEBUG nova.network.neutron [req-35b0b9a4-094c-46fc-b9eb-318d6bc15d01 req-ddb79ee5-a8c2-4ce4-9439-1df0eddbc06e service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Updating instance_info_cache with network_info: [{"id": "94e4aefa-d790-4eb7-ba5e-6437f32b3305", "address": "fa:16:3e:7a:e1:0d", "network": {"id": "5801391d-4968-4504-9f23-8683eeb63a54", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2082110052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cb6a3c6bdd484d9a8d0c27bf1ac2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e4aefa-d7", "ovs_interfaceid": "94e4aefa-d790-4eb7-ba5e-6437f32b3305", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:13:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-35b0b9a4-094c-46fc-b9eb-318d6bc15d01 req-ddb79ee5-a8c2-4ce4-9439-1df0eddbc06e service nova] Releasing lock "refresh_cache-7342c6b4-7597-4a4d-a2a2-c770ff99398c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:13:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:13:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:13:13 user nova-compute[74247]: DEBUG nova.compute.manager [req-ed412018-c034-4c4e-8561-b0f8befe27fe req-5ad2522e-a70d-463d-ad7b-2f5d05361b61 service nova] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Received event network-changed-ca03492e-c602-4ae1-ae43-63b37a989463 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:13:13 user nova-compute[74247]: DEBUG nova.compute.manager [req-ed412018-c034-4c4e-8561-b0f8befe27fe req-5ad2522e-a70d-463d-ad7b-2f5d05361b61 service nova] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Refreshing instance network info cache due to event network-changed-ca03492e-c602-4ae1-ae43-63b37a989463. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 19:13:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-ed412018-c034-4c4e-8561-b0f8befe27fe req-5ad2522e-a70d-463d-ad7b-2f5d05361b61 service nova] Acquiring lock "refresh_cache-c98f761b-9569-4bdc-bb41-87201d78ee1c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:13:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-ed412018-c034-4c4e-8561-b0f8befe27fe req-5ad2522e-a70d-463d-ad7b-2f5d05361b61 service nova] Acquired lock "refresh_cache-c98f761b-9569-4bdc-bb41-87201d78ee1c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:13:13 user nova-compute[74247]: DEBUG nova.network.neutron [req-ed412018-c034-4c4e-8561-b0f8befe27fe req-5ad2522e-a70d-463d-ad7b-2f5d05361b61 service nova] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Refreshing network info cache for port ca03492e-c602-4ae1-ae43-63b37a989463 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 19:13:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e7013b95-852c-457b-bbad-d150204dc04a tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Acquiring lock "c98f761b-9569-4bdc-bb41-87201d78ee1c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:13:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e7013b95-852c-457b-bbad-d150204dc04a tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "c98f761b-9569-4bdc-bb41-87201d78ee1c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:13:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e7013b95-852c-457b-bbad-d150204dc04a tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Acquiring lock "c98f761b-9569-4bdc-bb41-87201d78ee1c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:13:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e7013b95-852c-457b-bbad-d150204dc04a tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "c98f761b-9569-4bdc-bb41-87201d78ee1c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:13:13 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e7013b95-852c-457b-bbad-d150204dc04a tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "c98f761b-9569-4bdc-bb41-87201d78ee1c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:13:13 user nova-compute[74247]: INFO nova.compute.manager [None req-e7013b95-852c-457b-bbad-d150204dc04a tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Terminating instance
Oct 16 19:13:13 user nova-compute[74247]: DEBUG nova.compute.manager [None req-e7013b95-852c-457b-bbad-d150204dc04a tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 19:13:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:13:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:13:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:13:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:13:14 user nova-compute[74247]: DEBUG nova.network.neutron [req-ed412018-c034-4c4e-8561-b0f8befe27fe req-5ad2522e-a70d-463d-ad7b-2f5d05361b61 service nova] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Updated VIF entry in instance network info cache for port ca03492e-c602-4ae1-ae43-63b37a989463. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 19:13:14 user nova-compute[74247]: DEBUG nova.network.neutron [req-ed412018-c034-4c4e-8561-b0f8befe27fe req-5ad2522e-a70d-463d-ad7b-2f5d05361b61 service nova] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Updating instance_info_cache with network_info: [{"id": "ca03492e-c602-4ae1-ae43-63b37a989463", "address": "fa:16:3e:34:00:5c", "network": {"id": "baf3f2f3-1b8b-4c83-b488-9e7bd2323e54", "bridge": "br-int", "label": "tempest-TestStampPattern-1706551992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c41a39f4784703bcad1f7591a76d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca03492e-c6", "ovs_interfaceid": "ca03492e-c602-4ae1-ae43-63b37a989463", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:13:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-ed412018-c034-4c4e-8561-b0f8befe27fe req-5ad2522e-a70d-463d-ad7b-2f5d05361b61 service nova] Releasing lock "refresh_cache-c98f761b-9569-4bdc-bb41-87201d78ee1c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:13:14 user nova-compute[74247]: DEBUG nova.compute.manager [req-90816f32-53ac-4ea9-a1e5-85e7eb1c2d84 req-ce13e5f9-270c-4f10-8cd9-ea427379d865 service nova] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Received event network-vif-unplugged-ca03492e-c602-4ae1-ae43-63b37a989463 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:13:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-90816f32-53ac-4ea9-a1e5-85e7eb1c2d84 req-ce13e5f9-270c-4f10-8cd9-ea427379d865 service nova] Acquiring lock "c98f761b-9569-4bdc-bb41-87201d78ee1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:13:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-90816f32-53ac-4ea9-a1e5-85e7eb1c2d84 req-ce13e5f9-270c-4f10-8cd9-ea427379d865 service nova] Lock "c98f761b-9569-4bdc-bb41-87201d78ee1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:13:14 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-90816f32-53ac-4ea9-a1e5-85e7eb1c2d84 req-ce13e5f9-270c-4f10-8cd9-ea427379d865 service nova] Lock "c98f761b-9569-4bdc-bb41-87201d78ee1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:13:14 user nova-compute[74247]: DEBUG nova.compute.manager [req-90816f32-53ac-4ea9-a1e5-85e7eb1c2d84 req-ce13e5f9-270c-4f10-8cd9-ea427379d865 service nova] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] No waiting events found dispatching network-vif-unplugged-ca03492e-c602-4ae1-ae43-63b37a989463 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:13:14 user nova-compute[74247]: DEBUG nova.compute.manager [req-90816f32-53ac-4ea9-a1e5-85e7eb1c2d84 req-ce13e5f9-270c-4f10-8cd9-ea427379d865 service nova] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Received event network-vif-unplugged-ca03492e-c602-4ae1-ae43-63b37a989463 for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 19:13:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:13:14 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Instance destroyed successfully.
Oct 16 19:13:14 user nova-compute[74247]: DEBUG nova.objects.instance [None req-e7013b95-852c-457b-bbad-d150204dc04a tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lazy-loading 'resources' on Instance uuid c98f761b-9569-4bdc-bb41-87201d78ee1c {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:13:14 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-e7013b95-852c-457b-bbad-d150204dc04a tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T19:05:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1510741437',display_name='tempest-TestStampPattern-server-1510741437',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1510741437',id=49,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNxEdjHCqXg36WXekMM1Zh/PyzVI0ul1kYnElgqTDHXdRIJob26QfSPrWsyAE9isu855bMWOwxFPWIr1rugbT9wqVDtsPKJbjyx5N9NGEec2huAjGi342Kiv9qTpABeJw==',key_name='tempest-TestStampPattern-547736775',keypairs=<?>,launch_index=0,launched_at=2023-10-16T19:05:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c1c41a39f4784703bcad1f7591a76d11',ramdisk_id='',reservation_id='r-shyy4w85',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-595700511',owner_user_name='tempest-TestStampPattern-595700511-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T19:08:48Z,user_data=None,user_id='b28a77b1cf14454595a99c9428c687b9',uuid=c98f761b-9569-4bdc-bb41-87201d78ee1c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca03492e-c602-4ae1-ae43-63b37a989463", "address": "fa:16:3e:34:00:5c", "network": {"id": "baf3f2f3-1b8b-4c83-b488-9e7bd2323e54", "bridge": "br-int", "label": "tempest-TestStampPattern-1706551992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c41a39f4784703bcad1f7591a76d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca03492e-c6", "ovs_interfaceid": "ca03492e-c602-4ae1-ae43-63b37a989463", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 19:13:14 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-e7013b95-852c-457b-bbad-d150204dc04a tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Converting VIF {"id": "ca03492e-c602-4ae1-ae43-63b37a989463", "address": "fa:16:3e:34:00:5c", "network": {"id": "baf3f2f3-1b8b-4c83-b488-9e7bd2323e54", "bridge": "br-int", "label": "tempest-TestStampPattern-1706551992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c41a39f4784703bcad1f7591a76d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca03492e-c6", "ovs_interfaceid": "ca03492e-c602-4ae1-ae43-63b37a989463", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 19:13:14 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-e7013b95-852c-457b-bbad-d150204dc04a tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:00:5c,bridge_name='br-int',has_traffic_filtering=True,id=ca03492e-c602-4ae1-ae43-63b37a989463,network=Network(baf3f2f3-1b8b-4c83-b488-9e7bd2323e54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca03492e-c6') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 19:13:14 user nova-compute[74247]: DEBUG os_vif [None req-e7013b95-852c-457b-bbad-d150204dc04a tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:00:5c,bridge_name='br-int',has_traffic_filtering=True,id=ca03492e-c602-4ae1-ae43-63b37a989463,network=Network(baf3f2f3-1b8b-4c83-b488-9e7bd2323e54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca03492e-c6') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 19:13:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:13:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapca03492e-c6, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:13:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:13:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:13:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:13:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7e1e335d-3785-40ca-bdda-dde7c1cbd008) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:13:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:13:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:13:14 user nova-compute[74247]: INFO os_vif [None req-e7013b95-852c-457b-bbad-d150204dc04a tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:00:5c,bridge_name='br-int',has_traffic_filtering=True,id=ca03492e-c602-4ae1-ae43-63b37a989463,network=Network(baf3f2f3-1b8b-4c83-b488-9e7bd2323e54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca03492e-c6')
Oct 16 19:13:14 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-e7013b95-852c-457b-bbad-d150204dc04a tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Deleting instance files /opt/stack/data/nova/instances/c98f761b-9569-4bdc-bb41-87201d78ee1c_del
Oct 16 19:13:14 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-e7013b95-852c-457b-bbad-d150204dc04a tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Deletion of /opt/stack/data/nova/instances/c98f761b-9569-4bdc-bb41-87201d78ee1c_del complete
Oct 16 19:13:14 user nova-compute[74247]: INFO nova.compute.manager [None req-e7013b95-852c-457b-bbad-d150204dc04a tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 16 19:13:14 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-e7013b95-852c-457b-bbad-d150204dc04a tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 19:13:14 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 19:13:14 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 19:13:15 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:13:15 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Took 0.44 seconds to deallocate network for instance.
Oct 16 19:13:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e7013b95-852c-457b-bbad-d150204dc04a tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:13:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e7013b95-852c-457b-bbad-d150204dc04a tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:13:15 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-e7013b95-852c-457b-bbad-d150204dc04a tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 19:13:15 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-e7013b95-852c-457b-bbad-d150204dc04a tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 19:13:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e7013b95-852c-457b-bbad-d150204dc04a tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.136s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:13:15 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-e7013b95-852c-457b-bbad-d150204dc04a tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Deleted allocations for instance c98f761b-9569-4bdc-bb41-87201d78ee1c
Oct 16 19:13:15 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-e7013b95-852c-457b-bbad-d150204dc04a tempest-TestStampPattern-595700511 tempest-TestStampPattern-595700511-project-member] Lock "c98f761b-9569-4bdc-bb41-87201d78ee1c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.659s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:13:16 user nova-compute[74247]: DEBUG nova.compute.manager [req-0e64c221-a206-4b59-be13-3cdc1ac44d5c req-56c4fac6-9982-43f2-b5ff-4416c0fd77c7 service nova] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Received event network-vif-plugged-ca03492e-c602-4ae1-ae43-63b37a989463 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:13:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0e64c221-a206-4b59-be13-3cdc1ac44d5c req-56c4fac6-9982-43f2-b5ff-4416c0fd77c7 service nova] Acquiring lock "c98f761b-9569-4bdc-bb41-87201d78ee1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:13:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0e64c221-a206-4b59-be13-3cdc1ac44d5c req-56c4fac6-9982-43f2-b5ff-4416c0fd77c7 service nova] Lock "c98f761b-9569-4bdc-bb41-87201d78ee1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:13:16 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0e64c221-a206-4b59-be13-3cdc1ac44d5c req-56c4fac6-9982-43f2-b5ff-4416c0fd77c7 service nova] Lock "c98f761b-9569-4bdc-bb41-87201d78ee1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:13:16 user nova-compute[74247]: DEBUG nova.compute.manager [req-0e64c221-a206-4b59-be13-3cdc1ac44d5c req-56c4fac6-9982-43f2-b5ff-4416c0fd77c7 service nova] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] No waiting events found dispatching network-vif-plugged-ca03492e-c602-4ae1-ae43-63b37a989463 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:13:16 user nova-compute[74247]: WARNING nova.compute.manager [req-0e64c221-a206-4b59-be13-3cdc1ac44d5c req-56c4fac6-9982-43f2-b5ff-4416c0fd77c7 service nova] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Received unexpected event network-vif-plugged-ca03492e-c602-4ae1-ae43-63b37a989463 for instance with vm_state deleted and task_state None.
Oct 16 19:13:16 user nova-compute[74247]: DEBUG nova.compute.manager [req-0e64c221-a206-4b59-be13-3cdc1ac44d5c req-56c4fac6-9982-43f2-b5ff-4416c0fd77c7 service nova] [instance: c98f761b-9569-4bdc-bb41-87201d78ee1c] Received event network-vif-deleted-ca03492e-c602-4ae1-ae43-63b37a989463 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:13:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:13:23 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:13:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:13:26 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-fce1c468-0531-4bc3-8c27-dc40dca99bee tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7342c6b4-7597-4a4d-a2a2-c770ff99398c is timed out.
Oct 16 19:13:26 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-fce1c468-0531-4bc3-8c27-dc40dca99bee tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Successfully detached device vdb from instance 7342c6b4-7597-4a4d-a2a2-c770ff99398c from the live domain config.
Oct 16 19:13:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fce1c468-0531-4bc3-8c27-dc40dca99bee tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce1c468-0531-4bc3-8c27-dc40dca99bee tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DbHZYUQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 19:13:26 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-fce1c468-0531-4bc3-8c27-dc40dca99bee tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 19:13:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-fce1c468-0531-4bc3-8c27-dc40dca99bee tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-fce1c468-0531-4bc3-8c27-dc40dca99bee tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fac1de2-a619-4dfa-9697-ade97b18911c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce1c468-0531-4bc3-8c27-dc40dca99bee tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 19:13:26 user nova-compute[74247]: No targets found.
Oct 16 19:13:26 user nova-compute[74247]: iSNS:
Oct 16 19:13:26 user nova-compute[74247]: No targets found.
Oct 16 19:13:26 user nova-compute[74247]: STATIC:
Oct 16 19:13:26 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034
Oct 16 19:13:26 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 19:13:26 user nova-compute[74247]:                 Iface Name: default
Oct 16 19:13:26 user nova-compute[74247]: FIRMWARE:
Oct 16 19:13:26 user nova-compute[74247]: No targets found.
Oct 16 19:13:26 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce1c468-0531-4bc3-8c27-dc40dca99bee tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 19:13:26 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 19:13:26 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce1c468-0531-4bc3-8c27-dc40dca99bee tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc1ac2e-e199-47c0-bd20-7b04cb26bc41]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f81601-f491-4f9a-9d18-05dfa2001d92]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce1c468-0531-4bc3-8c27-dc40dca99bee tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034 (non-flash)
Oct 16 19:13:26 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce1c468-0531-4bc3-8c27-dc40dca99bee tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034 (non-flash)
Oct 16 19:13:26 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce1c468-0531-4bc3-8c27-dc40dca99bee tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe048218670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034'): ({'sdb'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-fce1c468-0531-4bc3-8c27-dc40dca99bee tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Removing single pathed devices sdb {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb85891-3a8d-40ae-8fd0-7ea0d5263f8a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b193c0a9-36ca-4d66-b2b2-ac56d1b7d711]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-fce1c468-0531-4bc3-8c27-dc40dca99bee tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Flushing IO for device /dev/sdb {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[711d3151-70d3-448a-adf2-cd75d9203ac9]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-fce1c468-0531-4bc3-8c27-dc40dca99bee tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.063s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[86063ba7-a4b1-4aa9-84e1-41576553cd25]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-fce1c468-0531-4bc3-8c27-dc40dca99bee tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-fce1c468-0531-4bc3-8c27-dc40dca99bee tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] SCSI volumes sdb have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce1c468-0531-4bc3-8c27-dc40dca99bee tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e44a976-bd44-48d1-8224-c896f6ab1b56]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce1c468-0531-4bc3-8c27-dc40dca99bee tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034 -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[33eb3d18-39ef-42c8-accf-f7721533e5e4]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce1c468-0531-4bc3-8c27-dc40dca99bee tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034, portal: 172.16.0.220,3260]
Oct 16 19:13:26 user nova-compute[74247]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034, portal: 172.16.0.220,3260] successful.
Oct 16 19:13:26 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034 -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d14e8f54-ce4f-4164-a05a-25f78a3c5034 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfc51e5-7a10-429c-ae78-6b507af6dd46]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce1c468-0531-4bc3-8c27-dc40dca99bee tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-fce1c468-0531-4bc3-8c27-dc40dca99bee tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce1c468-0531-4bc3-8c27-dc40dca99bee tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] <== disconnect_volume: return (317ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 19:13:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fce1c468-0531-4bc3-8c27-dc40dca99bee tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 19:13:27 user nova-compute[74247]: DEBUG nova.objects.instance [None req-fce1c468-0531-4bc3-8c27-dc40dca99bee tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lazy-loading 'flavor' on Instance uuid 7342c6b4-7597-4a4d-a2a2-c770ff99398c {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:13:27 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-fce1c468-0531-4bc3-8c27-dc40dca99bee tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.797s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:13:29 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:13:29 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:13:29 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:13:29 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:13:29 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:13:29 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:13:33 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:13:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:13:35 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:13:36 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:13:36 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 19:13:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "refresh_cache-7342c6b4-7597-4a4d-a2a2-c770ff99398c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:13:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquired lock "refresh_cache-7342c6b4-7597-4a4d-a2a2-c770ff99398c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:13:36 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Forcefully refreshing network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 19:13:37 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Updating instance_info_cache with network_info: [{"id": "94e4aefa-d790-4eb7-ba5e-6437f32b3305", "address": "fa:16:3e:7a:e1:0d", "network": {"id": "5801391d-4968-4504-9f23-8683eeb63a54", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2082110052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cb6a3c6bdd484d9a8d0c27bf1ac2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e4aefa-d7", "ovs_interfaceid": "94e4aefa-d790-4eb7-ba5e-6437f32b3305", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:13:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Releasing lock "refresh_cache-7342c6b4-7597-4a4d-a2a2-c770ff99398c" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:13:37 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Updated the network info_cache for instance {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 19:13:37 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:13:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:13:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:13:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:13:37 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 19:13:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7342c6b4-7597-4a4d-a2a2-c770ff99398c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:13:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7342c6b4-7597-4a4d-a2a2-c770ff99398c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:13:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7342c6b4-7597-4a4d-a2a2-c770ff99398c/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:13:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7342c6b4-7597-4a4d-a2a2-c770ff99398c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:13:37 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:13:37 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:13:37 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=8908MB free_disk=24.80841064453125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 19:13:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:13:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:13:38 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 7342c6b4-7597-4a4d-a2a2-c770ff99398c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 19:13:38 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 19:13:38 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 19:13:38 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 19:13:38 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 19:13:38 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 19:13:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.215s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:13:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:13:39 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:13:42 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:13:43 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:13:43 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 19:13:44 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:13:44 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:13:44 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:13:44 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:13:44 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:13:44 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:13:47 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:13:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:13:54 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:13:54 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:13:54 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:13:54 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:13:54 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:13:54 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:13:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:13:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:13:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:13:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:13:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:13:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:14:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-bf50d842-ebac-4d57-aa46-cd504dccfdcb tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Acquiring lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:14:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-bf50d842-ebac-4d57-aa46-cd504dccfdcb tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:14:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-bf50d842-ebac-4d57-aa46-cd504dccfdcb tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Acquiring lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:14:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-bf50d842-ebac-4d57-aa46-cd504dccfdcb tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:14:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-bf50d842-ebac-4d57-aa46-cd504dccfdcb tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:14:04 user nova-compute[74247]: INFO nova.compute.manager [None req-bf50d842-ebac-4d57-aa46-cd504dccfdcb tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Terminating instance
Oct 16 19:14:04 user nova-compute[74247]: DEBUG nova.compute.manager [None req-bf50d842-ebac-4d57-aa46-cd504dccfdcb tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 19:14:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:14:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:14:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:14:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:14:04 user nova-compute[74247]: DEBUG nova.compute.manager [req-36cf2963-8856-4c32-95ee-e48e2bbf8b52 req-3eba4a23-7337-4dd3-a75d-16bbadeb94c6 service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Received event network-vif-unplugged-94e4aefa-d790-4eb7-ba5e-6437f32b3305 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:14:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-36cf2963-8856-4c32-95ee-e48e2bbf8b52 req-3eba4a23-7337-4dd3-a75d-16bbadeb94c6 service nova] Acquiring lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:14:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-36cf2963-8856-4c32-95ee-e48e2bbf8b52 req-3eba4a23-7337-4dd3-a75d-16bbadeb94c6 service nova] Lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:14:04 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-36cf2963-8856-4c32-95ee-e48e2bbf8b52 req-3eba4a23-7337-4dd3-a75d-16bbadeb94c6 service nova] Lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:14:04 user nova-compute[74247]: DEBUG nova.compute.manager [req-36cf2963-8856-4c32-95ee-e48e2bbf8b52 req-3eba4a23-7337-4dd3-a75d-16bbadeb94c6 service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] No waiting events found dispatching network-vif-unplugged-94e4aefa-d790-4eb7-ba5e-6437f32b3305 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:14:04 user nova-compute[74247]: DEBUG nova.compute.manager [req-36cf2963-8856-4c32-95ee-e48e2bbf8b52 req-3eba4a23-7337-4dd3-a75d-16bbadeb94c6 service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Received event network-vif-unplugged-94e4aefa-d790-4eb7-ba5e-6437f32b3305 for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 19:14:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:14:05 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Instance destroyed successfully.
Oct 16 19:14:05 user nova-compute[74247]: DEBUG nova.objects.instance [None req-bf50d842-ebac-4d57-aa46-cd504dccfdcb tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lazy-loading 'resources' on Instance uuid 7342c6b4-7597-4a4d-a2a2-c770ff99398c {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:14:05 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-bf50d842-ebac-4d57-aa46-cd504dccfdcb tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T19:08:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1474275686',display_name='tempest-TestMinimumBasicScenario-server-1474275686',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1474275686',id=50,image_ref='d76765c7-e435-419a-a1e6-135b68d25bc6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLy984zKXfWcr+qrmnnf+PRN3ZevxqvwoR8EVBJsoKsGkrUb+S3p672oy87GJpObXxQd5tsI1EwukbRXJx2NMzK2VW9PVG+t9s1MntGX1icQApLfLM5huuv9OE55lGakEA==',key_name='tempest-TestMinimumBasicScenario-451463780',keypairs=<?>,launch_index=0,launched_at=2023-10-16T19:08:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42cb6a3c6bdd484d9a8d0c27bf1ac2fb',ramdisk_id='',reservation_id='r-cn1s0417',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d76765c7-e435-419a-a1e6-135b68d25bc6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-218992455',owner_user_name='tempest-TestMinimumBasicScenario-218992455-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T19:11:19Z,user_data=None,user_id='7414f773f7a94a13938c406bf02b3bac',uuid=7342c6b4-7597-4a4d-a2a2-c770ff99398c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94e4aefa-d790-4eb7-ba5e-6437f32b3305", "address": "fa:16:3e:7a:e1:0d", "network": {"id": "5801391d-4968-4504-9f23-8683eeb63a54", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2082110052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cb6a3c6bdd484d9a8d0c27bf1ac2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e4aefa-d7", "ovs_interfaceid": "94e4aefa-d790-4eb7-ba5e-6437f32b3305", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 19:14:05 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-bf50d842-ebac-4d57-aa46-cd504dccfdcb tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Converting VIF {"id": "94e4aefa-d790-4eb7-ba5e-6437f32b3305", "address": "fa:16:3e:7a:e1:0d", "network": {"id": "5801391d-4968-4504-9f23-8683eeb63a54", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2082110052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cb6a3c6bdd484d9a8d0c27bf1ac2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e4aefa-d7", "ovs_interfaceid": "94e4aefa-d790-4eb7-ba5e-6437f32b3305", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 19:14:05 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-bf50d842-ebac-4d57-aa46-cd504dccfdcb tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:e1:0d,bridge_name='br-int',has_traffic_filtering=True,id=94e4aefa-d790-4eb7-ba5e-6437f32b3305,network=Network(5801391d-4968-4504-9f23-8683eeb63a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94e4aefa-d7') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 19:14:05 user nova-compute[74247]: DEBUG os_vif [None req-bf50d842-ebac-4d57-aa46-cd504dccfdcb tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:e1:0d,bridge_name='br-int',has_traffic_filtering=True,id=94e4aefa-d790-4eb7-ba5e-6437f32b3305,network=Network(5801391d-4968-4504-9f23-8683eeb63a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94e4aefa-d7') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 19:14:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:14:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94e4aefa-d7, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:14:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:14:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:14:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:14:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ba1df6c4-1e6e-423b-89b0-4c08ef42c69d) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:14:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:14:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:14:05 user nova-compute[74247]: INFO os_vif [None req-bf50d842-ebac-4d57-aa46-cd504dccfdcb tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:e1:0d,bridge_name='br-int',has_traffic_filtering=True,id=94e4aefa-d790-4eb7-ba5e-6437f32b3305,network=Network(5801391d-4968-4504-9f23-8683eeb63a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94e4aefa-d7')
Oct 16 19:14:05 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-bf50d842-ebac-4d57-aa46-cd504dccfdcb tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Deleting instance files /opt/stack/data/nova/instances/7342c6b4-7597-4a4d-a2a2-c770ff99398c_del
Oct 16 19:14:05 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-bf50d842-ebac-4d57-aa46-cd504dccfdcb tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Deletion of /opt/stack/data/nova/instances/7342c6b4-7597-4a4d-a2a2-c770ff99398c_del complete
Oct 16 19:14:05 user nova-compute[74247]: INFO nova.compute.manager [None req-bf50d842-ebac-4d57-aa46-cd504dccfdcb tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 16 19:14:05 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-bf50d842-ebac-4d57-aa46-cd504dccfdcb tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 19:14:05 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 19:14:05 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 19:14:05 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:14:05 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Took 0.49 seconds to deallocate network for instance.
Oct 16 19:14:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-a8dc3a52-25f2-46a6-bb28-a57e3b0cfe7a req-e113c310-a4f2-4a65-9032-4dc0cb17d082 service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Received event network-vif-deleted-94e4aefa-d790-4eb7-ba5e-6437f32b3305 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:14:05 user nova-compute[74247]: INFO nova.compute.manager [req-a8dc3a52-25f2-46a6-bb28-a57e3b0cfe7a req-e113c310-a4f2-4a65-9032-4dc0cb17d082 service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Neutron deleted interface 94e4aefa-d790-4eb7-ba5e-6437f32b3305; detaching it from the instance and deleting it from the info cache
Oct 16 19:14:05 user nova-compute[74247]: DEBUG nova.network.neutron [req-a8dc3a52-25f2-46a6-bb28-a57e3b0cfe7a req-e113c310-a4f2-4a65-9032-4dc0cb17d082 service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:14:05 user nova-compute[74247]: DEBUG nova.compute.manager [req-a8dc3a52-25f2-46a6-bb28-a57e3b0cfe7a req-e113c310-a4f2-4a65-9032-4dc0cb17d082 service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Detach interface failed, port_id=94e4aefa-d790-4eb7-ba5e-6437f32b3305, reason: Instance 7342c6b4-7597-4a4d-a2a2-c770ff99398c could not be found. {{(pid=74247) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 19:14:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-bf50d842-ebac-4d57-aa46-cd504dccfdcb tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:14:05 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-bf50d842-ebac-4d57-aa46-cd504dccfdcb tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:14:06 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-bf50d842-ebac-4d57-aa46-cd504dccfdcb tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 19:14:06 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-bf50d842-ebac-4d57-aa46-cd504dccfdcb tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 19:14:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-bf50d842-ebac-4d57-aa46-cd504dccfdcb tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.122s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:14:06 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-bf50d842-ebac-4d57-aa46-cd504dccfdcb tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Deleted allocations for instance 7342c6b4-7597-4a4d-a2a2-c770ff99398c
Oct 16 19:14:06 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-bf50d842-ebac-4d57-aa46-cd504dccfdcb tempest-TestMinimumBasicScenario-218992455 tempest-TestMinimumBasicScenario-218992455-project-member] Lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.730s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:14:07 user nova-compute[74247]: DEBUG nova.compute.manager [req-3ec3632d-e8e3-43bc-a9ed-1c476a3ad3dd req-a258d20d-077e-4b34-866e-e8ae47bdb0e7 service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Received event network-vif-plugged-94e4aefa-d790-4eb7-ba5e-6437f32b3305 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:14:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3ec3632d-e8e3-43bc-a9ed-1c476a3ad3dd req-a258d20d-077e-4b34-866e-e8ae47bdb0e7 service nova] Acquiring lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:14:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3ec3632d-e8e3-43bc-a9ed-1c476a3ad3dd req-a258d20d-077e-4b34-866e-e8ae47bdb0e7 service nova] Lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:14:07 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-3ec3632d-e8e3-43bc-a9ed-1c476a3ad3dd req-a258d20d-077e-4b34-866e-e8ae47bdb0e7 service nova] Lock "7342c6b4-7597-4a4d-a2a2-c770ff99398c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:14:07 user nova-compute[74247]: DEBUG nova.compute.manager [req-3ec3632d-e8e3-43bc-a9ed-1c476a3ad3dd req-a258d20d-077e-4b34-866e-e8ae47bdb0e7 service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] No waiting events found dispatching network-vif-plugged-94e4aefa-d790-4eb7-ba5e-6437f32b3305 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:14:07 user nova-compute[74247]: WARNING nova.compute.manager [req-3ec3632d-e8e3-43bc-a9ed-1c476a3ad3dd req-a258d20d-077e-4b34-866e-e8ae47bdb0e7 service nova] [instance: 7342c6b4-7597-4a4d-a2a2-c770ff99398c] Received unexpected event network-vif-plugged-94e4aefa-d790-4eb7-ba5e-6437f32b3305 for instance with vm_state deleted and task_state None.
Oct 16 19:14:10 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:14:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:14:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:14:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:14:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:14:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:14:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:14:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:14:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:14:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:14:23 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:14:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:14:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:14:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:14:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:14:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:14:25 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:14:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:14:33 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:14:34 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:14:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:14:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:14:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:14:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:14:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:14:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:14:36 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:14:36 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 19:14:36 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Rebuilding the list of instances to heal {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 19:14:36 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Didn't find any instances for network info cache update. {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 19:14:36 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:14:36 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:14:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:14:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:14:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:14:36 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 19:14:37 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:14:37 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:14:37 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=9120MB free_disk=24.835006713867188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 19:14:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:14:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:14:37 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 19:14:37 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 19:14:37 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 19:14:37 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 19:14:37 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 19:14:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:14:39 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:14:40 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:14:42 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:14:45 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:14:45 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:14:45 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 19:14:48 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:14:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:14:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:14:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:14:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:14:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:14:50 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:14:55 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:14:57 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:15:00 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:15:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:15:05 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:15:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:15:07 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:15:08 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:15:10 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:15:12 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:15:12 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:15:13 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:15:15 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:15:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:15:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Acquiring lock "17ccd1c6-817a-4421-b043-a8229feb0a29" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:15:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lock "17ccd1c6-817a-4421-b043-a8229feb0a29" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:15:17 user nova-compute[74247]: DEBUG nova.compute.manager [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Starting instance... {{(pid=74247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 19:15:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:15:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:15:17 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 19:15:17 user nova-compute[74247]: INFO nova.compute.claims [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Claim successful on node user
Oct 16 19:15:17 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 19:15:17 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 19:15:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.215s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:15:17 user nova-compute[74247]: DEBUG nova.compute.manager [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Start building networks asynchronously for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 19:15:17 user nova-compute[74247]: DEBUG nova.compute.manager [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Allocating IP information in the background. {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 19:15:17 user nova-compute[74247]: DEBUG nova.network.neutron [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] allocate_for_instance() {{(pid=74247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 19:15:17 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 19:15:17 user nova-compute[74247]: DEBUG nova.compute.manager [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Start building block device mappings for instance. {{(pid=74247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 19:15:17 user nova-compute[74247]: DEBUG nova.compute.manager [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Start spawning the instance on the hypervisor. {{(pid=74247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 19:15:17 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Creating instance directory {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 19:15:17 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Creating image(s)
Oct 16 19:15:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Acquiring lock "/opt/stack/data/nova/instances/17ccd1c6-817a-4421-b043-a8229feb0a29/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:15:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lock "/opt/stack/data/nova/instances/17ccd1c6-817a-4421-b043-a8229feb0a29/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:15:17 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lock "/opt/stack/data/nova/instances/17ccd1c6-817a-4421-b043-a8229feb0a29/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:15:17 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:15:17 user nova-compute[74247]: DEBUG nova.policy [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7628a82438654c36b20aaa5f2d0c6db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba84ebc7e30c480f9f10ed27ed51c51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74247) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 19:15:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.172s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:15:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Acquiring lock "37399febbd18f60b85fd0f833558f6a3539ab231" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:15:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:15:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:15:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.192s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:15:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/17ccd1c6-817a-4421-b043-a8229feb0a29/disk 1073741824 {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:15:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231,backing_fmt=raw /opt/stack/data/nova/instances/17ccd1c6-817a-4421-b043-a8229feb0a29/disk 1073741824" returned: 0 in 0.052s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:15:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lock "37399febbd18f60b85fd0f833558f6a3539ab231" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:15:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:15:18 user nova-compute[74247]: DEBUG nova.network.neutron [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Successfully created port: 0efc8452-2a89-4e9e-8ad3-c97c142fbbe2 {{(pid=74247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 19:15:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37399febbd18f60b85fd0f833558f6a3539ab231 --force-share --output=json" returned: 0 in 0.199s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:15:18 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Checking if we can resize image /opt/stack/data/nova/instances/17ccd1c6-817a-4421-b043-a8229feb0a29/disk. size=1073741824 {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 19:15:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17ccd1c6-817a-4421-b043-a8229feb0a29/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:15:18 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17ccd1c6-817a-4421-b043-a8229feb0a29/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:15:18 user nova-compute[74247]: DEBUG nova.virt.disk.api [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Cannot resize image /opt/stack/data/nova/instances/17ccd1c6-817a-4421-b043-a8229feb0a29/disk to a smaller size. {{(pid=74247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 19:15:18 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Created local disks {{(pid=74247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 19:15:18 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Ensure instance console log exists: /opt/stack/data/nova/instances/17ccd1c6-817a-4421-b043-a8229feb0a29/console.log {{(pid=74247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 19:15:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:15:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:15:18 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG nova.network.neutron [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Successfully updated port: 0efc8452-2a89-4e9e-8ad3-c97c142fbbe2 {{(pid=74247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Acquiring lock "refresh_cache-17ccd1c6-817a-4421-b043-a8229feb0a29" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Acquired lock "refresh_cache-17ccd1c6-817a-4421-b043-a8229feb0a29" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG nova.network.neutron [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Building network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG nova.compute.manager [req-d6a2f196-10af-4c7c-924d-e2b0865fa70c req-c695a7fc-3b2f-4ae8-adcd-3f14cb9bcfc7 service nova] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Received event network-changed-0efc8452-2a89-4e9e-8ad3-c97c142fbbe2 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG nova.compute.manager [req-d6a2f196-10af-4c7c-924d-e2b0865fa70c req-c695a7fc-3b2f-4ae8-adcd-3f14cb9bcfc7 service nova] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Refreshing instance network info cache due to event network-changed-0efc8452-2a89-4e9e-8ad3-c97c142fbbe2. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d6a2f196-10af-4c7c-924d-e2b0865fa70c req-c695a7fc-3b2f-4ae8-adcd-3f14cb9bcfc7 service nova] Acquiring lock "refresh_cache-17ccd1c6-817a-4421-b043-a8229feb0a29" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG nova.network.neutron [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Instance cache missing network info. {{(pid=74247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG nova.network.neutron [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Updating instance_info_cache with network_info: [{"id": "0efc8452-2a89-4e9e-8ad3-c97c142fbbe2", "address": "fa:16:3e:48:70:dd", "network": {"id": "605c88e1-153d-4d31-a57b-7e38962706e6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1265267696-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba84ebc7e30c480f9f10ed27ed51c51f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0efc8452-2a", "ovs_interfaceid": "0efc8452-2a89-4e9e-8ad3-c97c142fbbe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Releasing lock "refresh_cache-17ccd1c6-817a-4421-b043-a8229feb0a29" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG nova.compute.manager [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Instance network_info: |[{"id": "0efc8452-2a89-4e9e-8ad3-c97c142fbbe2", "address": "fa:16:3e:48:70:dd", "network": {"id": "605c88e1-153d-4d31-a57b-7e38962706e6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1265267696-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba84ebc7e30c480f9f10ed27ed51c51f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0efc8452-2a", "ovs_interfaceid": "0efc8452-2a89-4e9e-8ad3-c97c142fbbe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d6a2f196-10af-4c7c-924d-e2b0865fa70c req-c695a7fc-3b2f-4ae8-adcd-3f14cb9bcfc7 service nova] Acquired lock "refresh_cache-17ccd1c6-817a-4421-b043-a8229feb0a29" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG nova.network.neutron [req-d6a2f196-10af-4c7c-924d-e2b0865fa70c req-c695a7fc-3b2f-4ae8-adcd-3f14cb9bcfc7 service nova] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Refreshing network info cache for port 0efc8452-2a89-4e9e-8ad3-c97c142fbbe2 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Start _get_guest_xml network_info=[{"id": "0efc8452-2a89-4e9e-8ad3-c97c142fbbe2", "address": "fa:16:3e:48:70:dd", "network": {"id": "605c88e1-153d-4d31-a57b-7e38962706e6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1265267696-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba84ebc7e30c480f9f10ed27ed51c51f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0efc8452-2a", "ovs_interfaceid": "0efc8452-2a89-4e9e-8ad3-c97c142fbbe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'encrypted': False, 'image_id': '83126bb1-29f5-42fe-8620-72ab0797f776'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 19:15:19 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:15:19 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:15:19 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] CPU controller missing on host. {{(pid=74247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG nova.virt.libvirt.host [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] CPU controller found on host. {{(pid=74247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T18:20:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T18:20:15Z,direct_url=<?>,disk_format='qcow2',id=83126bb1-29f5-42fe-8620-72ab0797f776,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='12ee40b874d34e56adcfd74c16123017',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T18:20:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Flavor limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Image limits 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Flavor pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Image pref 0:0:0 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Got 1 possible topologies {{(pid=74247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG nova.virt.hardware [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T19:15:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1683795670',display_name='tempest-TestServerVolumeAttachmentScenario-server-1683795670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1683795670',id=52,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhIwpYRDMEswwPRbVH6NxzSbdlqjHg67FPdmeWPvpuSA8R0pT/B1xkig2qdHF//9OAh1vAxrsiCNsqq+UbVYZd/D0RsGnVl+BxCYB7NeB80LfeOd1To4AKSehqc/nwVWA==',key_name='tempest-keypair-511833156',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba84ebc7e30c480f9f10ed27ed51c51f',ramdisk_id='',reservation_id='r-pp4okpvj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-257558189',owner_user_name='tempest-TestServerVolumeAttachmentScenario-257558189-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T19:15:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7628a82438654c36b20aaa5f2d0c6db0',uuid=17ccd1c6-817a-4421-b043-a8229feb0a29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0efc8452-2a89-4e9e-8ad3-c97c142fbbe2", "address": "fa:16:3e:48:70:dd", "network": {"id": "605c88e1-153d-4d31-a57b-7e38962706e6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1265267696-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba84ebc7e30c480f9f10ed27ed51c51f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0efc8452-2a", "ovs_interfaceid": "0efc8452-2a89-4e9e-8ad3-c97c142fbbe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Converting VIF {"id": "0efc8452-2a89-4e9e-8ad3-c97c142fbbe2", "address": "fa:16:3e:48:70:dd", "network": {"id": "605c88e1-153d-4d31-a57b-7e38962706e6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1265267696-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba84ebc7e30c480f9f10ed27ed51c51f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0efc8452-2a", "ovs_interfaceid": "0efc8452-2a89-4e9e-8ad3-c97c142fbbe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:70:dd,bridge_name='br-int',has_traffic_filtering=True,id=0efc8452-2a89-4e9e-8ad3-c97c142fbbe2,network=Network(605c88e1-153d-4d31-a57b-7e38962706e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0efc8452-2a') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG nova.objects.instance [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lazy-loading 'pci_devices' on Instance uuid 17ccd1c6-817a-4421-b043-a8229feb0a29 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] End _get_guest_xml xml=<domain type="kvm">
Oct 16 19:15:19 user nova-compute[74247]:   <uuid>17ccd1c6-817a-4421-b043-a8229feb0a29</uuid>
Oct 16 19:15:19 user nova-compute[74247]:   <name>instance-00000034</name>
Oct 16 19:15:19 user nova-compute[74247]:   <memory>524288</memory>
Oct 16 19:15:19 user nova-compute[74247]:   <vcpu>1</vcpu>
Oct 16 19:15:19 user nova-compute[74247]:   <metadata>
Oct 16 19:15:19 user nova-compute[74247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 19:15:19 user nova-compute[74247]:       <nova:package version="0.0.0"/>
Oct 16 19:15:19 user nova-compute[74247]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1683795670</nova:name>
Oct 16 19:15:19 user nova-compute[74247]:       <nova:creationTime>2023-10-16 19:15:19</nova:creationTime>
Oct 16 19:15:19 user nova-compute[74247]:       <nova:flavor name="m1.tiny">
Oct 16 19:15:19 user nova-compute[74247]:         <nova:memory>512</nova:memory>
Oct 16 19:15:19 user nova-compute[74247]:         <nova:disk>1</nova:disk>
Oct 16 19:15:19 user nova-compute[74247]:         <nova:swap>0</nova:swap>
Oct 16 19:15:19 user nova-compute[74247]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 19:15:19 user nova-compute[74247]:         <nova:vcpus>1</nova:vcpus>
Oct 16 19:15:19 user nova-compute[74247]:       </nova:flavor>
Oct 16 19:15:19 user nova-compute[74247]:       <nova:owner>
Oct 16 19:15:19 user nova-compute[74247]:         <nova:user uuid="7628a82438654c36b20aaa5f2d0c6db0">tempest-TestServerVolumeAttachmentScenario-257558189-project-member</nova:user>
Oct 16 19:15:19 user nova-compute[74247]:         <nova:project uuid="ba84ebc7e30c480f9f10ed27ed51c51f">tempest-TestServerVolumeAttachmentScenario-257558189</nova:project>
Oct 16 19:15:19 user nova-compute[74247]:       </nova:owner>
Oct 16 19:15:19 user nova-compute[74247]:       <nova:root type="image" uuid="83126bb1-29f5-42fe-8620-72ab0797f776"/>
Oct 16 19:15:19 user nova-compute[74247]:       <nova:ports>
Oct 16 19:15:19 user nova-compute[74247]:         <nova:port uuid="0efc8452-2a89-4e9e-8ad3-c97c142fbbe2">
Oct 16 19:15:19 user nova-compute[74247]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 16 19:15:19 user nova-compute[74247]:         </nova:port>
Oct 16 19:15:19 user nova-compute[74247]:       </nova:ports>
Oct 16 19:15:19 user nova-compute[74247]:     </nova:instance>
Oct 16 19:15:19 user nova-compute[74247]:   </metadata>
Oct 16 19:15:19 user nova-compute[74247]:   <sysinfo type="smbios">
Oct 16 19:15:19 user nova-compute[74247]:     <system>
Oct 16 19:15:19 user nova-compute[74247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 19:15:19 user nova-compute[74247]:       <entry name="product">OpenStack Nova</entry>
Oct 16 19:15:19 user nova-compute[74247]:       <entry name="version">0.0.0</entry>
Oct 16 19:15:19 user nova-compute[74247]:       <entry name="serial">17ccd1c6-817a-4421-b043-a8229feb0a29</entry>
Oct 16 19:15:19 user nova-compute[74247]:       <entry name="uuid">17ccd1c6-817a-4421-b043-a8229feb0a29</entry>
Oct 16 19:15:19 user nova-compute[74247]:       <entry name="family">Virtual Machine</entry>
Oct 16 19:15:19 user nova-compute[74247]:     </system>
Oct 16 19:15:19 user nova-compute[74247]:   </sysinfo>
Oct 16 19:15:19 user nova-compute[74247]:   <os>
Oct 16 19:15:19 user nova-compute[74247]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 19:15:19 user nova-compute[74247]:     <boot dev="hd"/>
Oct 16 19:15:19 user nova-compute[74247]:     <smbios mode="sysinfo"/>
Oct 16 19:15:19 user nova-compute[74247]:   </os>
Oct 16 19:15:19 user nova-compute[74247]:   <features>
Oct 16 19:15:19 user nova-compute[74247]:     <acpi/>
Oct 16 19:15:19 user nova-compute[74247]:     <apic/>
Oct 16 19:15:19 user nova-compute[74247]:     <vmcoreinfo/>
Oct 16 19:15:19 user nova-compute[74247]:   </features>
Oct 16 19:15:19 user nova-compute[74247]:   <clock offset="utc">
Oct 16 19:15:19 user nova-compute[74247]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 19:15:19 user nova-compute[74247]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 19:15:19 user nova-compute[74247]:     <timer name="hpet" present="no"/>
Oct 16 19:15:19 user nova-compute[74247]:   </clock>
Oct 16 19:15:19 user nova-compute[74247]:   <cpu mode="custom" match="exact">
Oct 16 19:15:19 user nova-compute[74247]:     <model>Nehalem</model>
Oct 16 19:15:19 user nova-compute[74247]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 19:15:19 user nova-compute[74247]:   </cpu>
Oct 16 19:15:19 user nova-compute[74247]:   <devices>
Oct 16 19:15:19 user nova-compute[74247]:     <disk type="file" device="disk">
Oct 16 19:15:19 user nova-compute[74247]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 19:15:19 user nova-compute[74247]:       <source file="/opt/stack/data/nova/instances/17ccd1c6-817a-4421-b043-a8229feb0a29/disk"/>
Oct 16 19:15:19 user nova-compute[74247]:       <target dev="vda" bus="virtio"/>
Oct 16 19:15:19 user nova-compute[74247]:     </disk>
Oct 16 19:15:19 user nova-compute[74247]:     <interface type="ethernet">
Oct 16 19:15:19 user nova-compute[74247]:       <mac address="fa:16:3e:48:70:dd"/>
Oct 16 19:15:19 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 19:15:19 user nova-compute[74247]:       <mtu size="1442"/>
Oct 16 19:15:19 user nova-compute[74247]:       <target dev="tap0efc8452-2a"/>
Oct 16 19:15:19 user nova-compute[74247]:     </interface>
Oct 16 19:15:19 user nova-compute[74247]:     <serial type="pty">
Oct 16 19:15:19 user nova-compute[74247]:       <log file="/opt/stack/data/nova/instances/17ccd1c6-817a-4421-b043-a8229feb0a29/console.log" append="off"/>
Oct 16 19:15:19 user nova-compute[74247]:     </serial>
Oct 16 19:15:19 user nova-compute[74247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 19:15:19 user nova-compute[74247]:     <video>
Oct 16 19:15:19 user nova-compute[74247]:       <model type="virtio"/>
Oct 16 19:15:19 user nova-compute[74247]:     </video>
Oct 16 19:15:19 user nova-compute[74247]:     <rng model="virtio">
Oct 16 19:15:19 user nova-compute[74247]:       <backend model="random">/dev/urandom</backend>
Oct 16 19:15:19 user nova-compute[74247]:     </rng>
Oct 16 19:15:19 user nova-compute[74247]:     <controller type="usb" index="0" model="none"/>
Oct 16 19:15:19 user nova-compute[74247]:     <memballoon model="virtio">
Oct 16 19:15:19 user nova-compute[74247]:       <stats period="10"/>
Oct 16 19:15:19 user nova-compute[74247]:     </memballoon>
Oct 16 19:15:19 user nova-compute[74247]:   </devices>
Oct 16 19:15:19 user nova-compute[74247]: </domain>
Oct 16 19:15:19 user nova-compute[74247]:  {{(pid=74247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T19:15:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1683795670',display_name='tempest-TestServerVolumeAttachmentScenario-server-1683795670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1683795670',id=52,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhIwpYRDMEswwPRbVH6NxzSbdlqjHg67FPdmeWPvpuSA8R0pT/B1xkig2qdHF//9OAh1vAxrsiCNsqq+UbVYZd/D0RsGnVl+BxCYB7NeB80LfeOd1To4AKSehqc/nwVWA==',key_name='tempest-keypair-511833156',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba84ebc7e30c480f9f10ed27ed51c51f',ramdisk_id='',reservation_id='r-pp4okpvj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-257558189',owner_user_name='tempest-TestServerVolumeAttachmentScenario-257558189-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T19:15:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7628a82438654c36b20aaa5f2d0c6db0',uuid=17ccd1c6-817a-4421-b043-a8229feb0a29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0efc8452-2a89-4e9e-8ad3-c97c142fbbe2", "address": "fa:16:3e:48:70:dd", "network": {"id": "605c88e1-153d-4d31-a57b-7e38962706e6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1265267696-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba84ebc7e30c480f9f10ed27ed51c51f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0efc8452-2a", "ovs_interfaceid": "0efc8452-2a89-4e9e-8ad3-c97c142fbbe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Converting VIF {"id": "0efc8452-2a89-4e9e-8ad3-c97c142fbbe2", "address": "fa:16:3e:48:70:dd", "network": {"id": "605c88e1-153d-4d31-a57b-7e38962706e6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1265267696-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba84ebc7e30c480f9f10ed27ed51c51f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0efc8452-2a", "ovs_interfaceid": "0efc8452-2a89-4e9e-8ad3-c97c142fbbe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:70:dd,bridge_name='br-int',has_traffic_filtering=True,id=0efc8452-2a89-4e9e-8ad3-c97c142fbbe2,network=Network(605c88e1-153d-4d31-a57b-7e38962706e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0efc8452-2a') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG os_vif [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:70:dd,bridge_name='br-int',has_traffic_filtering=True,id=0efc8452-2a89-4e9e-8ad3-c97c142fbbe2,network=Network(605c88e1-153d-4d31-a57b-7e38962706e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0efc8452-2a') {{(pid=74247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f695a1f3-9c65-5fe2-8afa-45234fe8ccb1', '_type': 'linux-noop'}}, row=False) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0efc8452-2a, may_exist=True, interface_attrs={}) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0efc8452-2a, col_values=(('qos', UUID('17cc63f7-ce95-41ce-a7b5-e478283a9aa9')),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0efc8452-2a, col_values=(('external_ids', {'iface-id': '0efc8452-2a89-4e9e-8ad3-c97c142fbbe2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:70:dd', 'vm-uuid': '17ccd1c6-817a-4421-b043-a8229feb0a29'}),), if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:15:19 user nova-compute[74247]: INFO os_vif [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:70:dd,bridge_name='br-int',has_traffic_filtering=True,id=0efc8452-2a89-4e9e-8ad3-c97c142fbbe2,network=Network(605c88e1-153d-4d31-a57b-7e38962706e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0efc8452-2a')
Oct 16 19:15:19 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] No VIF found with MAC fa:16:3e:48:70:dd, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG nova.network.neutron [req-d6a2f196-10af-4c7c-924d-e2b0865fa70c req-c695a7fc-3b2f-4ae8-adcd-3f14cb9bcfc7 service nova] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Updated VIF entry in instance network info cache for port 0efc8452-2a89-4e9e-8ad3-c97c142fbbe2. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG nova.network.neutron [req-d6a2f196-10af-4c7c-924d-e2b0865fa70c req-c695a7fc-3b2f-4ae8-adcd-3f14cb9bcfc7 service nova] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Updating instance_info_cache with network_info: [{"id": "0efc8452-2a89-4e9e-8ad3-c97c142fbbe2", "address": "fa:16:3e:48:70:dd", "network": {"id": "605c88e1-153d-4d31-a57b-7e38962706e6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1265267696-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba84ebc7e30c480f9f10ed27ed51c51f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0efc8452-2a", "ovs_interfaceid": "0efc8452-2a89-4e9e-8ad3-c97c142fbbe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:15:19 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-d6a2f196-10af-4c7c-924d-e2b0865fa70c req-c695a7fc-3b2f-4ae8-adcd-3f14cb9bcfc7 service nova] Releasing lock "refresh_cache-17ccd1c6-817a-4421-b043-a8229feb0a29" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:15:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:15:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:15:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:15:20 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:15:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:15:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:15:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:15:21 user nova-compute[74247]: DEBUG nova.compute.manager [req-a7040766-e439-48a8-8a21-2005378e82f4 req-b081ff81-c4ec-44a6-aafe-616262df7e58 service nova] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Received event network-vif-plugged-0efc8452-2a89-4e9e-8ad3-c97c142fbbe2 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:15:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a7040766-e439-48a8-8a21-2005378e82f4 req-b081ff81-c4ec-44a6-aafe-616262df7e58 service nova] Acquiring lock "17ccd1c6-817a-4421-b043-a8229feb0a29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:15:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a7040766-e439-48a8-8a21-2005378e82f4 req-b081ff81-c4ec-44a6-aafe-616262df7e58 service nova] Lock "17ccd1c6-817a-4421-b043-a8229feb0a29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:15:21 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-a7040766-e439-48a8-8a21-2005378e82f4 req-b081ff81-c4ec-44a6-aafe-616262df7e58 service nova] Lock "17ccd1c6-817a-4421-b043-a8229feb0a29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:15:21 user nova-compute[74247]: DEBUG nova.compute.manager [req-a7040766-e439-48a8-8a21-2005378e82f4 req-b081ff81-c4ec-44a6-aafe-616262df7e58 service nova] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] No waiting events found dispatching network-vif-plugged-0efc8452-2a89-4e9e-8ad3-c97c142fbbe2 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:15:21 user nova-compute[74247]: WARNING nova.compute.manager [req-a7040766-e439-48a8-8a21-2005378e82f4 req-b081ff81-c4ec-44a6-aafe-616262df7e58 service nova] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Received unexpected event network-vif-plugged-0efc8452-2a89-4e9e-8ad3-c97c142fbbe2 for instance with vm_state building and task_state spawning.
Oct 16 19:15:22 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:15:22 user nova-compute[74247]: DEBUG nova.compute.manager [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Instance event wait completed in 0 seconds for  {{(pid=74247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 19:15:22 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Guest created on hypervisor {{(pid=74247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 19:15:22 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Instance spawned successfully.
Oct 16 19:15:22 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 19:15:22 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Found default for hw_cdrom_bus of ide {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 19:15:22 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Found default for hw_disk_bus of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 19:15:22 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Found default for hw_input_bus of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 19:15:22 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Found default for hw_pointer_model of None {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 19:15:22 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Found default for hw_video_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 19:15:22 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Found default for hw_vif_model of virtio {{(pid=74247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 19:15:23 user nova-compute[74247]: INFO nova.compute.manager [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Took 5.16 seconds to spawn the instance on the hypervisor.
Oct 16 19:15:23 user nova-compute[74247]: DEBUG nova.compute.manager [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Checking state {{(pid=74247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 19:15:23 user nova-compute[74247]: INFO nova.compute.manager [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Took 5.70 seconds to build instance.
Oct 16 19:15:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-86848d45-841e-4e4c-9c5e-0d449e8561c5 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lock "17ccd1c6-817a-4421-b043-a8229feb0a29" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.805s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:15:23 user nova-compute[74247]: DEBUG nova.compute.manager [req-16de4c69-41fc-48ca-9cd1-59b0fd7ebfb5 req-51c8b4c3-535d-43d0-a99b-e04f0d1b48cd service nova] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Received event network-vif-plugged-0efc8452-2a89-4e9e-8ad3-c97c142fbbe2 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:15:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-16de4c69-41fc-48ca-9cd1-59b0fd7ebfb5 req-51c8b4c3-535d-43d0-a99b-e04f0d1b48cd service nova] Acquiring lock "17ccd1c6-817a-4421-b043-a8229feb0a29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:15:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-16de4c69-41fc-48ca-9cd1-59b0fd7ebfb5 req-51c8b4c3-535d-43d0-a99b-e04f0d1b48cd service nova] Lock "17ccd1c6-817a-4421-b043-a8229feb0a29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:15:23 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-16de4c69-41fc-48ca-9cd1-59b0fd7ebfb5 req-51c8b4c3-535d-43d0-a99b-e04f0d1b48cd service nova] Lock "17ccd1c6-817a-4421-b043-a8229feb0a29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:15:23 user nova-compute[74247]: DEBUG nova.compute.manager [req-16de4c69-41fc-48ca-9cd1-59b0fd7ebfb5 req-51c8b4c3-535d-43d0-a99b-e04f0d1b48cd service nova] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] No waiting events found dispatching network-vif-plugged-0efc8452-2a89-4e9e-8ad3-c97c142fbbe2 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:15:23 user nova-compute[74247]: WARNING nova.compute.manager [req-16de4c69-41fc-48ca-9cd1-59b0fd7ebfb5 req-51c8b4c3-535d-43d0-a99b-e04f0d1b48cd service nova] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Received unexpected event network-vif-plugged-0efc8452-2a89-4e9e-8ad3-c97c142fbbe2 for instance with vm_state active and task_state None.
Oct 16 19:15:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:15:24 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:15:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:15:29 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:15:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:15:34 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:15:36 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:15:36 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 19:15:36 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Rebuilding the list of instances to heal {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 19:15:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "refresh_cache-17ccd1c6-817a-4421-b043-a8229feb0a29" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:15:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquired lock "refresh_cache-17ccd1c6-817a-4421-b043-a8229feb0a29" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:15:36 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Forcefully refreshing network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 19:15:36 user nova-compute[74247]: DEBUG nova.objects.instance [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lazy-loading 'info_cache' on Instance uuid 17ccd1c6-817a-4421-b043-a8229feb0a29 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:15:37 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Updating instance_info_cache with network_info: [{"id": "0efc8452-2a89-4e9e-8ad3-c97c142fbbe2", "address": "fa:16:3e:48:70:dd", "network": {"id": "605c88e1-153d-4d31-a57b-7e38962706e6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1265267696-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba84ebc7e30c480f9f10ed27ed51c51f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0efc8452-2a", "ovs_interfaceid": "0efc8452-2a89-4e9e-8ad3-c97c142fbbe2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:15:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Releasing lock "refresh_cache-17ccd1c6-817a-4421-b043-a8229feb0a29" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:15:37 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Updated the network info_cache for instance {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 19:15:37 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:15:37 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:15:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:15:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:15:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:15:37 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 19:15:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17ccd1c6-817a-4421-b043-a8229feb0a29/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:15:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17ccd1c6-817a-4421-b043-a8229feb0a29/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:15:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17ccd1c6-817a-4421-b043-a8229feb0a29/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:15:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17ccd1c6-817a-4421-b043-a8229feb0a29/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:15:38 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:15:38 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:15:38 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=8876MB free_disk=24.837772369384766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 19:15:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:15:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:15:38 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 17ccd1c6-817a-4421-b043-a8229feb0a29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 19:15:38 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 19:15:38 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 19:15:38 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 19:15:38 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 19:15:38 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 19:15:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.215s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:15:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:15:39 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:15:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:15:43 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:15:44 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:15:46 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:15:46 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Cleaning up deleted instances with incomplete migration  {{(pid=74247) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 16 19:15:47 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:15:47 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:15:47 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 19:15:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:15:50 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:15:52 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:15:54 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:15:58 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:15:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:16:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:16:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:16:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:16:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:16:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:16:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:16:04 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:16:04 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Cleaning up deleted instances {{(pid=74247) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 16 19:16:04 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] There are 0 instances to clean {{(pid=74247) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 16 19:16:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:16:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:16:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:16:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:16:25 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:16:29 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:16:29 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:16:29 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:16:29 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:16:29 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:16:29 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:16:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:16:36 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:16:36 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 19:16:36 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Rebuilding the list of instances to heal {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 19:16:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "refresh_cache-17ccd1c6-817a-4421-b043-a8229feb0a29" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:16:36 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquired lock "refresh_cache-17ccd1c6-817a-4421-b043-a8229feb0a29" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:16:36 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Forcefully refreshing network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 19:16:36 user nova-compute[74247]: DEBUG nova.objects.instance [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lazy-loading 'info_cache' on Instance uuid 17ccd1c6-817a-4421-b043-a8229feb0a29 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:16:37 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Updating instance_info_cache with network_info: [{"id": "0efc8452-2a89-4e9e-8ad3-c97c142fbbe2", "address": "fa:16:3e:48:70:dd", "network": {"id": "605c88e1-153d-4d31-a57b-7e38962706e6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1265267696-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba84ebc7e30c480f9f10ed27ed51c51f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0efc8452-2a", "ovs_interfaceid": "0efc8452-2a89-4e9e-8ad3-c97c142fbbe2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:16:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Releasing lock "refresh_cache-17ccd1c6-817a-4421-b043-a8229feb0a29" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:16:37 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Updated the network info_cache for instance {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 19:16:37 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:16:37 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:16:37 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:16:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:16:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:16:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:16:37 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 19:16:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17ccd1c6-817a-4421-b043-a8229feb0a29/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:16:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17ccd1c6-817a-4421-b043-a8229feb0a29/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:16:37 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17ccd1c6-817a-4421-b043-a8229feb0a29/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:16:38 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17ccd1c6-817a-4421-b043-a8229feb0a29/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:16:38 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:16:38 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:16:38 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=8976MB free_disk=24.83544921875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 19:16:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:16:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:16:38 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 17ccd1c6-817a-4421-b043-a8229feb0a29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 19:16:38 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 19:16:38 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 19:16:38 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Refreshing inventories for resource provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 16 19:16:38 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Updating ProviderTree inventory for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 16 19:16:38 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Updating inventory in ProviderTree for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 16 19:16:38 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Refreshing aggregate associations for resource provider 7b8a7b7b-c686-4162-903b-700fbc4d7273, aggregates: None {{(pid=74247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 16 19:16:38 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Refreshing trait associations for resource provider 7b8a7b7b-c686-4162-903b-700fbc4d7273, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=74247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 16 19:16:38 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 19:16:38 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 19:16:38 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 19:16:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.397s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:16:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:16:39 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:16:39 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:16:43 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:16:44 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:16:48 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:16:48 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 19:16:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:16:50 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:16:54 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:16:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:17:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:17:08 user nova-compute[74247]: DEBUG nova.compute.manager [req-9f9514e9-83f0-4583-ad24-f72fbd4a41a0 req-05ff6141-5119-491a-8644-6c2d8ca7286e service nova] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Received event network-changed-0efc8452-2a89-4e9e-8ad3-c97c142fbbe2 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:17:08 user nova-compute[74247]: DEBUG nova.compute.manager [req-9f9514e9-83f0-4583-ad24-f72fbd4a41a0 req-05ff6141-5119-491a-8644-6c2d8ca7286e service nova] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Refreshing instance network info cache due to event network-changed-0efc8452-2a89-4e9e-8ad3-c97c142fbbe2. {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 19:17:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9f9514e9-83f0-4583-ad24-f72fbd4a41a0 req-05ff6141-5119-491a-8644-6c2d8ca7286e service nova] Acquiring lock "refresh_cache-17ccd1c6-817a-4421-b043-a8229feb0a29" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:17:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9f9514e9-83f0-4583-ad24-f72fbd4a41a0 req-05ff6141-5119-491a-8644-6c2d8ca7286e service nova] Acquired lock "refresh_cache-17ccd1c6-817a-4421-b043-a8229feb0a29" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:17:08 user nova-compute[74247]: DEBUG nova.network.neutron [req-9f9514e9-83f0-4583-ad24-f72fbd4a41a0 req-05ff6141-5119-491a-8644-6c2d8ca7286e service nova] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Refreshing network info cache for port 0efc8452-2a89-4e9e-8ad3-c97c142fbbe2 {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 19:17:08 user nova-compute[74247]: DEBUG nova.network.neutron [req-9f9514e9-83f0-4583-ad24-f72fbd4a41a0 req-05ff6141-5119-491a-8644-6c2d8ca7286e service nova] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Updated VIF entry in instance network info cache for port 0efc8452-2a89-4e9e-8ad3-c97c142fbbe2. {{(pid=74247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 19:17:08 user nova-compute[74247]: DEBUG nova.network.neutron [req-9f9514e9-83f0-4583-ad24-f72fbd4a41a0 req-05ff6141-5119-491a-8644-6c2d8ca7286e service nova] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Updating instance_info_cache with network_info: [{"id": "0efc8452-2a89-4e9e-8ad3-c97c142fbbe2", "address": "fa:16:3e:48:70:dd", "network": {"id": "605c88e1-153d-4d31-a57b-7e38962706e6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1265267696-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba84ebc7e30c480f9f10ed27ed51c51f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0efc8452-2a", "ovs_interfaceid": "0efc8452-2a89-4e9e-8ad3-c97c142fbbe2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:17:08 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-9f9514e9-83f0-4583-ad24-f72fbd4a41a0 req-05ff6141-5119-491a-8644-6c2d8ca7286e service nova] Releasing lock "refresh_cache-17ccd1c6-817a-4421-b043-a8229feb0a29" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:17:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Acquiring lock "17ccd1c6-817a-4421-b043-a8229feb0a29" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:17:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lock "17ccd1c6-817a-4421-b043-a8229feb0a29" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:17:09 user nova-compute[74247]: DEBUG nova.objects.instance [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lazy-loading 'flavor' on Instance uuid 17ccd1c6-817a-4421-b043-a8229feb0a29 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:17:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lock "17ccd1c6-817a-4421-b043-a8229feb0a29" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:17:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Acquiring lock "17ccd1c6-817a-4421-b043-a8229feb0a29" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:17:09 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lock "17ccd1c6-817a-4421-b043-a8229feb0a29" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:17:09 user nova-compute[74247]: INFO nova.compute.manager [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Attaching volume 86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25 to /dev/vdb
Oct 16 19:17:09 user nova-compute[74247]: DEBUG os_brick.utils [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 19:17:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:17:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:17:09 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dadbb47-bfd4-45f9-85b2-1f2d2edddd27]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:17:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:17:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:17:09 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1fc4d4-fa4c-4398-a59d-0427e0775136]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:17:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:17:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:17:09 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[226e336c-4582-43e8-a631-82d03aee5feb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:17:09 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33eb722-5b05-4995-abd6-513df8515798]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:17:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:17:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 19:17:09 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 19:17:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:17:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 19:17:09 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 19:17:09 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[444843d0-8618-4630-8789-acce81596ac8]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:17:09 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 19:17:09 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 19:17:09 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 19:17:09 user nova-compute[74247]: DEBUG os_brick.utils [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 19:17:09 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Updating existing volume attachment record: 29b1da69-a8e9-4cdc-b399-595b650669dd {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 19:17:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:17:12 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:17:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:17:17 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:17:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:17:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:17:24 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 19:17:24 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CetfjVFx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 19:17:24 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 19:17:24 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 19:17:24 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 19:17:24 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 19:17:24 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 19:17:24 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 19:17:24 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 19:17:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25 -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:17:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:17:24 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0e0fcf-759a-48ef-91c4-17a439ff1a23]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:17:24 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 19:17:24 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:17:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25 -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:17:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:17:24 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0765af03-9888-4100-97a5-7fcb53ae6a5f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:17:24 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25] added
Oct 16 19:17:24 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:17:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:17:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:17:24 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5939288a-e4f9-4db8-af9b-2833aa46a84a]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:17:24 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:17:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:17:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:17:24 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc959dbe-bab7-4451-bb71-510b5b72c5af]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:17:24 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:17:24 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CetfjVFx {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:17:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CetfjVFx" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:17:25 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[19431616-f1be-41e0-9732-687eb1b60954]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:17:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CetfjVFx'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:17:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:17:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:17:25 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed1d5c9-0666-4467-ac5a-a3c52393ae21]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:17:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:17:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:17:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:17:25 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[135545fc-0491-41b5-816b-42b815518791]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:17:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 16 19:17:25 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 19:17:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 16 19:17:25 user nova-compute[74247]:  {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 19:17:25 user nova-compute[74247]: WARNING os_brick.initiator.connectors.iscsi [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 16 19:17:25 user nova-compute[74247]: 
Oct 16 19:17:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25 -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:17:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:17:25 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f8723f-b13d-4e3d-b09d-759c4f1d8fb5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:17:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25, portal: 172.16.0.220,3260]
Oct 16 19:17:25 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25, portal: 172.16.0.220,3260] successful.
Oct 16 19:17:25 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:17:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:17:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:17:25 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc28788d-c564-4e4b-8f62-6833c6fa67e6]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:17:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:17:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:17:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:17:25 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[34625e75-6d40-4eb4-8729-e90ba22047c5]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:17:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25 (non-flash)
Oct 16 19:17:25 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 19:17:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25 (non-flash)
Oct 16 19:17:25 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 19:17:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 19:17:25 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 19:17:25 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 19:17:25 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 19:17:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:17:25 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:17:25 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fce9ac-2ed6-4af4-a1f2-cf906586afeb]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:17:25 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: None {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 19:17:26 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 19:17:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CetfjVFx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 19:17:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 19:17:26 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '23138383362396361', 'path': '/dev/sdb'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 19:17:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138383362396361', 'path': '/dev/sdb'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 19:17:26 user nova-compute[74247]: DEBUG nova.objects.instance [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lazy-loading 'flavor' on Instance uuid 17ccd1c6-817a-4421-b043-a8229feb0a29 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:17:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 19:17:26 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 19:17:26 user nova-compute[74247]:   <source dev="/dev/sdb"/>
Oct 16 19:17:26 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 19:17:26 user nova-compute[74247]:   <serial>86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25</serial>
Oct 16 19:17:26 user nova-compute[74247]: </disk>
Oct 16 19:17:26 user nova-compute[74247]:  {{(pid=74247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 19:17:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 19:17:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 19:17:26 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] No VIF found with MAC fa:16:3e:48:70:dd, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 19:17:26 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:17:26 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c60efc9c-280f-4bce-bfe9-12cb2d3421b1 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lock "17ccd1c6-817a-4421-b043-a8229feb0a29" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.317s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:17:27 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:17:29 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:17:30 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Acquiring lock "17ccd1c6-817a-4421-b043-a8229feb0a29" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:17:30 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lock "17ccd1c6-817a-4421-b043-a8229feb0a29" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:17:30 user nova-compute[74247]: DEBUG nova.objects.instance [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lazy-loading 'flavor' on Instance uuid 17ccd1c6-817a-4421-b043-a8229feb0a29 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:17:30 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lock "17ccd1c6-817a-4421-b043-a8229feb0a29" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:17:30 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Acquiring lock "17ccd1c6-817a-4421-b043-a8229feb0a29" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:17:30 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lock "17ccd1c6-817a-4421-b043-a8229feb0a29" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:17:30 user nova-compute[74247]: INFO nova.compute.manager [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Attaching volume 45f159d6-4bde-433f-9080-8156fee885c7 to /dev/vdc
Oct 16 19:17:30 user nova-compute[74247]: DEBUG os_brick.utils [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 19:17:30 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:17:30 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:17:30 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d319d4a-e157-4733-8f1f-3cb6cb3ac4c3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a35bb29239a6\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:17:30 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:17:30 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:17:30 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4777a302-d855-4425-bcf3-6bb92bc021d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:17:30 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:17:30 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:17:30 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e315399-b947-4224-9829-cd576b6df267]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:17:30 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[99644176-94de-4460-b4df-cf670d00b0f7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:17:30 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Running cmd (subprocess): nvme version {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:17:30 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] 'nvme version' failed. Not Retrying. {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 19:17:30 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] nvme not present on system {{(pid=74247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 19:17:30 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:17:30 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 19:17:30 user nova-compute[74247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 19:17:30 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c93c1e-5027-4bb1-89d9-054dbdb1ab37]: (4, '') {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:17:30 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 19:17:30 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 19:17:30 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.lightos [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] LIGHTOS: no hostnqn found. {{(pid=74247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 19:17:30 user nova-compute[74247]: DEBUG os_brick.utils [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a35bb29239a6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 19:17:30 user nova-compute[74247]: DEBUG nova.virt.block_device [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Updating existing volume attachment record: 8b9d9bb1-f92f-4d43-8b17-7bc6c9a1aa39 {{(pid=74247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 19:17:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:17:37 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:17:37 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 19:17:37 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Rebuilding the list of instances to heal {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 19:17:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "refresh_cache-17ccd1c6-817a-4421-b043-a8229feb0a29" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:17:37 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquired lock "refresh_cache-17ccd1c6-817a-4421-b043-a8229feb0a29" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:17:37 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Forcefully refreshing network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 19:17:37 user nova-compute[74247]: DEBUG nova.objects.instance [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lazy-loading 'info_cache' on Instance uuid 17ccd1c6-817a-4421-b043-a8229feb0a29 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:17:38 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Updating instance_info_cache with network_info: [{"id": "0efc8452-2a89-4e9e-8ad3-c97c142fbbe2", "address": "fa:16:3e:48:70:dd", "network": {"id": "605c88e1-153d-4d31-a57b-7e38962706e6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1265267696-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba84ebc7e30c480f9f10ed27ed51c51f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0efc8452-2a", "ovs_interfaceid": "0efc8452-2a89-4e9e-8ad3-c97c142fbbe2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:17:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Releasing lock "refresh_cache-17ccd1c6-817a-4421-b043-a8229feb0a29" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:17:38 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Updated the network info_cache for instance {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 19:17:38 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:17:38 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:17:39 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:17:39 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:17:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:17:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:17:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:17:39 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 19:17:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:17:39 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17ccd1c6-817a-4421-b043-a8229feb0a29/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:17:39 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17ccd1c6-817a-4421-b043-a8229feb0a29/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:17:39 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17ccd1c6-817a-4421-b043-a8229feb0a29/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:17:40 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17ccd1c6-817a-4421-b043-a8229feb0a29/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:17:40 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 19:17:40 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:17:40 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:17:40 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=8966MB free_disk=24.83415985107422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 19:17:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:17:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:17:40 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 17ccd1c6-817a-4421-b043-a8229feb0a29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 19:17:40 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 19:17:40 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 19:17:40 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 19:17:40 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 19:17:40 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 19:17:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:17:42 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:17:44 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:17:44 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Calling os-brick to attach iSCSI Volume {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vFdyRrmc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 19:17:46 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 19:17:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 19:17:46 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 19:17:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 19:17:46 user nova-compute[74247]: INFO os_brick.initiator.connectors.iscsi [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 19:17:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7 -p 172.16.0.220:3260 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[590604ee-38c9-412a-94f1-c3b6ffc749a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 19:17:46 user nova-compute[74247]:  {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d95f03-4a29-4004-9ad7-2b26f2226a18]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7] added\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7] added
Oct 16 19:17:46 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d694c651-4e90-4ade-8db4-ed712e5d2bd9]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[542ed328-088f-4d31-8650-8f28e965dda4]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vFdyRrmc {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vFdyRrmc" returned: 0 in 0.023s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22b5c02-b6e0-4582-a6bf-ff7271db4e13]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vFdyRrmc'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[64aaf7e2-99c3-403f-bb3b-4be069b37377]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52f4866-cbe7-412f-a89d-d54ef2c2951f]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25 (non-flash)
Oct 16 19:17:46 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25 (non-flash)
Oct 16 19:17:46 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7 -p 172.16.0.220:3260 --login {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[46aa0e50-c298-4a0c-9077-ed4cedd78c2d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7, portal: 172.16.0.220,3260]
Oct 16 19:17:46 user nova-compute[74247]: Login to [iface: default, target: iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7, portal: 172.16.0.220,3260] successful.
Oct 16 19:17:46 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa9c08f-9a5b-4740-9dae-3e074b81a705]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd11ea24-0206-4f9d-b2d2-d32ca408f386]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25 (non-flash)
Oct 16 19:17:46 user nova-compute[74247]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7 (non-flash)
Oct 16 19:17:46 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25 (non-flash)
Oct 16 19:17:46 user nova-compute[74247]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7 (non-flash)
Oct 16 19:17:46 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Connected to 172.16.0.220:3260 {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=74247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8b3d50-b996-4c0f-9bdc-a8fa96995c3e]: (4, ('- - 0', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 19:17:46 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vFdyRrmc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 19:17:47 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 19:17:47 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23739653339653730', 'path': '/dev/sdc'} {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 19:17:47 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739653339653730', 'path': '/dev/sdc'} {{(pid=74247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 19:17:47 user nova-compute[74247]: DEBUG nova.objects.instance [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lazy-loading 'flavor' on Instance uuid 17ccd1c6-817a-4421-b043-a8229feb0a29 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:17:47 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 19:17:47 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 19:17:47 user nova-compute[74247]:   <source dev="/dev/sdc"/>
Oct 16 19:17:47 user nova-compute[74247]:   <target dev="vdc" bus="virtio"/>
Oct 16 19:17:47 user nova-compute[74247]:   <serial>45f159d6-4bde-433f-9080-8156fee885c7</serial>
Oct 16 19:17:47 user nova-compute[74247]: </disk>
Oct 16 19:17:47 user nova-compute[74247]:  {{(pid=74247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 19:17:48 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] No BDM found with device name vda, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 19:17:48 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 19:17:48 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 19:17:48 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] No VIF found with MAC fa:16:3e:48:70:dd, not building metadata {{(pid=74247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 19:17:48 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-27dc10e8-af4d-453d-a2e5-f51f4c9efd6f tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lock "17ccd1c6-817a-4421-b043-a8229feb0a29" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.712s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:17:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c340d743-86cd-4ae2-bed8-543d32884fe4 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Acquiring lock "17ccd1c6-817a-4421-b043-a8229feb0a29" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:17:49 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c340d743-86cd-4ae2-bed8-543d32884fe4 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lock "17ccd1c6-817a-4421-b043-a8229feb0a29" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:17:49 user nova-compute[74247]: INFO nova.compute.manager [None req-c340d743-86cd-4ae2-bed8-543d32884fe4 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Detaching volume 45f159d6-4bde-433f-9080-8156fee885c7
Oct 16 19:17:49 user nova-compute[74247]: INFO nova.virt.block_device [None req-c340d743-86cd-4ae2-bed8-543d32884fe4 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Attempting to driver detach volume 45f159d6-4bde-433f-9080-8156fee885c7 from mountpoint /dev/vdc
Oct 16 19:17:49 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c340d743-86cd-4ae2-bed8-543d32884fe4 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Attempting to detach device vdc from instance 17ccd1c6-817a-4421-b043-a8229feb0a29 from the persistent domain config. {{(pid=74247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 19:17:49 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-c340d743-86cd-4ae2-bed8-543d32884fe4 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 19:17:49 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 19:17:49 user nova-compute[74247]:   <source dev="/dev/sdc"/>
Oct 16 19:17:49 user nova-compute[74247]:   <target dev="vdc" bus="virtio"/>
Oct 16 19:17:49 user nova-compute[74247]:   <serial>45f159d6-4bde-433f-9080-8156fee885c7</serial>
Oct 16 19:17:49 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 16 19:17:49 user nova-compute[74247]: </disk>
Oct 16 19:17:49 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 19:17:49 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-c340d743-86cd-4ae2-bed8-543d32884fe4 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Successfully detached device vdc from instance 17ccd1c6-817a-4421-b043-a8229feb0a29 from the persistent domain config.
Oct 16 19:17:49 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c340d743-86cd-4ae2-bed8-543d32884fe4 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 17ccd1c6-817a-4421-b043-a8229feb0a29 from the live domain config. {{(pid=74247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 19:17:49 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-c340d743-86cd-4ae2-bed8-543d32884fe4 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 19:17:49 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 19:17:49 user nova-compute[74247]:   <source dev="/dev/sdc"/>
Oct 16 19:17:49 user nova-compute[74247]:   <target dev="vdc" bus="virtio"/>
Oct 16 19:17:49 user nova-compute[74247]:   <serial>45f159d6-4bde-433f-9080-8156fee885c7</serial>
Oct 16 19:17:49 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 16 19:17:49 user nova-compute[74247]: </disk>
Oct 16 19:17:49 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 19:17:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:17:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:17:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:17:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:17:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:17:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:17:49 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-c340d743-86cd-4ae2-bed8-543d32884fe4 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 17ccd1c6-817a-4421-b043-a8229feb0a29 {{(pid=74247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 19:17:50 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:17:50 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 19:17:52 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:17:54 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:17:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:18:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:18:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:18:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:18:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:18:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:18:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:18:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:18:09 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-c340d743-86cd-4ae2-bed8-543d32884fe4 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 17ccd1c6-817a-4421-b043-a8229feb0a29 is timed out.
Oct 16 19:18:09 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-c340d743-86cd-4ae2-bed8-543d32884fe4 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Successfully detached device vdc from instance 17ccd1c6-817a-4421-b043-a8229feb0a29 from the live domain config.
Oct 16 19:18:09 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c340d743-86cd-4ae2-bed8-543d32884fe4 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 19:18:09 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c340d743-86cd-4ae2-bed8-543d32884fe4 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vFdyRrmc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 19:18:09 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-c340d743-86cd-4ae2-bed8-543d32884fe4 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 19:18:09 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-c340d743-86cd-4ae2-bed8-543d32884fe4 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 19:18:09 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-c340d743-86cd-4ae2-bed8-543d32884fe4 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 19:18:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:18:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:18:09 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c02e9a-94c8-47b7-9d38-10564067e313]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:18:09 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c340d743-86cd-4ae2-bed8-543d32884fe4 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 19:18:09 user nova-compute[74247]: No targets found.
Oct 16 19:18:09 user nova-compute[74247]: iSNS:
Oct 16 19:18:09 user nova-compute[74247]: No targets found.
Oct 16 19:18:09 user nova-compute[74247]: STATIC:
Oct 16 19:18:09 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25
Oct 16 19:18:09 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 19:18:09 user nova-compute[74247]:                 Iface Name: default
Oct 16 19:18:09 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7
Oct 16 19:18:09 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 19:18:09 user nova-compute[74247]:                 Iface Name: default
Oct 16 19:18:09 user nova-compute[74247]: FIRMWARE:
Oct 16 19:18:09 user nova-compute[74247]: No targets found.
Oct 16 19:18:09 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 19:18:09 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c340d743-86cd-4ae2-bed8-543d32884fe4 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 19:18:09 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 19:18:09 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 19:18:09 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c340d743-86cd-4ae2-bed8-543d32884fe4 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 19:18:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:18:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:18:09 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bda3a2d-ec68-431f-8cd6-5f7d1a6512a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:18:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:18:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:18:09 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b22794f-54f9-457a-9dd0-7438d722f6e1]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:18:09 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c340d743-86cd-4ae2-bed8-543d32884fe4 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25 (non-flash)
Oct 16 19:18:09 user nova-compute[74247]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7 (non-flash)
Oct 16 19:18:09 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 19:18:09 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c340d743-86cd-4ae2-bed8-543d32884fe4 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25 (non-flash)
Oct 16 19:18:09 user nova-compute[74247]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7 (non-flash)
Oct 16 19:18:09 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 19:18:09 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c340d743-86cd-4ae2-bed8-543d32884fe4 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe0484520e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7'): ({'sdc'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 19:18:09 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-c340d743-86cd-4ae2-bed8-543d32884fe4 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Removing single pathed devices sdc {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 19:18:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:18:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:18:09 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c6c39a-06d6-456a-9131-6dc83f63f06b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:18:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:18:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:18:09 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37546c0-30f2-4a0d-8720-ae2ccd670092]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:18:09 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-c340d743-86cd-4ae2-bed8-543d32884fe4 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Flushing IO for device /dev/sdc {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 19:18:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:18:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:18:09 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc39e60a-66e5-4075-a011-61de04624204]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:18:09 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-c340d743-86cd-4ae2-bed8-543d32884fe4 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 19:18:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:18:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:18:09 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffedee18-63ff-4f74-9019-5c7a98947580]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:18:09 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-c340d743-86cd-4ae2-bed8-543d32884fe4 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 19:18:09 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-c340d743-86cd-4ae2-bed8-543d32884fe4 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] SCSI volumes sdc have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 19:18:09 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c340d743-86cd-4ae2-bed8-543d32884fe4 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 19:18:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:18:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:18:09 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8bca69-0842-4f4a-b558-b05770f0e43f]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:18:09 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c340d743-86cd-4ae2-bed8-543d32884fe4 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:18:09 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7 -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:18:10 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:18:10 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8819e27-2c6a-4ae1-b3aa-b667ac1ce1dd]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:18:10 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c340d743-86cd-4ae2-bed8-543d32884fe4 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7, portal: 172.16.0.220,3260]
Oct 16 19:18:10 user nova-compute[74247]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7, portal: 172.16.0.220,3260] successful.
Oct 16 19:18:10 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:18:10 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7 -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:18:10 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f159d6-4bde-433f-9080-8156fee885c7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:18:10 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d007ce-c2b6-43b9-b312-ab90c525c97a]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:18:10 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c340d743-86cd-4ae2-bed8-543d32884fe4 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:18:10 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-c340d743-86cd-4ae2-bed8-543d32884fe4 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 19:18:10 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c340d743-86cd-4ae2-bed8-543d32884fe4 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] <== disconnect_volume: return (326ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 19:18:10 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c340d743-86cd-4ae2-bed8-543d32884fe4 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 19:18:10 user nova-compute[74247]: DEBUG nova.objects.instance [None req-c340d743-86cd-4ae2-bed8-543d32884fe4 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lazy-loading 'flavor' on Instance uuid 17ccd1c6-817a-4421-b043-a8229feb0a29 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:18:11 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-c340d743-86cd-4ae2-bed8-543d32884fe4 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lock "17ccd1c6-817a-4421-b043-a8229feb0a29" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.851s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:18:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:18:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:18:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:18:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:18:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:18:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:18:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:18:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:18:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:18:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:18:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:18:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:18:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:18:26 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:18:29 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:18:34 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:18:38 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:18:38 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 19:18:38 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Rebuilding the list of instances to heal {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 19:18:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "refresh_cache-17ccd1c6-817a-4421-b043-a8229feb0a29" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 19:18:38 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquired lock "refresh_cache-17ccd1c6-817a-4421-b043-a8229feb0a29" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 19:18:38 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Forcefully refreshing network info cache for instance {{(pid=74247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 19:18:38 user nova-compute[74247]: DEBUG nova.objects.instance [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lazy-loading 'info_cache' on Instance uuid 17ccd1c6-817a-4421-b043-a8229feb0a29 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:18:39 user nova-compute[74247]: DEBUG nova.network.neutron [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Updating instance_info_cache with network_info: [{"id": "0efc8452-2a89-4e9e-8ad3-c97c142fbbe2", "address": "fa:16:3e:48:70:dd", "network": {"id": "605c88e1-153d-4d31-a57b-7e38962706e6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1265267696-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba84ebc7e30c480f9f10ed27ed51c51f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0efc8452-2a", "ovs_interfaceid": "0efc8452-2a89-4e9e-8ad3-c97c142fbbe2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:18:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Releasing lock "refresh_cache-17ccd1c6-817a-4421-b043-a8229feb0a29" {{(pid=74247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 19:18:39 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Updated the network info_cache for instance {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 19:18:39 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:18:39 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:18:39 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:18:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:18:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:18:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:18:39 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 19:18:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:18:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:18:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:18:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:18:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:18:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:18:39 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17ccd1c6-817a-4421-b043-a8229feb0a29/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:18:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3078ac2e-78fd-4ea9-9524-10c2f76e27d7 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Acquiring lock "17ccd1c6-817a-4421-b043-a8229feb0a29" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:18:39 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3078ac2e-78fd-4ea9-9524-10c2f76e27d7 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lock "17ccd1c6-817a-4421-b043-a8229feb0a29" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:18:39 user nova-compute[74247]: INFO nova.compute.manager [None req-3078ac2e-78fd-4ea9-9524-10c2f76e27d7 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Detaching volume 86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25
Oct 16 19:18:39 user nova-compute[74247]: INFO nova.virt.block_device [None req-3078ac2e-78fd-4ea9-9524-10c2f76e27d7 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Attempting to driver detach volume 86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25 from mountpoint /dev/vdb
Oct 16 19:18:39 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3078ac2e-78fd-4ea9-9524-10c2f76e27d7 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Attempting to detach device vdb from instance 17ccd1c6-817a-4421-b043-a8229feb0a29 from the persistent domain config. {{(pid=74247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 19:18:39 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-3078ac2e-78fd-4ea9-9524-10c2f76e27d7 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 19:18:39 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 19:18:39 user nova-compute[74247]:   <source dev="/dev/sdb"/>
Oct 16 19:18:39 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 19:18:39 user nova-compute[74247]:   <serial>86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25</serial>
Oct 16 19:18:39 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 19:18:39 user nova-compute[74247]: </disk>
Oct 16 19:18:39 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 19:18:39 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-3078ac2e-78fd-4ea9-9524-10c2f76e27d7 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Successfully detached device vdb from instance 17ccd1c6-817a-4421-b043-a8229feb0a29 from the persistent domain config.
Oct 16 19:18:39 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3078ac2e-78fd-4ea9-9524-10c2f76e27d7 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 17ccd1c6-817a-4421-b043-a8229feb0a29 from the live domain config. {{(pid=74247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 19:18:39 user nova-compute[74247]: DEBUG nova.virt.libvirt.guest [None req-3078ac2e-78fd-4ea9-9524-10c2f76e27d7 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 19:18:39 user nova-compute[74247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 19:18:39 user nova-compute[74247]:   <source dev="/dev/sdb"/>
Oct 16 19:18:39 user nova-compute[74247]:   <target dev="vdb" bus="virtio"/>
Oct 16 19:18:39 user nova-compute[74247]:   <serial>86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25</serial>
Oct 16 19:18:39 user nova-compute[74247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 19:18:39 user nova-compute[74247]: </disk>
Oct 16 19:18:39 user nova-compute[74247]:  {{(pid=74247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 19:18:39 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17ccd1c6-817a-4421-b043-a8229feb0a29/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:18:39 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17ccd1c6-817a-4421-b043-a8229feb0a29/disk --force-share --output=json {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:18:40 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17ccd1c6-817a-4421-b043-a8229feb0a29/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:18:40 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 19:18:40 user nova-compute[74247]: DEBUG nova.virt.libvirt.driver [None req-3078ac2e-78fd-4ea9-9524-10c2f76e27d7 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 17ccd1c6-817a-4421-b043-a8229feb0a29 {{(pid=74247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 19:18:40 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:18:40 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:18:40 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=8981MB free_disk=24.833274841308594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 19:18:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:18:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:18:40 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Instance 17ccd1c6-817a-4421-b043-a8229feb0a29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 19:18:40 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 19:18:40 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 19:18:40 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 19:18:40 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 19:18:40 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 19:18:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.321s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:18:41 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:18:42 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:18:43 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:18:44 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:18:49 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:18:52 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:18:52 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 19:18:54 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:18:54 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:18:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:18:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:18:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:18:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:18:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:18:59 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:19:00 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-3078ac2e-78fd-4ea9-9524-10c2f76e27d7 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 17ccd1c6-817a-4421-b043-a8229feb0a29 is timed out.
Oct 16 19:19:00 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-3078ac2e-78fd-4ea9-9524-10c2f76e27d7 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Successfully detached device vdb from instance 17ccd1c6-817a-4421-b043-a8229feb0a29 from the live domain config.
Oct 16 19:19:00 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3078ac2e-78fd-4ea9-9524-10c2f76e27d7 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] calling os-brick to detach iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3078ac2e-78fd-4ea9-9524-10c2f76e27d7 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe0683a0d90>, {'target_iqn': 'iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CetfjVFx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 19:19:00 user nova-compute[74247]: WARNING os_brick.initiator.connectors.base [None req-3078ac2e-78fd-4ea9-9524-10c2f76e27d7 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 19:19:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-3078ac2e-78fd-4ea9-9524-10c2f76e27d7 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-3078ac2e-78fd-4ea9-9524-10c2f76e27d7 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5d240b-14ac-47f4-a669-84914dcaf3fc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3078ac2e-78fd-4ea9-9524-10c2f76e27d7 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 19:19:00 user nova-compute[74247]: No targets found.
Oct 16 19:19:00 user nova-compute[74247]: iSNS:
Oct 16 19:19:00 user nova-compute[74247]: No targets found.
Oct 16 19:19:00 user nova-compute[74247]: STATIC:
Oct 16 19:19:00 user nova-compute[74247]: Target: iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25
Oct 16 19:19:00 user nova-compute[74247]:         Portal: 172.16.0.220:3260,-1
Oct 16 19:19:00 user nova-compute[74247]:                 Iface Name: default
Oct 16 19:19:00 user nova-compute[74247]: FIRMWARE:
Oct 16 19:19:00 user nova-compute[74247]: No targets found.
Oct 16 19:19:00 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3078ac2e-78fd-4ea9-9524-10c2f76e27d7 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 19:19:00 user nova-compute[74247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 19:19:00 user nova-compute[74247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3078ac2e-78fd-4ea9-9524-10c2f76e27d7 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25', 0)] {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42bc2ab-61b3-404c-bc0d-71705821a98d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8296e2-03db-4605-a92c-30ae7e8b8550]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25 (non-flash)\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3078ac2e-78fd-4ea9-9524-10c2f76e27d7 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25 (non-flash)
Oct 16 19:19:00 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3078ac2e-78fd-4ea9-9524-10c2f76e27d7 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25 (non-flash)
Oct 16 19:19:00 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3078ac2e-78fd-4ea9-9524-10c2f76e27d7 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe0484504c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25'): ({'sdb'}, set())}) {{(pid=74247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-3078ac2e-78fd-4ea9-9524-10c2f76e27d7 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Removing single pathed devices sdb {{(pid=74247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[96dee262-65f9-4e71-9030-8ac28efcd354]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81337de-2f49-4d7d-bfd9-548e3a633026]: (4, ('ok\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-3078ac2e-78fd-4ea9-9524-10c2f76e27d7 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Flushing IO for device /dev/sdb {{(pid=74247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[570b7e5e-44ae-4c27-94b8-cf82e166fc6c]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-3078ac2e-78fd-4ea9-9524-10c2f76e27d7 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[590322db-d876-4036-a720-929e473faec5]: (4, ('1', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-3078ac2e-78fd-4ea9-9524-10c2f76e27d7 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG os_brick.initiator.linuxscsi [None req-3078ac2e-78fd-4ea9-9524-10c2f76e27d7 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] SCSI volumes sdb have been removed. {{(pid=74247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3078ac2e-78fd-4ea9-9524-10c2f76e27d7 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25')] {{(pid=74247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22b16a6-fc25-41f3-b228-d27116ccdd5d]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3078ac2e-78fd-4ea9-9524-10c2f76e27d7 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25 -p 172.16.0.220:3260 --logout {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96dc072-d881-4cd4-9ee6-39234617fa5c]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3078ac2e-78fd-4ea9-9524-10c2f76e27d7 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25, portal: 172.16.0.220,3260]
Oct 16 19:19:00 user nova-compute[74247]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25, portal: 172.16.0.220,3260] successful.
Oct 16 19:19:00 user nova-compute[74247]:  stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25 -p 172.16.0.220:3260 --op delete {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86fc1a48-c9d2-4f3e-9d9d-9ee94a25ae25 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85128) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe59aae-5b14-4e2d-9e69-814894a48c8c]: (4, ('', '')) {{(pid=85128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3078ac2e-78fd-4ea9-9524-10c2f76e27d7 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.base [None req-3078ac2e-78fd-4ea9-9524-10c2f76e27d7 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3078ac2e-78fd-4ea9-9524-10c2f76e27d7 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] <== disconnect_volume: return (319ms) None {{(pid=74247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 19:19:00 user nova-compute[74247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3078ac2e-78fd-4ea9-9524-10c2f76e27d7 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Disconnected iSCSI Volume {{(pid=74247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 19:19:01 user nova-compute[74247]: DEBUG nova.objects.instance [None req-3078ac2e-78fd-4ea9-9524-10c2f76e27d7 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lazy-loading 'flavor' on Instance uuid 17ccd1c6-817a-4421-b043-a8229feb0a29 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:19:01 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-3078ac2e-78fd-4ea9-9524-10c2f76e27d7 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lock "17ccd1c6-817a-4421-b043-a8229feb0a29" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.878s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:19:04 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:19:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:19:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:19:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:19:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:19:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:19:09 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:19:14 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:19:19 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:19:24 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:19:27 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:19:29 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:19:30 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-234800ee-45d8-488f-9611-968e1abdff91 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Acquiring lock "17ccd1c6-817a-4421-b043-a8229feb0a29" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:19:30 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-234800ee-45d8-488f-9611-968e1abdff91 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lock "17ccd1c6-817a-4421-b043-a8229feb0a29" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:19:30 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-234800ee-45d8-488f-9611-968e1abdff91 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Acquiring lock "17ccd1c6-817a-4421-b043-a8229feb0a29-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:19:30 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-234800ee-45d8-488f-9611-968e1abdff91 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lock "17ccd1c6-817a-4421-b043-a8229feb0a29-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:19:30 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-234800ee-45d8-488f-9611-968e1abdff91 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lock "17ccd1c6-817a-4421-b043-a8229feb0a29-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:19:30 user nova-compute[74247]: INFO nova.compute.manager [None req-234800ee-45d8-488f-9611-968e1abdff91 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Terminating instance
Oct 16 19:19:30 user nova-compute[74247]: DEBUG nova.compute.manager [None req-234800ee-45d8-488f-9611-968e1abdff91 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Start destroying the instance on the hypervisor. {{(pid=74247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 19:19:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:19:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:19:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:19:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:19:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:19:30 user nova-compute[74247]: DEBUG nova.compute.manager [req-f6d910ac-d625-43e1-8dbc-ab27809bae78 req-c4184e90-ffe9-4b63-a8ed-8b79558f8966 service nova] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Received event network-vif-unplugged-0efc8452-2a89-4e9e-8ad3-c97c142fbbe2 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:19:30 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f6d910ac-d625-43e1-8dbc-ab27809bae78 req-c4184e90-ffe9-4b63-a8ed-8b79558f8966 service nova] Acquiring lock "17ccd1c6-817a-4421-b043-a8229feb0a29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:19:30 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f6d910ac-d625-43e1-8dbc-ab27809bae78 req-c4184e90-ffe9-4b63-a8ed-8b79558f8966 service nova] Lock "17ccd1c6-817a-4421-b043-a8229feb0a29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:19:30 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-f6d910ac-d625-43e1-8dbc-ab27809bae78 req-c4184e90-ffe9-4b63-a8ed-8b79558f8966 service nova] Lock "17ccd1c6-817a-4421-b043-a8229feb0a29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:19:30 user nova-compute[74247]: DEBUG nova.compute.manager [req-f6d910ac-d625-43e1-8dbc-ab27809bae78 req-c4184e90-ffe9-4b63-a8ed-8b79558f8966 service nova] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] No waiting events found dispatching network-vif-unplugged-0efc8452-2a89-4e9e-8ad3-c97c142fbbe2 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:19:30 user nova-compute[74247]: DEBUG nova.compute.manager [req-f6d910ac-d625-43e1-8dbc-ab27809bae78 req-c4184e90-ffe9-4b63-a8ed-8b79558f8966 service nova] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Received event network-vif-unplugged-0efc8452-2a89-4e9e-8ad3-c97c142fbbe2 for instance with task_state deleting. {{(pid=74247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 19:19:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:19:30 user nova-compute[74247]: INFO nova.virt.libvirt.driver [-] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Instance destroyed successfully.
Oct 16 19:19:30 user nova-compute[74247]: DEBUG nova.objects.instance [None req-234800ee-45d8-488f-9611-968e1abdff91 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lazy-loading 'resources' on Instance uuid 17ccd1c6-817a-4421-b043-a8229feb0a29 {{(pid=74247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 19:19:30 user nova-compute[74247]: DEBUG nova.virt.libvirt.vif [None req-234800ee-45d8-488f-9611-968e1abdff91 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T19:15:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1683795670',display_name='tempest-TestServerVolumeAttachmentScenario-server-1683795670',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1683795670',id=52,image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhIwpYRDMEswwPRbVH6NxzSbdlqjHg67FPdmeWPvpuSA8R0pT/B1xkig2qdHF//9OAh1vAxrsiCNsqq+UbVYZd/D0RsGnVl+BxCYB7NeB80LfeOd1To4AKSehqc/nwVWA==',key_name='tempest-keypair-511833156',keypairs=<?>,launch_index=0,launched_at=2023-10-16T19:15:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba84ebc7e30c480f9f10ed27ed51c51f',ramdisk_id='',reservation_id='r-pp4okpvj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83126bb1-29f5-42fe-8620-72ab0797f776',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-257558189',owner_user_name='tempest-TestServerVolumeAttachmentScenario-257558189-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T19:15:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7628a82438654c36b20aaa5f2d0c6db0',uuid=17ccd1c6-817a-4421-b043-a8229feb0a29,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0efc8452-2a89-4e9e-8ad3-c97c142fbbe2", "address": "fa:16:3e:48:70:dd", "network": {"id": "605c88e1-153d-4d31-a57b-7e38962706e6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1265267696-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba84ebc7e30c480f9f10ed27ed51c51f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0efc8452-2a", "ovs_interfaceid": "0efc8452-2a89-4e9e-8ad3-c97c142fbbe2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 19:19:30 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-234800ee-45d8-488f-9611-968e1abdff91 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Converting VIF {"id": "0efc8452-2a89-4e9e-8ad3-c97c142fbbe2", "address": "fa:16:3e:48:70:dd", "network": {"id": "605c88e1-153d-4d31-a57b-7e38962706e6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1265267696-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba84ebc7e30c480f9f10ed27ed51c51f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0efc8452-2a", "ovs_interfaceid": "0efc8452-2a89-4e9e-8ad3-c97c142fbbe2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 19:19:30 user nova-compute[74247]: DEBUG nova.network.os_vif_util [None req-234800ee-45d8-488f-9611-968e1abdff91 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:70:dd,bridge_name='br-int',has_traffic_filtering=True,id=0efc8452-2a89-4e9e-8ad3-c97c142fbbe2,network=Network(605c88e1-153d-4d31-a57b-7e38962706e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0efc8452-2a') {{(pid=74247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 19:19:30 user nova-compute[74247]: DEBUG os_vif [None req-234800ee-45d8-488f-9611-968e1abdff91 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:70:dd,bridge_name='br-int',has_traffic_filtering=True,id=0efc8452-2a89-4e9e-8ad3-c97c142fbbe2,network=Network(605c88e1-153d-4d31-a57b-7e38962706e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0efc8452-2a') {{(pid=74247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 19:19:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:19:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0efc8452-2a, bridge=br-int, if_exists=True) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:19:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:19:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:19:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:19:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=17cc63f7-ce95-41ce-a7b5-e478283a9aa9) {{(pid=74247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 19:19:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:19:30 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:19:30 user nova-compute[74247]: INFO os_vif [None req-234800ee-45d8-488f-9611-968e1abdff91 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:70:dd,bridge_name='br-int',has_traffic_filtering=True,id=0efc8452-2a89-4e9e-8ad3-c97c142fbbe2,network=Network(605c88e1-153d-4d31-a57b-7e38962706e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0efc8452-2a')
Oct 16 19:19:30 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-234800ee-45d8-488f-9611-968e1abdff91 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Deleting instance files /opt/stack/data/nova/instances/17ccd1c6-817a-4421-b043-a8229feb0a29_del
Oct 16 19:19:30 user nova-compute[74247]: INFO nova.virt.libvirt.driver [None req-234800ee-45d8-488f-9611-968e1abdff91 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Deletion of /opt/stack/data/nova/instances/17ccd1c6-817a-4421-b043-a8229feb0a29_del complete
Oct 16 19:19:31 user nova-compute[74247]: INFO nova.compute.manager [None req-234800ee-45d8-488f-9611-968e1abdff91 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 16 19:19:31 user nova-compute[74247]: DEBUG oslo.service.loopingcall [None req-234800ee-45d8-488f-9611-968e1abdff91 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 19:19:31 user nova-compute[74247]: DEBUG nova.compute.manager [-] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Deallocating network for instance {{(pid=74247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 19:19:31 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] deallocate_for_instance() {{(pid=74247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 19:19:31 user nova-compute[74247]: DEBUG nova.network.neutron [-] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Updating instance_info_cache with network_info: [] {{(pid=74247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 19:19:31 user nova-compute[74247]: INFO nova.compute.manager [-] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Took 0.67 seconds to deallocate network for instance.
Oct 16 19:19:31 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-234800ee-45d8-488f-9611-968e1abdff91 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:19:31 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-234800ee-45d8-488f-9611-968e1abdff91 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:19:31 user nova-compute[74247]: DEBUG nova.compute.manager [req-a44a60dd-4d00-43a0-aa20-8125610e52e9 req-fecbcbcc-c270-4154-8d97-c610c0b1cf81 service nova] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Received event network-vif-deleted-0efc8452-2a89-4e9e-8ad3-c97c142fbbe2 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:19:31 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-234800ee-45d8-488f-9611-968e1abdff91 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 19:19:31 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-234800ee-45d8-488f-9611-968e1abdff91 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 19:19:31 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-234800ee-45d8-488f-9611-968e1abdff91 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.112s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:19:31 user nova-compute[74247]: INFO nova.scheduler.client.report [None req-234800ee-45d8-488f-9611-968e1abdff91 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Deleted allocations for instance 17ccd1c6-817a-4421-b043-a8229feb0a29
Oct 16 19:19:31 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-234800ee-45d8-488f-9611-968e1abdff91 tempest-TestServerVolumeAttachmentScenario-257558189 tempest-TestServerVolumeAttachmentScenario-257558189-project-member] Lock "17ccd1c6-817a-4421-b043-a8229feb0a29" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.820s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:19:32 user nova-compute[74247]: DEBUG nova.compute.manager [req-0b51514b-7624-4214-a398-31d5f4484d11 req-32c1309e-a77e-4acb-9f1e-4e5454fe1bfe service nova] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Received event network-vif-plugged-0efc8452-2a89-4e9e-8ad3-c97c142fbbe2 {{(pid=74247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 19:19:32 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0b51514b-7624-4214-a398-31d5f4484d11 req-32c1309e-a77e-4acb-9f1e-4e5454fe1bfe service nova] Acquiring lock "17ccd1c6-817a-4421-b043-a8229feb0a29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:19:32 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0b51514b-7624-4214-a398-31d5f4484d11 req-32c1309e-a77e-4acb-9f1e-4e5454fe1bfe service nova] Lock "17ccd1c6-817a-4421-b043-a8229feb0a29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:19:32 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [req-0b51514b-7624-4214-a398-31d5f4484d11 req-32c1309e-a77e-4acb-9f1e-4e5454fe1bfe service nova] Lock "17ccd1c6-817a-4421-b043-a8229feb0a29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:19:32 user nova-compute[74247]: DEBUG nova.compute.manager [req-0b51514b-7624-4214-a398-31d5f4484d11 req-32c1309e-a77e-4acb-9f1e-4e5454fe1bfe service nova] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] No waiting events found dispatching network-vif-plugged-0efc8452-2a89-4e9e-8ad3-c97c142fbbe2 {{(pid=74247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 19:19:32 user nova-compute[74247]: WARNING nova.compute.manager [req-0b51514b-7624-4214-a398-31d5f4484d11 req-32c1309e-a77e-4acb-9f1e-4e5454fe1bfe service nova] [instance: 17ccd1c6-817a-4421-b043-a8229feb0a29] Received unexpected event network-vif-plugged-0efc8452-2a89-4e9e-8ad3-c97c142fbbe2 for instance with vm_state deleted and task_state None.
Oct 16 19:19:35 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:19:38 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:19:39 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:19:39 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 19:19:39 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Rebuilding the list of instances to heal {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 19:19:39 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Didn't find any instances for network info cache update. {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 19:19:39 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:19:40 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:19:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:19:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:19:40 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:19:40 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 19:19:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:19:41 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:19:41 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:19:41 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=9110MB free_disk=24.86042022705078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 19:19:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:19:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:19:41 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 19:19:41 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 19:19:41 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 19:19:41 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 19:19:41 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 19:19:41 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:19:42 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:19:44 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:19:45 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:19:46 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:19:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:19:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:19:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:19:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:19:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:19:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:19:52 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:19:52 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 19:19:55 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:19:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:20:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:20:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:20:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:20:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:20:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:20:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:20:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:20:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:20:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:20:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:20:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:20:27 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:20:28 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:20:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:20:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:20:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:20:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:20:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:20:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:20:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:20:39 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:20:39 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:20:40 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:20:40 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 19:20:40 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Rebuilding the list of instances to heal {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 19:20:40 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Didn't find any instances for network info cache update. {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 19:20:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:20:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:20:41 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:20:41 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:20:42 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:20:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:20:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:20:42 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:20:42 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 19:20:43 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:20:43 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:20:43 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=9136MB free_disk=24.859336853027344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 19:20:43 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:20:43 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:20:43 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 19:20:43 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 19:20:43 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 19:20:43 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 19:20:43 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 19:20:43 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.113s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:20:44 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:20:44 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._sync_power_states {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:20:44 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:20:46 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:20:46 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:20:49 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:20:49 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Cleaning up deleted instances with incomplete migration  {{(pid=74247) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 16 19:20:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:20:53 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:20:53 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 19:20:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:20:56 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:21:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:21:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:21:08 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:21:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:21:11 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:21:11 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Cleaning up deleted instances {{(pid=74247) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 16 19:21:11 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] There are 0 instances to clean {{(pid=74247) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 16 19:21:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:21:21 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:21:26 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:21:28 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:21:31 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:21:36 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:21:40 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:21:40 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Starting heal instance info cache {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 19:21:40 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Rebuilding the list of instances to heal {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 19:21:40 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Didn't find any instances for network info cache update. {{(pid=74247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 19:21:41 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:21:41 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:21:43 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:21:43 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:21:43 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:21:43 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:21:43 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:21:43 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:21:43 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Auditing locally available compute resources for user (node: user) {{(pid=74247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 19:21:44 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:21:44 user nova-compute[74247]: WARNING nova.virt.libvirt.driver [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 19:21:44 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Hypervisor/Node resource view: name=user free_ram=9119MB free_disk=24.857746124267578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 19:21:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 19:21:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 19:21:44 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 19:21:44 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 19:21:44 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Refreshing inventories for resource provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 16 19:21:44 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Updating ProviderTree inventory for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 16 19:21:44 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Updating inventory in ProviderTree for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 16 19:21:44 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Refreshing aggregate associations for resource provider 7b8a7b7b-c686-4162-903b-700fbc4d7273, aggregates: None {{(pid=74247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 16 19:21:44 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Refreshing trait associations for resource provider 7b8a7b7b-c686-4162-903b-700fbc4d7273, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=74247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 16 19:21:44 user nova-compute[74247]: DEBUG nova.compute.provider_tree [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed in ProviderTree for provider: 7b8a7b7b-c686-4162-903b-700fbc4d7273 {{(pid=74247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 19:21:44 user nova-compute[74247]: DEBUG nova.scheduler.client.report [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Inventory has not changed for provider 7b8a7b7b-c686-4162-903b-700fbc4d7273 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 19:21:44 user nova-compute[74247]: DEBUG nova.compute.resource_tracker [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Compute_service record updated for user:user {{(pid=74247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 19:21:44 user nova-compute[74247]: DEBUG oslo_concurrency.lockutils [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.275s {{(pid=74247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 19:21:45 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:21:46 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:21:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:21:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:21:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:21:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:21:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:21:51 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:21:54 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:21:54 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:21:54 user nova-compute[74247]: DEBUG nova.compute.manager [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 19:21:56 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:21:58 user nova-compute[74247]: DEBUG oslo_service.periodic_task [None req-4b2965df-538d-4fea-b4e0-d347d73b6c7b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 19:22:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:22:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:22:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:22:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:22:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:22:01 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:22:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:22:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:22:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:22:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:22:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:22:06 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:22:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:22:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 19:22:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 19:22:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:22:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 19:22:11 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 19:22:16 user nova-compute[74247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}